Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feature: udsink gRPC #16

Merged
merged 23 commits into from
Sep 17, 2022
Merged

feature: udsink gRPC #16

merged 23 commits into from
Sep 17, 2022

Conversation

jy4096
Copy link
Contributor

@jy4096 jy4096 commented Sep 15, 2022

support udsink gRPC

Tested using the pkg/sink/examples/udsink_log.go example
image

jyu6 added 13 commits September 14, 2022 17:18
Signed-off-by: jyu6 <juanlu_yu@intuit.com>
Signed-off-by: jyu6 <juanlu_yu@intuit.com>
Signed-off-by: jyu6 <juanlu_yu@intuit.com>
Signed-off-by: jyu6 <juanlu_yu@intuit.com>
Signed-off-by: jyu6 <juanlu_yu@intuit.com>
Signed-off-by: jyu6 <juanlu_yu@intuit.com>
Signed-off-by: jyu6 <juanlu_yu@intuit.com>
Signed-off-by: jyu6 <juanlu_yu@intuit.com>
Signed-off-by: jyu6 <juanlu_yu@intuit.com>
Signed-off-by: jyu6 <juanlu_yu@intuit.com>
Signed-off-by: jyu6 <juanlu_yu@intuit.com>
Signed-off-by: jyu6 <juanlu_yu@intuit.com>
// In short:
// Add EventTime and Watermark in the Message type
// or
// Delete event_time and watermark in the sink proto file.
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please check this TODO

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I feel like we only need Datum...
Message type is only used in the numaflow project. We can replace sinksdk.Message with sinkpb.Datum.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

removed message type..

Signed-off-by: jyu6 <juanlu_yu@intuit.com>
jyu6 added 4 commits September 16, 2022 09:33
Signed-off-by: jyu6 <juanlu_yu@intuit.com>
Signed-off-by: jyu6 <juanlu_yu@intuit.com>
Signed-off-by: jyu6 <juanlu_yu@intuit.com>
Signed-off-by: jyu6 <juanlu_yu@intuit.com>
@jy4096 jy4096 changed the title Udsink grpc feature: udsink gRPC Sep 16, 2022
@jy4096 jy4096 marked this pull request as ready for review September 16, 2022 17:32
jyu6 added 2 commits September 16, 2022 13:29
Signed-off-by: jyu6 <juanlu_yu@intuit.com>
Signed-off-by: jyu6 <juanlu_yu@intuit.com>
Signed-off-by: jyu6 <juanlu_yu@intuit.com>
@jy4096
Copy link
Contributor Author

jy4096 commented Sep 16, 2022

Do we need key for sink.Datum type??? @whynowy @vigith

=== Update ===
Discussed offline.. not required but we can keep it as for now

jyu6 added 2 commits September 16, 2022 14:38
Signed-off-by: jyu6 <juanlu_yu@intuit.com>
Signed-off-by: jyu6 <juanlu_yu@intuit.com>
@jy4096 jy4096 requested a review from whynowy September 16, 2022 23:09
@whynowy whynowy merged commit 3ec0220 into main Sep 17, 2022
@whynowy whynowy deleted the udsink-grpc branch September 17, 2022 01:02
ashwinidulams pushed a commit to ashwinidulams/numaflow-go that referenced this pull request Mar 6, 2023
* ci: fix kafka e2e test

Signed-off-by: Derek Wang <whynowy@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants