Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Support Flink 2 (and preview) #126

Open
davidradl opened this issue Oct 2, 2024 · 5 comments
Open

Support Flink 2 (and preview) #126

davidradl opened this issue Oct 2, 2024 · 5 comments

Comments

@davidradl
Copy link
Contributor

There may be a different java version. Also there is a Flink lineage tracing capability that we may want to take advantage of. The dev list has a post proposing lots of deliverables for v1 pre lineage and V1 with lineage and V2 Kafka connector.
@davidradl davidradl changed the title Support Flink 2 Support Flink 2 (and preview) Oct 2, 2024
@davidradl
Copy link
Contributor Author

I am happy to work on this. @kzarzycki

@kzarzycki
Copy link
Member

Sure @davidradl ! If you needed help with lineage APIs and/or OpenLineage, our colleagues from Getindata actually implemented it, like @pawel-big-lebowski :)
I will also help with getting reviewers for that.

@davidradl
Copy link
Contributor Author

Sure @davidradl ! If you needed help with lineage APIs and/or OpenLineage, our colleagues from Getindata actually implemented it, like @pawel-big-lebowski :) I will also help with getting reviewers for that.

sounds good. I will see how the Kafka connector plays out, in terms of java levels. before looking at this.

@pawel-big-lebowski
Copy link

@davidradl I think we should be ready soon with the first version of job listener that converts Flink lineage into OpenLineage events. We'll bring more details during Flink Forward talk https://www.flink-forward.org/berlin-2024/agenda#data-lineage-for-apache-flink-with-openlineage

@davidradl
Copy link
Contributor Author

@davidradl I think we should be ready soon with the first version of job listener that converts Flink lineage into OpenLineage events. We'll bring more details during Flink Forward talk https://www.flink-forward.org/berlin-2024/agenda#data-lineage-for-apache-flink-with-openlineage

sounds good - I am attending so will come along and say hello!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@pawel-big-lebowski @kzarzycki @davidradl