Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

docs: Updated Roadmap document #827

Merged
merged 1 commit into from
Dec 3, 2020
Merged

docs: Updated Roadmap document #827

merged 1 commit into from
Dec 3, 2020

Conversation

Golodhros
Copy link
Member

Summary of Changes

Updates our roadmap document to remove already done items
Updates planned features and focus (biased by Lyft's roadmap)

Documentation

Updates the doc

CheckList

Make sure you have checked all steps below to ensure a timely review.

  • PR title addresses the issue accurately and concisely, including a title prefix.
  • PR includes a summary of changes.
  • My commits follow the guidelines from "How to write a good git commit message"

@Golodhros Golodhros requested a review from a team as a code owner November 30, 2020 19:49
Signed-off-by: Marcos Iglesias <miglesiasvalle@lyft.com>
@feng-tao
Copy link
Member

@Golodhros I will take a look later today as well, but I think we should include some of the ongoing RFCs in https://github.com/amundsen-io/rfcs.


*Status*: tech spec out
_What_: We want to create a native lineage integration in Amundsen, to better surface how data assets interact with each other.
Copy link
Member

@feng-tao feng-tao Nov 30, 2020

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

if we are only targeting table level lineage in short term, we may want to make it explicit.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think we want both, and we have designs for both

Copy link
Contributor

@allisonsuarez allisonsuarez left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

thanks!

@Golodhros Golodhros merged commit d8398e3 into master Dec 3, 2020
@feng-tao feng-tao deleted the mi-roadmap branch December 3, 2020 00:27
@feng-tao
Copy link
Member

feng-tao commented Dec 3, 2020

@Golodhros @allisonsuarez I don't think we include the one from @amundsen-io/rfcs ?

@Golodhros
Copy link
Member Author

@Golodhros @allisonsuarez I don't think we include the one from @amundsen-io/rfcs ?

Which one? This https://github.com/amundsen-io/rfcs/blob/master/rfcs/002-databuilder-record-abstraction.md ?

@feng-tao
Copy link
Member

feng-tao commented Dec 3, 2020

amundsen-io/rfcs#10 and amundsen-io/rfcs#13, but let me create a sperate PR to include. Thanks @Golodhros !

@markgrover
Copy link
Contributor

Thanks! While we are at it, should we include a minor update to the push API?
Say, something like:

Possible through [Kafka extractor](https://github.com/amundsen-io/amundsendatabuilder/blob/master/databuilder/extractor/kafka_source_extractor.py), though message format is not well defined. More work not planned.

Flexible here, thoughts?

@Golodhros
Copy link
Member Author

amundsen-io/rfcs#10 and amundsen-io/rfcs#13, but let me create a sperate PR to include. Thanks @Golodhros !

Makes sense!

@Golodhros
Copy link
Member Author

Thanks! While we are at it, should we include a minor update to the push API?
Say, something like:

Possible through [Kafka extractor](https://github.com/amundsen-io/amundsendatabuilder/blob/master/databuilder/extractor/kafka_source_extractor.py), though message format is not well defined. More work not planned.

Flexible here, thoughts?

Could you include this in your PR @feng-tao ?

@feng-tao
Copy link
Member

feng-tao commented Dec 3, 2020

sure

dorianj pushed a commit to dorianj/amundsen that referenced this pull request Apr 25, 2021
Signed-off-by: Marcos Iglesias <miglesiasvalle@lyft.com>
feng-tao pushed a commit that referenced this pull request May 7, 2021
Signed-off-by: Marcos Iglesias <miglesiasvalle@lyft.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants