Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove exclusions from serving #607

Merged

Conversation

zhilingc
Copy link
Collaborator

@zhilingc zhilingc commented Apr 6, 2020

What this PR does / why we need it:
Doesn't exactly solve the issue where the bigquery connector as a whole depends on beam-sdks-java-io-google-cloud-platform, which Serving therefore transitively depends on, but removes the offending packages within beam-sdks-java-io-google-cloud-platform it so that the bigquery connector can be imported wholesale by Serving without any dependency clashes.

I've considered removing beam-sdks-java-io-google-cloud-platform from the bigquery connector entirely, and implementing a custom write transform, but for it to retain the same level of reliability as the existing BigQueryIO would require quite significant dev effort.

@feast-ci-bot
Copy link
Collaborator

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: zhilingc

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@zhilingc zhilingc requested review from ches and removed request for pradithya, davidheryanto and khorshuheng April 6, 2020 06:17
@woop
Copy link
Member

woop commented Apr 6, 2020

/lgtm

@feast-ci-bot feast-ci-bot merged this pull request into feast-dev:storage-refactor Apr 6, 2020
feast-ci-bot pushed a commit that referenced this pull request Apr 7, 2020
…567)

* Add storage interfaces, basic file structure (#529)

* Add storage interfaces, basic file structure

* Apply spotless, add comments

* Move parseResponse and isEmpty to response object

* Make changes to write interface to be more beam-like

* Pass feature specs to the retriever

* Pass feature specs to online retriever

* Add FeatureSetRequest

* Add mistakenly removed TestUtil

* Add mistakenly removed TestUtil

* Add BigQuery storage (#546)

* Add Redis storage implementation (#547)

* Add Redis storage

* Remove staleness check; can be checked at the service level

* Remove staleness related tests

* Add dependencies to top level pom

* Clean up code

* Change serving and ingestion to use storage API (#553)

* Change serving and ingestion to use storage API

* Remove extra exclusion clause

* Storage refactor API and docstring tweaks (#569)

* API and docstring tweaks

* Fix javadoc linting errors

* Apply spotless

* Fix javadoc formatting

* Drop result from HistoricalRetrievalResult constructors

* Change pipeline to use DeadletterSink API (#586)

* Add better code docs to storage refactor (#601)

* Add better code documentation, make GetFeastServingInfo independent of retriever

* Make getStagingLocation method of historical retriever

* Apply spotless

* Clean up dependencies, remove exclusions at serving (#607)

* Clean up OnlineServingService code (#605)

* Clean up OnlineServingService code to be more readable

* Revert Metrics

* Rename storage API packages to nouns
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants