Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feast integration #410

Merged
merged 67 commits into from
Sep 20, 2021
Merged
Changes from 1 commit
Commits
Show all changes
67 commits
Select commit Hold shift + click to select a range
03e4553
Initial version
eapolinario Sep 9, 2021
eaab6d3
Add venv to dockerfile
eapolinario Sep 9, 2021
1127e3a
Rename feast integration dir
eapolinario Sep 9, 2021
6bf9808
Configure minio in the image
eapolinario Sep 9, 2021
408bcfd
Refactoring + retrieve offline features
eapolinario Sep 10, 2021
a3cd35e
Remove all_together
eapolinario Sep 10, 2021
ee1f3ce
Attempt to add s3 credentials to image
eapolinario Sep 13, 2021
1c8438d
Fix s3 endpoint
eapolinario Sep 13, 2021
09d3317
custom provider
eapolinario Sep 14, 2021
cb11e46
Transform FeatureView prior to executing queries
eapolinario Sep 14, 2021
611e81a
Set PYTHONPATH
eapolinario Sep 14, 2021
9a23767
Set PYTHONPATH to multiple values
eapolinario Sep 14, 2021
5a9189e
Remove "custom_provider" from path
eapolinario Sep 14, 2021
ec7b202
Replace minio endpoint
eapolinario Sep 14, 2021
bbe59b8
Print env vars
eapolinario Sep 14, 2021
d514ff0
Set FEAST_S3_ENDPOINT_URL while building feature store
eapolinario Sep 14, 2021
c8eeee9
Remove minio credentials from image
eapolinario Sep 14, 2021
7e88f9b
Add aws env vars
eapolinario Sep 14, 2021
5ce165c
Remove mention to local provider
eapolinario Sep 14, 2021
c843f0a
Remove piping of registry object
eapolinario Sep 14, 2021
94b6ba3
Create random path via FlyteContext
eapolinario Sep 14, 2021
25aef0d
Revert "Remove piping of registry object"
eapolinario Sep 14, 2021
564caa2
Clean up feature description and remove debugging statements
eapolinario Sep 14, 2021
ed29d9d
Add tasks up to `train_model`
eapolinario Sep 14, 2021
f7bc8e6
Rename workflow
eapolinario Sep 15, 2021
adc95ad
Comment use of custom provider
eapolinario Sep 15, 2021
de6dc8e
Rename workflow
eapolinario Sep 15, 2021
58d8d1b
fix error in training
samhita-alla Sep 15, 2021
e36fbb8
Add TODO
eapolinario Sep 15, 2021
0aa0dc3
Import feature_eng tasks directly
eapolinario Sep 15, 2021
d5bd529
Add store_online task
eapolinario Sep 15, 2021
4d41e01
Copy remote file to a local file and replace batch_source in materialize
eapolinario Sep 15, 2021
c8d02fe
Add some debugging statements and fix local execution parameter
eapolinario Sep 15, 2021
2490f5f
Add remaining steps to workflow
eapolinario Sep 16, 2021
00fb3bf
Regenerate requirements files
eapolinario Sep 16, 2021
adc6eff
Regenerate requirements and put replacement of remote files back in c…
eapolinario Sep 16, 2021
5c0548f
Add more logging
eapolinario Sep 16, 2021
b2f5f93
Regenerate requirements again
eapolinario Sep 16, 2021
a9326bb
Add workflow return type
eapolinario Sep 16, 2021
4d8d99c
Include a directory prefix in the model filename
eapolinario Sep 16, 2021
8e3eeca
Remove unused overrides in custom provider and comment use of localiz…
eapolinario Sep 16, 2021
a76da5d
Add type transformer
eapolinario Sep 16, 2021
4a9c4f6
Pipe _Feature_Store to all interactions with feast
eapolinario Sep 16, 2021
6cffd57
Remove unnecessary override in custom provider
eapolinario Sep 16, 2021
7ceb257
Rearrange initialization of FeatureStore for better legibility
eapolinario Sep 16, 2021
eef50b7
Revert "Remove unnecessary override in custom provider"
eapolinario Sep 16, 2021
387cb09
Use create_node to enforce order
eapolinario Sep 16, 2021
88bfcfc
Remove unused function
eapolinario Sep 16, 2021
b4c9a46
Guard env vars behind a check
eapolinario Sep 16, 2021
5927b94
Expose inputs to workflow
eapolinario Sep 16, 2021
cb10452
Task to build FeatureStore
eapolinario Sep 16, 2021
6a69588
Do not guard env vars behind a check
eapolinario Sep 16, 2021
4b6b8a1
Experiment with converted_df
eapolinario Sep 16, 2021
66dd862
Comments
eapolinario Sep 16, 2021
3eedd1a
Remove commented code from type transformer
eapolinario Sep 16, 2021
e90aa62
Remove unused portion of sandbox.config
eapolinario Sep 16, 2021
0d57a32
Remove TODO
eapolinario Sep 16, 2021
d8d0659
Remove registry parameter from local execution
eapolinario Sep 16, 2021
87da867
No need for type transformers
eapolinario Sep 16, 2021
e4e0b98
Remove mentions to type transformers
eapolinario Sep 16, 2021
a7a2b3f
Copy README.rst from https://github.com/flyteorg/flytesnacks/pull/322/
eapolinario Sep 16, 2021
4f1222a
Step 3 of guide on adding a new integration
eapolinario Sep 17, 2021
9b14835
Remove extraneous print statement and turn comments into docstrings i…
eapolinario Sep 17, 2021
b76dba8
Comments on README.rst
eapolinario Sep 17, 2021
89d0b8a
Fix link to feast
eapolinario Sep 17, 2021
17fa781
Merge remote-tracking branch 'origin' into feast-integration--pipe-re…
eapolinario Sep 18, 2021
584ef67
Fix serialization of feast_integration dir
eapolinario Sep 18, 2021
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Remove registry parameter from local execution
Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>
  • Loading branch information
eapolinario committed Sep 16, 2021
commit d8d065909bdcba1aeb85efd23d69b83472fd04c2
Original file line number Diff line number Diff line change
Expand Up @@ -250,4 +250,4 @@ def feast_workflow(


if __name__ == "__main__":
print(f"{feast_workflow(registry='registry.db')}")
print(f"{feast_workflow()}")