Skip to content

Commit

Permalink
Merge branch 'master' into feature/drop-python-3.8
Browse files Browse the repository at this point in the history
  • Loading branch information
lokeshrangineni authored Mar 18, 2024
2 parents dfd1248 + be52772 commit 2dcd786
Show file tree
Hide file tree
Showing 11 changed files with 90 additions and 118 deletions.
7 changes: 4 additions & 3 deletions docs/reference/online-stores/hazelcast.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,17 +2,17 @@

## Description

Hazelcast online store is in alpha development.
The Hazelcast online store is in alpha development.

The [Hazelcast](htpps://hazelcast.com) online store provides support for materializing feature values into a Hazelcast cluster for serving online features in real-time.
In order to use Hazelcast as online store, you need to have a running Hazelcast cluster. You can create a cluster using Hazelcast Viridian Serverless. See this [getting started](https://hazelcast.com/get-started/) page for more details.
In order to use Hazelcast as an online store, you need to have a running Hazelcast cluster. You can create a cluster using Hazelcast Viridian Serverless. See this [getting started](https://hazelcast.com/get-started/) page for more details.

* Each feature view is mapped one-to-one to a specific Hazelcast IMap
* This implementation inherits all strengths of Hazelcast such as high availability, fault-tolerance, and data distribution.
* Secure TSL/SSL connection is supported by Hazelcast online store.
* You can set TTL (Time-To-Live) setting for your features in Hazelcast cluster.

Each feature view corresponds to an IMap in Hazelcast cluster and the entries in that IMap corresponds to features of entities.
Each feature view corresponds to an IMap in Hazelcast cluster and the entries in that IMap correspond to features of entities.
Each feature value stored separately and can be retrieved individually.

## Getting started
Expand All @@ -33,6 +33,7 @@ online_store:
cluster_members: ["localhost:5701"]
key_ttl_seconds: 36000
```
{% endcode %}
## Functionality Matrix
Expand Down
2 changes: 1 addition & 1 deletion go.mod
Original file line number Diff line number Diff line change
Expand Up @@ -15,7 +15,7 @@ require (
github.com/spaolacci/murmur3 v1.1.0
github.com/stretchr/testify v1.7.0
google.golang.org/grpc v1.56.3
google.golang.org/protobuf v1.30.0
google.golang.org/protobuf v1.33.0
)

require (
Expand Down
3 changes: 2 additions & 1 deletion go.sum
Original file line number Diff line number Diff line change
Expand Up @@ -1826,8 +1826,9 @@ google.golang.org/protobuf v1.27.1/go.mod h1:9q0QmTI4eRPtz6boOQmLYwt+qCgq0jsYwAQ
google.golang.org/protobuf v1.28.0/go.mod h1:HV8QOd/L58Z+nl8r43ehVNZIU/HEI6OcFqwMG9pJV4I=
google.golang.org/protobuf v1.28.1/go.mod h1:HV8QOd/L58Z+nl8r43ehVNZIU/HEI6OcFqwMG9pJV4I=
google.golang.org/protobuf v1.29.1/go.mod h1:HV8QOd/L58Z+nl8r43ehVNZIU/HEI6OcFqwMG9pJV4I=
google.golang.org/protobuf v1.30.0 h1:kPPoIgf3TsEvrm0PFe15JQ+570QVxYzEvvHqChK+cng=
google.golang.org/protobuf v1.30.0/go.mod h1:HV8QOd/L58Z+nl8r43ehVNZIU/HEI6OcFqwMG9pJV4I=
google.golang.org/protobuf v1.33.0 h1:uNO2rsAINq/JlFpSdYEKIZ0uKD/R9cpdv0T+yoGwGmI=
google.golang.org/protobuf v1.33.0/go.mod h1:c6P6GXX6sHbq/GpV6MGZEdwhWPcYBgnhAHhKbcUYpos=
gopkg.in/alecthomas/kingpin.v2 v2.2.6/go.mod h1:FMv+mEhP44yOT+4EoQTLFTRgOQ1FBLkstjWtayDeSgw=
gopkg.in/check.v1 v0.0.0-20161208181325-20d25e280405/go.mod h1:Co6ibVJAznAaIkqp8huTwlJQCZ016jof/cbN4VW5Yz0=
gopkg.in/check.v1 v1.0.0-20180628173108-788fd7840127/go.mod h1:Co6ibVJAznAaIkqp8huTwlJQCZ016jof/cbN4VW5Yz0=
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,7 @@

from feast import flags_helper
from feast.data_source import DataSource
from feast.errors import DataSourceNoNameException
from feast.errors import DataSourceNoNameException, DataSourceNotFoundException
from feast.infra.offline_stores.offline_utils import get_temp_entity_table_name
from feast.protos.feast.core.DataSource_pb2 import DataSource as DataSourceProto
from feast.protos.feast.core.SavedDataset_pb2 import (
Expand Down Expand Up @@ -179,6 +179,7 @@ def get_table_query_string(self) -> str:
logger.exception(
"Spark read of file source failed.\n" + traceback.format_exc()
)
raise DataSourceNotFoundException(self.path)
tmp_table_name = get_temp_entity_table_name()
df.createOrReplaceTempView(tmp_table_name)

Expand Down
56 changes: 23 additions & 33 deletions sdk/python/requirements/py3.10-ci-requirements.txt
Original file line number Diff line number Diff line change
Expand Up @@ -41,7 +41,7 @@ attrs==23.2.0
# bowler
# jsonschema
# referencing
avro==1.10.0
avro==1.11.3
# via feast (setup.py)
azure-core==1.30.1
# via
Expand All @@ -63,11 +63,11 @@ black==22.12.0
# via feast (setup.py)
bleach==6.1.0
# via nbconvert
boto3==1.34.59
boto3==1.34.60
# via
# feast (setup.py)
# moto
botocore==1.34.59
botocore==1.34.60
# via
# boto3
# moto
Expand Down Expand Up @@ -122,14 +122,12 @@ colorama==0.4.6
# via
# feast (setup.py)
# great-expectations
comm==0.2.1
comm==0.2.2
# via
# ipykernel
# ipywidgets
coverage[toml]==7.4.3
# via
# coverage
# pytest-cov
# via pytest-cov
cryptography==42.0.5
# via
# azure-identity
Expand Down Expand Up @@ -215,7 +213,7 @@ google-api-core[grpc]==2.17.1
# google-cloud-datastore
# google-cloud-firestore
# google-cloud-storage
google-api-python-client==2.121.0
google-api-python-client==2.122.0
# via firebase-admin
google-auth==2.28.2
# via
Expand All @@ -228,9 +226,7 @@ google-auth==2.28.2
google-auth-httplib2==0.2.0
# via google-api-python-client
google-cloud-bigquery[pandas]==3.12.0
# via
# feast (setup.py)
# google-cloud-bigquery
# via feast (setup.py)
google-cloud-bigquery-storage==2.24.0
# via feast (setup.py)
google-cloud-bigtable==2.23.0
Expand Down Expand Up @@ -258,7 +254,7 @@ google-resumable-media==2.7.0
# via
# google-cloud-bigquery
# google-cloud-storage
googleapis-common-protos[grpc]==1.62.0
googleapis-common-protos[grpc]==1.63.0
# via
# feast (setup.py)
# google-api-core
Expand Down Expand Up @@ -391,12 +387,12 @@ jsonschema[format-nongpl]==4.21.1
# nbformat
jsonschema-specifications==2023.12.1
# via jsonschema
jupyter-client==8.6.0
jupyter-client==8.6.1
# via
# ipykernel
# jupyter-server
# nbclient
jupyter-core==5.7.1
jupyter-core==5.7.2
# via
# ipykernel
# jupyter-client
Expand All @@ -405,7 +401,7 @@ jupyter-core==5.7.1
# nbclient
# nbconvert
# nbformat
jupyter-events==0.9.0
jupyter-events==0.9.1
# via jupyter-server
jupyter-lsp==2.2.4
# via jupyterlab
Expand All @@ -416,13 +412,13 @@ jupyter-server==2.13.0
# jupyterlab-server
# notebook
# notebook-shim
jupyter-server-terminals==0.5.2
jupyter-server-terminals==0.5.3
# via jupyter-server
jupyterlab==4.1.4
# via notebook
jupyterlab-pygments==0.3.0
# via nbconvert
jupyterlab-server==2.25.3
jupyterlab-server==2.25.4
# via
# jupyterlab
# notebook
Expand Down Expand Up @@ -485,13 +481,13 @@ mypy-extensions==1.0.0
# via
# black
# mypy
mypy-protobuf==3.1.0
mypy-protobuf==3.3.0
# via feast (setup.py)
nbclient==0.9.0
nbclient==0.9.1
# via nbconvert
nbconvert==7.16.2
# via jupyter-server
nbformat==5.9.2
nbformat==5.10.2
# via
# great-expectations
# jupyter-server
Expand Down Expand Up @@ -651,7 +647,7 @@ pycodestyle==2.10.0
# via flake8
pycparser==2.21
# via cffi
pydantic==2.6.3
pydantic==2.6.4
# via
# fastapi
# feast (setup.py)
Expand Down Expand Up @@ -830,9 +826,7 @@ sniffio==1.3.1
snowballstemmer==2.2.0
# via sphinx
snowflake-connector-python[pandas]==3.7.1
# via
# feast (setup.py)
# snowflake-connector-python
# via feast (setup.py)
sortedcontainers==2.4.0
# via snowflake-connector-python
soupsieve==2.5
Expand All @@ -852,9 +846,7 @@ sphinxcontrib-qthelp==1.0.7
sphinxcontrib-serializinghtml==1.1.10
# via sphinx
sqlalchemy[mypy]==1.4.52
# via
# feast (setup.py)
# sqlalchemy
# via feast (setup.py)
sqlalchemy2-stubs==0.0.2a38
# via sqlalchemy
sqlglot==20.11.0
Expand All @@ -869,7 +861,7 @@ tabulate==0.9.0
# via feast (setup.py)
tenacity==8.2.3
# via feast (setup.py)
terminado==0.18.0
terminado==0.18.1
# via
# jupyter-server
# jupyter-server-terminals
Expand Down Expand Up @@ -911,7 +903,7 @@ tqdm==4.66.2
# via
# feast (setup.py)
# great-expectations
traitlets==5.14.1
traitlets==5.14.2
# via
# comm
# ipykernel
Expand Down Expand Up @@ -994,9 +986,7 @@ urllib3==1.26.18
# responses
# rockset
uvicorn[standard]==0.28.0
# via
# feast (setup.py)
# uvicorn
# via feast (setup.py)
uvloop==0.19.0
# via uvicorn
virtualenv==20.23.0
Expand All @@ -1023,7 +1013,7 @@ websockets==12.0
# via uvicorn
werkzeug==3.0.1
# via moto
wheel==0.42.0
wheel==0.43.0
# via pip-tools
widgetsnbextension==4.0.10
# via ipywidgets
Expand Down
12 changes: 4 additions & 8 deletions sdk/python/requirements/py3.10-requirements.txt
Original file line number Diff line number Diff line change
Expand Up @@ -93,7 +93,7 @@ mypy==1.9.0
# via sqlalchemy
mypy-extensions==1.0.0
# via mypy
mypy-protobuf==3.1.0
mypy-protobuf==3.5.0
# via feast (setup.py)
numpy==1.24.4
# via
Expand All @@ -117,7 +117,7 @@ protobuf==4.25.3
# proto-plus
pyarrow==15.0.1
# via feast (setup.py)
pydantic==2.6.3
pydantic==2.6.4
# via
# fastapi
# feast (setup.py)
Expand Down Expand Up @@ -153,9 +153,7 @@ sniffio==1.3.1
# anyio
# httpx
sqlalchemy[mypy]==1.4.52
# via
# feast (setup.py)
# sqlalchemy
# via feast (setup.py)
sqlalchemy2-stubs==0.0.2a38
# via sqlalchemy
starlette==0.36.3
Expand Down Expand Up @@ -193,9 +191,7 @@ tzdata==2024.1
urllib3==2.2.1
# via requests
uvicorn[standard]==0.28.0
# via
# feast (setup.py)
# uvicorn
# via feast (setup.py)
uvloop==0.19.0
# via uvicorn
volatile==2.1.0
Expand Down
Loading

0 comments on commit 2dcd786

Please sign in to comment.