forked from mlrun/mlrun
-
Notifications
You must be signed in to change notification settings - Fork 0
/
Copy pathextras-requirements.txt
39 lines (39 loc) · 2.3 KB
/
extras-requirements.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
# In our docker images we're copying the requirements files and pip installing them before copying and installing the
# whole code. We're doing that to leverage docker build cache so that we won't need to actually install all the
# requirements for every change in the code (which causes a cache miss in the copy command for the whole code) but we'll
# get "requirement is already satisfied" which causes the pip install of the mlrun package itself to be very quick.
# The extras requirements definition sits in the setup.py itself, therefore without this file these requirements were
# installed only in the last phase of installing mlrun, which causes this step to be longer and lowers the effectiveness
# of the above trick. To overcome this we have this file, which is a copy of all the requirements defined in the extras
# in setup.py so that we'll be able to copy and install this in the layer with all other requirements making the last
# layer (which is most commonly being re-built) as thin as possible
# we have a test test_extras_requirement_file_aligned to verify this file is aligned to setup.py
boto3>=1.24.59,<1.27
aiobotocore>=2.4.2,<2.6
s3fs>=2023.1,<2023.7
# https://github.com/Azure/azure-sdk-for-python/issues/24765#issuecomment-1150310498
msrest~=0.6.21
azure-core~=1.24
# Excluding 12.18.0 due to https://github.com/Azure/azure-sdk-for-python/issues/32056
azure-storage-blob>=12.13, !=12.18.0
adlfs>=2022.2,<2023.5
azure-identity~=1.5
azure-keyvault-secrets~=4.2
# cryptography>=39, which is required by azure, needs this, or else we get
# AttributeError: module 'lib' has no attribute 'OpenSSL_add_all_algorithms' (ML-3471)
pyopenssl>=23
bokeh~=2.4, >=2.4.2
gcsfs>=2023.1,<2023.7
# plotly artifact body in 5.12.0 may contain chars that are not encodable in 'latin-1' encoding
# so, it cannot be logged as artifact (raised UnicodeEncode error - ML-3255)
plotly~=5.4, <5.12.0
# To support python 11, google-cloud-bigquery requires grpcio>=1.49.1, which is incompatible with the grpcio version
# required by frames (because it upgrades protobuf from 3.x to 4.x, breaking binary compatibility)
google-cloud-bigquery[pandas, bqstorage]~=3.2
kafka-python~=2.0
avro~=1.11
redis~=4.3
graphviz~=0.20.0
databricks-sdk~=0.3.0
# sqlalchemy version should be aligned with mlrun-api due to common use with the model monitoring database
sqlalchemy~=1.4