arcticdb v5.2.0 #382

regro-cf-autotick-bot · 2025-01-17T15:51:17Z

It is very likely that the current package version for this feedstock is out of date.

Checklist before merging this PR:

Dependencies have been updated if changed: see upstream
Tests have passed
Updated license if changed and license_file is packaged

Information about this PR:

Feel free to push to the bot's branch to update this PR if needed.
The bot will almost always only open one PR per version.
The bot will stop issuing PRs if more than 3 version bump PRs generated by the bot are open. If you don't want to package a particular version please close the PR.
If you want these PRs to be merged automatically, make an issue with @conda-forge-admin,please add bot automerge in the title and merge the resulting PR. This command will add our bot automerge feature to your feedstock.
If this PR was opened in error or needs to be updated please add the bot-rerun label to this PR. The bot will close this PR and schedule another one. If you do not have permissions to add this label, you can use the phrase @conda-forge-admin, please rerun bot in a PR comment to have the conda-forge-admin add it for you.

Pending Dependency Version Updates

Here is a list of all the pending dependency version updates for this repo. Please double check all dependencies before merging.

Name	Upstream Version	Current Version
libmongocxx	4.0.0-1
msgpack-c	7.0.0
protobuf	29.3

_{This PR was created by the regro-cf-autotick-bot. The regro-cf-autotick-bot is a service to automatically track the dependency graph, migrate packages, and propose package version updates for conda-forge. Feel free to drop us a line if there are any issues! This PR was generated by https://github.com/regro/cf-scripts/actions/runs/12832181675 - please use this URL for debugging.}

…nda-forge-pinning 2025.01.17.07.43.33

conda-forge-admin · 2025-01-17T15:52:48Z

Hi! This is the friendly automated conda-forge-linting service.

I just wanted to let you know that I linted all conda-recipes in your PR (recipe/meta.yaml) and found it was in an excellent condition.

I do have some suggestions for making it better though...

For recipe/meta.yaml:

ℹ️ The recipe is not parsable by parser conda-souschef (grayskull). This parser is not currently used by conda-forge, but may be in the future. We are collecting information to see which recipes are compatible with grayskull.

_{This message was generated by GitHub Actions workflow run https://github.com/conda-forge/conda-forge-webservices/actions/runs/12832555117. Examine the logs at this URL for more detail.}

Signed-off-by: Julien Jerphanion <git@jjerphan.xyz>

conda-forge-admin · 2025-01-17T16:05:45Z

Hi! This is the friendly automated conda-forge-linting service.

I just wanted to let you know that I linted all conda-recipes in your PR (recipe/meta.yaml) and found it was in an excellent condition.

jjerphan · 2025-01-17T16:08:19Z

@conda-forge-admin, please rerender

…nda-forge-pinning 2025.01.17.07.43.33

… 5.2.0_h8c6ba2

conda-forge-admin · 2025-01-24T12:34:42Z

Hi! This is the friendly automated conda-forge-linting service.

I failed to even lint the recipe, probably because of a conda-smithy bug 😢. This likely indicates a problem in your meta.yaml, though. To get a traceback to help figure out what's going on, install conda-smithy and run conda smithy recipe-lint --conda-forge . from the recipe directory. You can also examine the workflow logs for more detail.

_{This message was generated by GitHub Actions workflow run https://github.com/conda-forge/conda-forge-webservices/actions/runs/12949708485. Examine the logs at this URL for more detail.}

conda-forge-admin · 2025-01-24T13:56:24Z

Hi! This is the friendly automated conda-forge-linting service.

I just wanted to let you know that I linted all conda-recipes in your PR (recipe/meta.yaml) and found it was in an excellent condition.

jjerphan

Might the error observed for osx i.e. (for osx_arm64):

  ERROR (arcticdb,lib/python3.11/site-packages/arcticdb_ext.cpython-311-darwin.so): Needed DSO lib/libabsl_log_internal_check_op.2407.0.0.dylib found in ['conda-forge/osx-arm64::libabseil==20240722.0=cxx17_h07bc746_4']
  ERROR (arcticdb,lib/python3.11/site-packages/arcticdb_ext.cpython-311-darwin.so): .. but ['conda-forge/osx-arm64::libabseil==20240722.0=cxx17_h07bc746_4'] not in reqs/run, (i.e. it is overlinking) (likely) or a missing dependency (less likely)
  ERROR (arcticdb,lib/python3.11/site-packages/arcticdb_ext.cpython-311-darwin.so): Needed DSO lib/libabsl_log_internal_message.2407.0.0.dylib found in ['conda-forge/osx-arm64::libabseil==20240722.0=cxx17_h07bc746_4']
  ERROR (arcticdb,lib/python3.11/site-packages/arcticdb_ext.cpython-311-darwin.so): .. but ['conda-forge/osx-arm64::libabseil==20240722.0=cxx17_h07bc746_4'] not in reqs/run, (i.e. it is overlinking) (likely) or a missing dependency (less likely)
  ERROR (arcticdb,lib/python3.11/site-packages/arcticdb_ext.cpython-311-darwin.so): Needed DSO lib/libabsl_log_internal_nullguard.2407.0.0.dylib found in ['conda-forge/osx-arm64::libabseil==20240722.0=cxx17_h07bc746_4']
  ERROR (arcticdb,lib/python3.11/site-packages/arcticdb_ext.cpython-311-darwin.so): .. but ['conda-forge/osx-arm64::libabseil==20240722.0=cxx17_h07bc746_4'] not in reqs/run, (i.e. it is overlinking) (likely) or a missing dependency (less likely)
  ERROR (arcticdb,lib/python3.11/site-packages/arcticdb_ext.cpython-311-darwin.so): Needed DSO lib/libabsl_hash.2407.0.0.dylib found in ['conda-forge/osx-arm64::libabseil==20240722.0=cxx17_h07bc746_4']
  ERROR (arcticdb,lib/python3.11/site-packages/arcticdb_ext.cpython-311-darwin.so): .. but ['conda-forge/osx-arm64::libabseil==20240722.0=cxx17_h07bc746_4'] not in reqs/run, (i.e. it is overlinking) (likely) or a missing dependency (less likely)

be due to conda-forge/abseil-cpp-feedstock#87?

In the short term, we can try adding this to recipe/conda_build_config:

diff --git i/recipe/conda_build_config.yaml w/recipe/conda_build_config.yaml
index 5171a6e..ee3e634 100644
--- i/recipe/conda_build_config.yaml
+++ w/recipe/conda_build_config.yaml
@@ -1,3 +1,9 @@
+# Use clang and clang++ 17 due to ABI changes in abseil
+# See: https://github.com/conda-forge/abseil-cpp-feedstock/issues/87
+c_compiler_version:            # [osx]
+  - 17                         # [osx]
+cxx_compiler_version:          # [osx]
+  - 17                         # [osx]
 MACOSX_SDK_VERSION:        # [osx and x86_64]
   - "11.0"                 # [osx and x86_64]
 c_stdlib_version:          # [osx and x86_64]

and re-rendering.

ognyanstoimenov · 2025-01-24T15:41:34Z

Might the error observed for osx i.e. (for osx_arm64):

  ERROR (arcticdb,lib/python3.11/site-packages/arcticdb_ext.cpython-311-darwin.so): Needed DSO lib/libabsl_log_internal_check_op.2407.0.0.dylib found in ['conda-forge/osx-arm64::libabseil==20240722.0=cxx17_h07bc746_4']
  ERROR (arcticdb,lib/python3.11/site-packages/arcticdb_ext.cpython-311-darwin.so): .. but ['conda-forge/osx-arm64::libabseil==20240722.0=cxx17_h07bc746_4'] not in reqs/run, (i.e. it is overlinking) (likely) or a missing dependency (less likely)
  ERROR (arcticdb,lib/python3.11/site-packages/arcticdb_ext.cpython-311-darwin.so): Needed DSO lib/libabsl_log_internal_message.2407.0.0.dylib found in ['conda-forge/osx-arm64::libabseil==20240722.0=cxx17_h07bc746_4']
  ERROR (arcticdb,lib/python3.11/site-packages/arcticdb_ext.cpython-311-darwin.so): .. but ['conda-forge/osx-arm64::libabseil==20240722.0=cxx17_h07bc746_4'] not in reqs/run, (i.e. it is overlinking) (likely) or a missing dependency (less likely)
  ERROR (arcticdb,lib/python3.11/site-packages/arcticdb_ext.cpython-311-darwin.so): Needed DSO lib/libabsl_log_internal_nullguard.2407.0.0.dylib found in ['conda-forge/osx-arm64::libabseil==20240722.0=cxx17_h07bc746_4']
  ERROR (arcticdb,lib/python3.11/site-packages/arcticdb_ext.cpython-311-darwin.so): .. but ['conda-forge/osx-arm64::libabseil==20240722.0=cxx17_h07bc746_4'] not in reqs/run, (i.e. it is overlinking) (likely) or a missing dependency (less likely)
  ERROR (arcticdb,lib/python3.11/site-packages/arcticdb_ext.cpython-311-darwin.so): Needed DSO lib/libabsl_hash.2407.0.0.dylib found in ['conda-forge/osx-arm64::libabseil==20240722.0=cxx17_h07bc746_4']
  ERROR (arcticdb,lib/python3.11/site-packages/arcticdb_ext.cpython-311-darwin.so): .. but ['conda-forge/osx-arm64::libabseil==20240722.0=cxx17_h07bc746_4'] not in reqs/run, (i.e. it is overlinking) (likely) or a missing dependency (less likely)

be due to conda-forge/abseil-cpp-feedstock#87?

In the short term, we can try adding this to recipe/conda_build_config:

diff --git i/recipe/conda_build_config.yaml w/recipe/conda_build_config.yaml
index 5171a6e..ee3e634 100644
--- i/recipe/conda_build_config.yaml
+++ w/recipe/conda_build_config.yaml
@@ -1,3 +1,9 @@
+# Use clang and clang++ 17 due to ABI changes in abseil
+# See: https://github.com/conda-forge/abseil-cpp-feedstock/issues/87
+c_compiler_version:            # [osx]
+  - 17                         # [osx]
+cxx_compiler_version:          # [osx]
+  - 17                         # [osx]
 MACOSX_SDK_VERSION:        # [osx and x86_64]
   - "11.0"                 # [osx and x86_64]
 c_stdlib_version:          # [osx and x86_64]

and re-rendering.

I can try that but the linux is also failing

ognyanstoimenov · 2025-01-24T15:54:11Z

@conda-forge-admin, please rerender

jjerphan · 2025-01-24T15:54:17Z

Yes, this is what I just have seen.

Something seems to overlinks with some of the shared object of libabseil via libprotobuf.

So in the short term we might assume that libabseil is a direct dependency of arcticdb by adding libabseil in the host section, making the shared objects available at runtime.

Gentle ping to @h-vetinari who is knowledgeable on libprotobuf and libabseil. 🙏

conda-forge-admin · 2025-01-24T15:55:37Z

Hi! This is the friendly automated conda-forge-linting service.

I failed to even lint the recipe, probably because of a conda-smithy bug 😢. This likely indicates a problem in your meta.yaml, though. To get a traceback to help figure out what's going on, install conda-smithy and run conda smithy recipe-lint --conda-forge . from the recipe directory. You can also examine the workflow logs for more detail.

_{This message was generated by GitHub Actions workflow run https://github.com/conda-forge/conda-forge-webservices/actions/runs/12953004111. Examine the logs at this URL for more detail.}

conda-forge-admin · 2025-01-24T15:56:40Z

Hi! This is the friendly automated conda-forge-webservice.

I tried to rerender for you but ran into some issues. Please check the output logs of the GitHub Actions workflow below for more details. You can also ping conda-forge/core (using the @ notation) for further assistance or you can try rerendering locally.

The following suggestions might help debug any issues:

Is the recipe/{meta.yaml,recipe.yaml} file valid?
If there is a recipe/conda-build-config.yaml file in the feedstock make sure that it is compatible with the current global pinnnings.
Is the fork used for this PR on an organization or user GitHub account? Automated rerendering via the webservices admin bot only works for user GitHub accounts.

_{This message was generated by GitHub Actions workflow run https://github.com/conda-forge/conda-forge-webservices/actions/runs/12953010286. Examine the logs at this URL for more detail.}

ognyanstoimenov · 2025-01-24T15:59:39Z

@conda-forge-admin, please rerender

conda-forge-admin · 2025-01-24T16:00:14Z

Hi! This is the friendly automated conda-forge-linting service.

I just wanted to let you know that I linted all conda-recipes in your PR (recipe/meta.yaml) and found it was in an excellent condition.

…nda-forge-pinning 2025.01.23.20.59.37

jjerphan · 2025-01-24T16:39:57Z

As discussed with @phoebusm, if you want to add python 3.13 builds with this PR, you can copy .ci_support/migrations/python313.yaml from #364 here, and re-render again to generate .ci_support/*python3.13.____cpython.yaml files for the Python 3.13 builds.

One can also perform the numpy 2 migration similarly with .ci_support/migrations/numpy2.yaml from #353.

My two cents: if I were you, I would decouple step and perform them in this order:

merge this PR as of 2d66dda if checks are successful
perform the numpy 2 migration (by bot-reruning Rebuild for numpy 2.0 #353) and merging the PR
perform the python 3.13 migration (by bot-reruning Rebuild for python 3.13 #364) and merging the PR

h-vetinari · 2025-01-24T22:38:46Z

This seems to be a failure that's pretty easy to fix:

==================================== ERRORS ====================================
_ ERROR collecting python/tests/stress/arcticdb/version_store/test_mem_leaks.py _
ImportError while importing test module '$SRC_DIR/python/tests/stress/arcticdb/version_store/test_mem_leaks.py'.
Hint: make sure your test modules/packages have valid Python names.
Traceback:
../_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_place/lib/python3.9/importlib/__init__.py:127: in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
python/tests/stress/arcticdb/version_store/test_mem_leaks.py:572: in <module>
    from pytest_memray import Stack
E   ModuleNotFoundError: No module named 'pytest_memray'

What open questions regarding abseil/protobuf are there?

ognyanstoimenov · 2025-01-26T18:17:48Z

@conda-forge-admin, please rerender

…nda-forge-pinning 2025.01.26.17.54.52

jjerphan · 2025-01-27T07:08:31Z

@h-vetinari: The error was different then (impromptu overlinkage with libabseil), but nevermind: this is probably more ArcticDB-related.

@ognyanstoimenov: conda-forge/memray-feedstock#44 needs to be merged so that pytest-memray is usable when running the tests.

Edit: it was merged and the workflows re-rendered.

jjerphan

LGTM given 🟢 CI checks.

regro-cf-autotick-bot added 2 commits January 17, 2025 15:50

updated v5.2.0

1763ed7

MNT: Re-rendered with conda-build 25.1.1, conda-smithy 3.45.2, and co…

44178a7

…nda-forge-pinning 2025.01.17.07.43.33

regro-cf-autotick-bot requested review from DerThorsten, G-D-Petrov, Hind-M, IvoDD, JohanMabille, Klaim, alexowens90, jamesmunro, jjerphan, joe-iddon, mehertz, ognyanstoimenov, phoebusm, poodlewars, qc00 and vasil-pashov as code owners January 17, 2025 15:51

jjerphan added 4 commits January 17, 2025 17:00

Remove patch

619f082

Signed-off-by: Julien Jerphanion <git@jjerphan.xyz>

Remove pin on pybind11

f170f55

Signed-off-by: Julien Jerphanion <git@jjerphan.xyz>

Remove pin on python>=3.12

13e86f9

Signed-off-by: Julien Jerphanion <git@jjerphan.xyz>

Remove the old pin_compatible directive on numpy

1c61b14

Signed-off-by: Julien Jerphanion <git@jjerphan.xyz>

MNT: Re-rendered with conda-build 25.1.1, conda-smithy 3.45.2, and co…

89862b9

…nda-forge-pinning 2025.01.17.07.43.33

jjerphan mentioned this pull request Jan 17, 2025

Rebuild for python 3.13 #364

Closed

ognyanstoimenov added 2 commits January 24, 2025 14:32

New version tar and sha

b337911

Merge branch 'main' of github.com:conda-forge/arcticdb-feedstock into…

b093f95

… 5.2.0_h8c6ba2

fix conflict

7f3bc84

jjerphan reviewed Jan 24, 2025

View reviewed changes

ognyanstoimenov force-pushed the 5.2.0_h8c6ba2 branch from c627818 to 7f3bc84 Compare January 24, 2025 15:58

Add libabseil

79c7e6c

MNT: Re-rendered with conda-build 25.1.1, conda-smithy 3.45.3, and co…

2d66dda

…nda-forge-pinning 2025.01.23.20.59.37

Dependancies

53239a3

MNT: Re-rendered with conda-build 25.1.1, conda-smithy 3.45.4, and co…

e7dc268

…nda-forge-pinning 2025.01.26.17.54.52

jjerphan approved these changes Jan 27, 2025

View reviewed changes

ognyanstoimenov merged commit 226a36f into conda-forge:main Jan 27, 2025
15 checks passed

regro-cf-autotick-bot deleted the 5.2.0_h8c6ba2 branch January 27, 2025 12:22

jjerphan mentioned this pull request Jan 27, 2025

Rebuild for aws_sdk_cpp 1.11.489 #386

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

arcticdb v5.2.0 #382

arcticdb v5.2.0 #382

regro-cf-autotick-bot commented Jan 17, 2025

conda-forge-admin commented Jan 17, 2025 •

edited

Loading

conda-forge-admin commented Jan 17, 2025

jjerphan commented Jan 17, 2025

conda-forge-admin commented Jan 24, 2025

conda-forge-admin commented Jan 24, 2025

jjerphan left a comment

ognyanstoimenov commented Jan 24, 2025

ognyanstoimenov commented Jan 24, 2025

jjerphan commented Jan 24, 2025 •

edited

Loading

conda-forge-admin commented Jan 24, 2025

conda-forge-admin commented Jan 24, 2025

ognyanstoimenov commented Jan 24, 2025

conda-forge-admin commented Jan 24, 2025

jjerphan commented Jan 24, 2025 •

edited

Loading

h-vetinari commented Jan 24, 2025

ognyanstoimenov commented Jan 26, 2025

jjerphan commented Jan 27, 2025 •

edited

Loading

jjerphan left a comment

arcticdb v5.2.0 #382

arcticdb v5.2.0 #382

Conversation

regro-cf-autotick-bot commented Jan 17, 2025

Pending Dependency Version Updates

conda-forge-admin commented Jan 17, 2025 • edited Loading

conda-forge-admin commented Jan 17, 2025

jjerphan commented Jan 17, 2025

conda-forge-admin commented Jan 24, 2025

conda-forge-admin commented Jan 24, 2025

jjerphan left a comment

Choose a reason for hiding this comment

ognyanstoimenov commented Jan 24, 2025

ognyanstoimenov commented Jan 24, 2025

jjerphan commented Jan 24, 2025 • edited Loading

conda-forge-admin commented Jan 24, 2025

conda-forge-admin commented Jan 24, 2025

ognyanstoimenov commented Jan 24, 2025

conda-forge-admin commented Jan 24, 2025

jjerphan commented Jan 24, 2025 • edited Loading

h-vetinari commented Jan 24, 2025

ognyanstoimenov commented Jan 26, 2025

jjerphan commented Jan 27, 2025 • edited Loading

jjerphan left a comment

Choose a reason for hiding this comment

conda-forge-admin commented Jan 17, 2025 •

edited

Loading

jjerphan commented Jan 24, 2025 •

edited

Loading

jjerphan commented Jan 24, 2025 •

edited

Loading

jjerphan commented Jan 27, 2025 •

edited

Loading