Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

MRG: propagate zipfile errors #3431

Merged
merged 7 commits into from
Dec 15, 2024
Merged

MRG: propagate zipfile errors #3431

merged 7 commits into from
Dec 15, 2024

Conversation

ctb
Copy link
Contributor

@ctb ctb commented Dec 14, 2024

This PR switches from ZipStorageBuilder to ZipStorageTryBuilder in order to propagate errors from bad zip files.

Fixes #3430

Copy link

codecov bot commented Dec 14, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 86.42%. Comparing base (7362b43) to head (4013bc0).
Report is 1 commits behind head on latest.

Additional details and impacted files
@@            Coverage Diff             @@
##           latest    #3431      +/-   ##
==========================================
- Coverage   86.43%   86.42%   -0.02%     
==========================================
  Files         137      137              
  Lines       16103    16103              
  Branches     2219     2219              
==========================================
- Hits        13919    13917       -2     
- Misses       1877     1879       +2     
  Partials      307      307              
Flag Coverage Δ
hypothesis-py 25.43% <ø> (ø)
python 92.40% <ø> (ø)
rust 62.11% <ø> (-0.07%) ⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@ctb
Copy link
Contributor Author

ctb commented Dec 14, 2024

@luizirber ready for review! Will need to bump the sourmash version b/c of header change, I'll deal with that too.

@ctb ctb merged commit d814ba7 into latest Dec 15, 2024
42 of 44 checks passed
@ctb ctb deleted the propagate_zip_errors branch December 15, 2024 12:01
ctb added a commit that referenced this pull request Dec 20, 2024
## [0.18.0] - 2024-12-20

MSRV: 1.66

Changes/additions:

* add skipmer capacity to sourmash python layer via ffi (#3446)
* add skipmers; switch to reading frame approach for translation,
skipmers (#3395)
* Refactor: Use to_writer/from_reader across the codebase (#3443)
* adjust `Signature::name()` to return `Option<String>` instead of
`filename()` and `md5sum()` (#3434)
* propagate zipfile errors (#3431)

Updates:

* Bump proptest from 1.5.0 to 1.6.0 (#3437)
* Bump roaring from 0.10.8 to 0.10.9 (#3438)
* Bump serde from 1.0.215 to 1.0.216 (#3436)
* Bump statrs from 0.17.1 to 0.18.0 (#3426)
* Bump roaring from 0.10.7 to 0.10.8 (#3423)
* Bump needletail from 0.6.0 to 0.6.1 (#3427)
* Bump web-sys from 0.3.72 to 0.3.74 (#3411)
* Bump js-sys from 0.3.72 to 0.3.74 (#3412)
* Bump roaring from 0.10.6 to 0.10.7 (#3413)
* Bump serde_json from 1.0.132 to 1.0.133 (#3402)
* Bump serde from 1.0.214 to 1.0.215 (#3403)
bluegenes added a commit to sourmash-bio/sourmash_plugin_directsketch that referenced this pull request Dec 27, 2024
This PR integrates the changes to `BuildUtils` (`MultiSelection`
details, minor changes to `BuildCollection` filtering + writing) that
arose from integration into branchwater. It also makes the number of
simultaneous downloads tunable, since I was having trouble when using
the 3 default permits with large eukaryotic genomes.

It also handles changes associated with zipfile handling from
sourmash-bio/sourmash#3431 arising from updating
sourmash core to 0.18.0

ref #134
@ctb ctb mentioned this pull request Jan 11, 2025
ctb added a commit that referenced this pull request Jan 11, 2025
Release issue: #3481

----

NOTE: This release adds basic support for skipmers, but they are not
yet fully supported.

Minor new features:

* add genbank plant db to docs (#3429)
* add skipmer capacity to sourmash python layer via ffi (#3446)
* add skipmers; switch to reading frame approach for translation,
skipmers (#3395)
* additional moltype specification needed for `sig downsample` with
skipmers (#3457)
* update with misc animal genomes (#3422)

Cleanup and documentation updates:

* add comment about semver and column headings (#3433)

Developer updates:

* Deps: update to rocksdb 0.23 (#3456)
* Refactor: Use to_writer/from_reader across the codebase (#3443)
* adjust `Signature::name()` to return `Option<String>` instead of
`filename()` and `md5sum()` (#3434)
* bump version to 4.8.13-dev (#3474)
* fix comment in _set_num_scaled (#3451)
* propagate zipfile errors (#3431)
* update rust CHANGELOG in preparation for r0.18.0 (#3450)
* CI: github actions updates (#3476)

Dependabot updates:

* Bump itertools from 0.13.0 to 0.14.0 (#3471)
* Bump needletail from 0.6.0 to 0.6.1 (#3427)
* Bump proptest from 1.5.0 to 1.6.0 (#3437)
* Bump roaring from 0.10.7 to 0.10.8 (#3423)
* Bump roaring from 0.10.8 to 0.10.9 (#3438)
* Bump serde from 1.0.215 to 1.0.216 (#3436)
* Bump serde from 1.0.216 to 1.0.217 (#3464)
* Bump serde_json from 1.0.133 to 1.0.134 (#3453)
* Bump statrs from 0.17.1 to 0.18.0 (#3426)
* Bump tempfile from 3.14.0 to 3.15.0 (#3472)
* Bump thiserror from 2.0.3 to 2.0.6 (#3425)
* Bump thiserror from 2.0.6 to 2.0.7 (#3435)
* Bump thiserror from 2.0.7 to 2.0.8 (#3448)
* Bump thiserror from 2.0.8 to 2.0.9 (#3452)
* Update maturin requirement from <1.8.0,>=1 to >=1,<1.9.0 (#3465)
* [pre-commit.ci] pre-commit autoupdate (#3428)
* [pre-commit.ci] pre-commit autoupdate (#3439)
* [pre-commit.ci] pre-commit autoupdate (#3454)
* [pre-commit.ci] pre-commit autoupdate (#3473)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

ZipStorage panics when failing to open/read zip file
2 participants