Skip to content

Commit

Permalink
feat: Move BT chunk processing into retry (#806)
Browse files Browse the repository at this point in the history
Bigtable stream reads are not reliable, and may fail at any time.
Move the chunk processing into the retry section to reduce the number
of read errors that can happen.

Version and cargo update included because of an audit update.

Closes: [SYNC-4508](https://mozilla-hub.atlassian.net/browse/SYNC-4508)

[SYNC-4508]:
https://mozilla-hub.atlassian.net/browse/SYNC-4508?atlOrigin=eyJpIjoiNWRkNTljNzYxNjVmNDY3MDlhMDU5Y2ZhYzA5YTRkZjUiLCJwIjoiZ2l0aHViLWNvbS1KU1cifQ

---------

Co-authored-by: Philip Jenvey <pjenvey@underboss.org>
  • Loading branch information
jrconlin and pjenvey authored Dec 16, 2024
1 parent 53d90aa commit 7edbcc7
Show file tree
Hide file tree
Showing 7 changed files with 679 additions and 403 deletions.
2 changes: 1 addition & 1 deletion .cargo/audit.toml
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
[advisories]
ignore = [
"RUSTSEC-2021-0124", # Bound by tokio restrictions, cargo, reqwest, hyper...
"RUSTSEC-2021-0124", # Bound by tokio restrictions, cargo, reqwest, hyper...
]
4 changes: 2 additions & 2 deletions .circleci/config.yml
Original file line number Diff line number Diff line change
Expand Up @@ -53,7 +53,7 @@ commands:
apt install build-essential curl libstdc++6 libstdc++-12-dev libssl-dev pkg-config -y
apt install cmake -y
# RUST_VER
curl https://sh.rustup.rs -sSf | sh -s -- --default-toolchain 1.81 -y
curl https://sh.rustup.rs -sSf | sh -s -- --default-toolchain 1.83 -y
export PATH=$PATH:$HOME/.cargo/bin
echo 'export PATH=$PATH:$HOME/.cargo/bin' >> $BASH_ENV
rustc --version
Expand Down Expand Up @@ -113,7 +113,7 @@ jobs:
audit:
docker:
# NOTE: update version for all # RUST_VER
- image: rust:1.81
- image: rust:1.83
auth:
username: $DOCKER_USER
password: $DOCKER_PASS
Expand Down
Loading

0 comments on commit 7edbcc7

Please sign in to comment.