New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Update max num tokens workflow, fix multiple bugs #2012

Merged

ydm-amazon merged 1 commit into deepjavalibrary:master from ydm-amazon:max_num_tokens_workflow_changes

Jun 3, 2024

Contributor

ydm-amazon commented Jun 3, 2024 •

edited

Loading

This is the branch I was using to run all the max_num_tokens numbers for 0.28.0; it contains lots of small changes.

double check cleaning model artifacts directory
multiple tries for model downloading
fallback to aws s3 cp from s5cmd
error handling for cases of non OOM error
better logging
timeout increased
increase shared memory size
mount to nvme instead of EBS volume
add g6.12xlarge


          update max num tokens workflow, fix multiple bugs

0c9abd1

ydm-amazon marked this pull request as ready for review

June 3, 2024 19:01

ydm-amazon requested review from zachgk, frankfliu and a team as code owners

June 3, 2024 19:01

lanking520 approved these changes

View reviewed changes

ydm-amazon merged commit 3c95420 into deepjavalibrary:master

8 checks passed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet