Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use matrix to build docker images on buildkite #36409

Merged
merged 3 commits into from
Jun 15, 2023

Conversation

aslonnie
Copy link
Collaborator

Avoid copy and pasting the same code on pipeline definitions.

Signed-off-by: Lonnie Liu <lonnie@anyscale.com>
@aslonnie aslonnie changed the title Use matrix to build docker images. Use matrix to build docker images on buildkite Jun 14, 2023
@aslonnie
Copy link
Collaborator Author

aslonnie commented Jun 14, 2023

manual branch run that shows that matrix works: https://buildkite.com/ray-project/oss-ci-build-branch/builds/4472#0188b872-125a-4f81-8834-938f09891b16

auto PR run does not show the matrix because it is (incorrectly) skipped.

…ocker

Signed-off-by: Lonnie Liu <lonnie@anyscale.com>
@matthewdeng
Copy link
Contributor

@aslonnie can you resolve conflicts on this one?

…ocker

Signed-off-by: Lonnie Liu <lonnie@anyscale.com>
@aslonnie
Copy link
Collaborator Author

can you resolve conflicts on this one?

done.

Copy link
Contributor

@matthewdeng matthewdeng left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.


via GIPHY

@@ -56,81 +56,32 @@
# - if [ "$BUILDKITE_BRANCH" == "master" ]; then python .buildkite/copy_files.py --destination wheels --path ./.whl; fi


- label: ":mechanical_arm: :docker: Build Images: py37 [aarch64] (1/2)"
- label: ":mechanical_arm: :docker: Build Images: {{matrix}} [aarch64] - cpu/cu115/cu116"
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should we convert the versions to matrices as well?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

what do you mean ? you mean cpu/cuda versions?

I think they are structured this way because the wheel building part is shared. it is shard-ed into 2 build steps only for slightly faster build time.

@matthewdeng matthewdeng merged commit 62b4834 into master Jun 15, 2023
@matthewdeng matthewdeng deleted the lonnie-0613-matrixdocker branch June 15, 2023 23:31
krfricke added a commit that referenced this pull request Jun 22, 2023
#36409 updated the job names but missed the cpu/cu115/cu116 image build job names, which now all show up as "py37". This PR fixes these names.

Signed-off-by: Kai Fricke <kai@anyscale.com>
arvind-chandra pushed a commit to lmco/ray that referenced this pull request Aug 31, 2023
Signed-off-by: Lonnie Liu <lonnie@anyscale.com>
Signed-off-by: e428265 <arvind.chandramouli@lmco.com>
arvind-chandra pushed a commit to lmco/ray that referenced this pull request Aug 31, 2023
ray-project#36409 updated the job names but missed the cpu/cu115/cu116 image build job names, which now all show up as "py37". This PR fixes these names.

Signed-off-by: Kai Fricke <kai@anyscale.com>
Signed-off-by: e428265 <arvind.chandramouli@lmco.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants