Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use AzDO Pipeline Resources to define our build Docker containers #75473

Merged
merged 4 commits into from
Oct 7, 2022

Conversation

jkoritzinsky
Copy link
Member

Refactor all of the docker images we use in our build into AzDO container resources.

Also update all of our pipelines (we have a lot) to use this new format.

This enables a few things:

  1. We can pass the ROOTFS_DIR environment variable as part of the container.
  2. Docker container names are better centralized in an easier to read and easier to parse file.
  3. Reduce duplication of defining container resources for containers used in individual steps (instead of job-wide).
  4. Enable an easy mechanism to reference specific containers that we use job-wide in specific steps.

The vast majority of changes in this PR are whitespace changes. I highly recommend viewing changes either side-by-side (to validate YAML whitespace changes) or with whitespace changes hidden (for the more interesting logic changes in the YAML).

@ghost
Copy link

ghost commented Sep 12, 2022

Tagging subscribers to this area: @dotnet/runtime-infrastructure
See info in area-owners.md if you want to be subscribed.

Issue Details

Refactor all of the docker images we use in our build into AzDO container resources.

Also update all of our pipelines (we have a lot) to use this new format.

This enables a few things:

  1. We can pass the ROOTFS_DIR environment variable as part of the container.
  2. Docker container names are better centralized in an easier to read and easier to parse file.
  3. Reduce duplication of defining container resources for containers used in individual steps (instead of job-wide).
  4. Enable an easy mechanism to reference specific containers that we use job-wide in specific steps.

The vast majority of changes in this PR are whitespace changes. I highly recommend viewing changes either side-by-side (to validate YAML whitespace changes) or with whitespace changes hidden (for the more interesting logic changes in the YAML).

Author: jkoritzinsky
Assignees: -
Labels:

area-Infrastructure

Milestone: -

@jkoritzinsky jkoritzinsky force-pushed the pipeline-container-resources branch from 1c682f1 to 972bcdf Compare September 12, 2022 19:37
…iner resources.

Also update all of our pipelines (we have a lot) to use this new format.

This enables a few things:

1. We can pass the ROOTFS_DIR environment variable as part of the container.
2. Docker container names are better centralized in an easier to read and easier to parse file.

Fix typo in template name

Pipeline template parameters are declared differently for some reason (and are strongly typed)

Fix runtime and runtime-llvm pipeilne defs

Explicitly reference mcr.microsoft.com
@jkoritzinsky jkoritzinsky force-pushed the pipeline-container-resources branch from 606928f to faee2c3 Compare October 3, 2022 21:45
@jkoritzinsky jkoritzinsky requested a review from a team October 3, 2022 23:04
Copy link
Member

@hoyosjs hoyosjs left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do you have an official build?

@jkoritzinsky
Copy link
Member Author

@jkoritzinsky
Copy link
Member Author

Files #76750 for the timeout

@jkoritzinsky jkoritzinsky merged commit 3c99def into dotnet:main Oct 7, 2022
@jkoritzinsky jkoritzinsky deleted the pipeline-container-resources branch October 7, 2022 17:47
directhex added a commit to directhex/runtime that referenced this pull request Oct 7, 2022
directhex added a commit that referenced this pull request Oct 7, 2022
akoeplinger added a commit to akoeplinger/runtime that referenced this pull request Nov 2, 2022
Fallout from dotnet#75473, container handling happens in platform-matrix.yml now.
ViktorHofer pushed a commit that referenced this pull request Nov 3, 2022
Fallout from #75473, container handling happens in platform-matrix.yml now.
@ghost ghost locked as resolved and limited conversation to collaborators Nov 6, 2022
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants