Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[integ-tests] improve build-image integration tests #6627

Merged
merged 7 commits into from
Dec 19, 2024

Conversation

hanwen-cluster
Copy link
Contributor

Description of changes

  • The first 3 commits are cherry-pick from release-3.12 branch.
  • The last 3 commits are to make sure kernel consistency on RHEL/Rocky build-image

Checklist

  • Make sure you are pointing to the right branch.
  • If you're creating a patch for a branch other than develop add the branch name as prefix in the PR title (e.g. [release-3.6]).
  • Check all commits' messages are clear, describing what and why vs how.
  • Make sure to have added unit tests or integration tests to cover the new/modified code.
  • Check if documentation is impacted by this change.

Please review the guidelines for contributing and Pull Request Instructions.

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

Reason: This increases test coverage of dependencies files in S3 buckets

How
1. Use GPU instances and use availability zones with best GPU capacity
2. Change build-image config file

Signed-off-by: Hanwen <hanwenli@amazon.com>
This reverts changes from aws#6450.
Because first stage AMIs are not available in China and GovCloud. Some OSes require first stage AMIs

Signed-off-by: Hanwen <hanwenli@amazon.com>
Signed-off-by: Hanwen <hanwenli@amazon.com>
@hanwen-cluster hanwen-cluster requested review from a team as code owners December 19, 2024 19:29
Signed-off-by: Hanwen <hanwenli@amazon.com>
Signed-off-by: Hanwen <hanwenli@amazon.com>
Signed-off-by: Hanwen <hanwenli@amazon.com>
@hanwen-cluster hanwen-cluster added the skip-changelog-update Disables the check that enforces changelog updates in PRs label Dec 19, 2024
@@ -52,8 +52,8 @@
"rocky8": {"name": "Rocky-8-EC2-Base-8.8*", "owners": ["792107900819"]}, # TODO add china and govcloud accounts
"rhel8.9": {"name": "RHEL-8.9*_HVM-*", "owners": RHEL_OWNERS},
"rocky8.9": {"name": "Rocky-8-EC2-Base-8.9*", "owners": ["792107900819"]}, # TODO add china and govcloud accounts
"rhel9": {"name": "RHEL-9.3*_HVM-*", "owners": RHEL_OWNERS},
"rocky9": {"name": "Rocky-9-EC2-Base-9.3*", "owners": ["792107900819"]}, # TODO add china and govcloud accounts
"rhel9": {"name": "RHEL-9.*_HVM*", "owners": RHEL_OWNERS},
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

should we be pinning to 9.4 until fsx lustre supports 9.5?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This test has Lustre installation disabled for RHEL/Rocky. So we can go head

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm not sure if this is what we want. We aren't going to release for an image that doesn't support lustre, so whats the point of testing it? I think we should enable lustre and stick with supported OSes

Enabled: false
{% endif %}
# Disable Lustre installation because these newer operating systems release new kernels more often. Lustre usually does not support the latest kernels
Enabled: {% if os in ["ubuntu2204", "rhel9", "rocky9"] %} false {% else %} true {% endif %}
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

i wonder if we even care about 9.5 until this is supported.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I agree. Anyway it is good to make the tests more robust

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lustre should just always be enabled i think

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Done, added another commit

…y9/Ubuntu22 AMIs are used

first stage AMIs are used in release.yaml
non-first-stage AMIs are used in develop.yaml

Signed-off-by: Hanwen <hanwenli@amazon.com>
@hanwen-cluster hanwen-cluster merged commit c71a0cb into aws:develop Dec 19, 2024
24 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
skip-changelog-update Disables the check that enforces changelog updates in PRs
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants