Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Dynamic Service SD Creation #551

Merged
merged 3 commits into from
Sep 28, 2023
Merged

Dynamic Service SD Creation #551

merged 3 commits into from
Sep 28, 2023

Conversation

CoreyKrewson-NOAA
Copy link
Contributor

Currently when we do a deploy, all service SD files are recreated and that causes all services to be republished. With over 100 services now, that puts a strain on the EGIS systems to do all that republishing so close together.

This PR aims to reduce the service republishing to only the services that need it. The github commit that was used in a deploy is stored in the AWS parameter store. This github commit is then used in the next deploy so that changes between the latest deploy and the current deploy can be tracked. Any mapx files that have been changed since that deployment will have their SD files recreated and thus be republished.

updated new parameter to latest_deployed_github_repo_commit
updated update_data_stores_and_sd_files script to use the latest_deployed_github_repo_commit to get diff from that commit
only recreate SD files if mapx files have changed since last commit used
shawncrawley
shawncrawley previously approved these changes Sep 28, 2023
Copy link
Collaborator

@shawncrawley shawncrawley left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is cool. I had no idea there was a git python package - but makes sense. Looks good!

Copy link
Collaborator

@shawncrawley shawncrawley left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Even better.

@CoreyKrewson-NOAA CoreyKrewson-NOAA merged commit cdac143 into ti Sep 28, 2023
@CoreyKrewson-NOAA CoreyKrewson-NOAA deleted the dynamic_service_publish branch September 28, 2023 17:58
@TylerSchrag-NOAA
Copy link
Contributor

Wow, this is cool! Way to go.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants