(PXP-6861): configure Metadata Service creds in kube-setup-ssjdispatcher

[johnfrancismccann]

Jira Ticket: PXP-6861

This PR extends kube-setup-ssjdispatcher so that if the Metadata Service is deployed and MDS basic auth creds are present, add those MDS creds to SSJDispatcher's secret. See related indexs3client PR requiring SSJDispatcher to pass it MDS creds. Going forward, the SSJDispatcher service will require MDS creds to start.

Note that the addition of MDS creds will not break the "old" SSJDispatcher/indexs3client combination (i.e. versions of SSJDispatcher/indexs3client not requiring MDS creds).

New Features

• Configure Metadata Service basic auth creds in kube-setup-ssjdispatcher

[johnfrancismccann]

Should we move:

cloud-automation/gen3/bin/kube-roll-all.sh

Lines 77 to 79 in e2a5880

	if g3k_manifest_lookup .versions.ssjdispatcher 2>&1 /dev/null; then
	gen3 kube-setup-ssjdispatcher
	fi

To after:

cloud-automation/gen3/bin/kube-roll-all.sh

Line 193 in e2a5880

gen3 kube-setup-metadata

So that the MDS creds are still configured if gen3 roll all is being run for the first time or the MDS creds get rotated❓

[frickjack]

Hey John,
This looks really good to me.
Before we merge - would you do the following?

• login to each of the jenkins-* environments:

 ls -d1 /home/jenkins-*
/home/jenkins-blood
/home/jenkins-brain
/home/jenkins-dcp
/home/jenkins-genomel
/home/jenkins-niaid
/home/jenkins-perf

• in each environment:

(
cd cdis-manifst && git pull --prune)
cd cloud-automation && git pull --prune && git checkout your-branch
gen3 kube-setup-ssjdispatcher
git checkout master
)

That will get all our jenkins environments setup with the new creds, and be a good test case too.

[johnfrancismccann]

Alright sounds good, so I ran:

(
(cd cdis-manifest && git pull --prune)
cd cloud-automation && git pull --prune && git checkout chore/configure-mds-creds-in-ssjdispatcher
gen3 kube-setup-ssjdispatcher
git checkout master
)

in:

• jenkins-blood
• jenkins-brain
• jenkins-dcp
• jenkins-genomel
• jenkins-niaid
• jenkins-perf

And the MDS creds were set up as expected for all of these Jenkins environments with the exception of jenkins-perf which doesn't have ssjdispatcher deployed.

[frickjack]

awesome!