updating_version_2022.08

[divyaocc]

this is final PR to update version to 2022.08 in microservices in manifest.json

[paulineribeyre]

data.bloodpac.org/manifest.json

Deployment changes

• arborist
  • Replace Travis with a GitHub workflow for CI (Fix lint CI + replace travis with GH workflow arborist#150)
• fence
  • Requires database migration for a new table to Fence, google Access expiration to add new expires column, and to create iss_sub_pair_to_user table Update manifest.json #968 updated BRAIN production data model to 1.0.0 #963 feat(stage-tiered-access): Updated portal versions to fix tiered acce… #973 (Feat/passport fence#964)
  • Requires Arborist >= 2022.04 OR >=3.4.0 (PXP-9480): Support merge param for PUT /resource endpoint arborist#143 (Feat/passport fence#964)
  • To enable Passports -> DRS in an environment you must update Fence Configuration to at a minimum specify GA4GH_PASSPORTS_TO_DRS_ENABLED: true (only do this after coordinating with the environment owner as this has several requirements before it can be enabled, including the need to use Indexd's authz field in ALL records rather than acl) (Feat/passport fence#964)
• portal
  • Added new optional field stridesPortalURL in portal config which can display a link to the STRIDES admin portal on workspace page (HP-708 Feat/multiple paymodels data-portal#978)
  • For decoupled workspace, must work with Hatchery 1.0.0+ (HP-708 Feat/multiple paymodels data-portal#978)
  • See gitops configuration options for tabbed metadata detail vs traditional (Feat/disco tabs data-portal#983)

Breaking changes

• fence
  • URL Signing when no_force_sign query param is provided: Previously Fence would make a decision based off if the data was public and no_force_sign provided. Fence will now NEVER sign if no_force_sign is provided (since the concept of "public" data has been abstracted out of Fence. Data access - public or not - is the sole responsibility of the policy engine). In other words, if no_force_sign is provided at the API level, Fence will respect that regardless of whether the resulting URL will actually work. The default Fence behavior should remain the same. chore(jupyter-nde1.1.0) #988 (Feat/passport fence#964)
• hatchery
  • In pay model configs, name has been changed to workspace_type (HP-682 Feat/multiple paymodels  hatchery#44)
  • In pay model configs, aws_account_id has been changed to account_id (HP-682 Feat/multiple paymodels  hatchery#44)
  • In pay model configs, ecs has its type changed from string to bool (HP-682 Feat/multiple paymodels  hatchery#44)
  • In pay model configs, vpcid has been removed (HP-682 Feat/multiple paymodels  hatchery#44)

[paulineribeyre]

$ echo " Validating $dir"
 Validating data.bloodpac.org

$ gen3utils validate-manifest $man
[2022-08-24 15:09:10,124][ gen3utils][   INFO] Validating manifest data.bloodpac.org/manifest.json
[2022-08-24 15:09:10,125][validate-manifest][WARNING] arborist is on a branch (2022.07): not validating, returning string type
[2022-08-24 15:09:10,125][validate-manifest][WARNING] hatchery is on a branch (2022.07): not validating, returning string type
[2022-08-24 15:09:10,125][validate-manifest][WARNING] sower is on a branch (2022.07): not validating, returning string type
[2022-08-24 15:09:10,125][validate-manifest][WARNING] guppy is on a branch (2022.07): not validating, returning string type
[2022-08-24 15:09:10,125][validate-manifest][WARNING] fence is on a branch (2022.07): not validating, returning string type
[2022-08-24 15:09:10,125][validate-manifest][WARNING] fence is on a branch (2022.07): not validating, returning string type
[2022-08-24 15:09:10,125][validate-manifest][WARNING] fence is on a branch (2022.07): not validating, returning string type
[2022-08-24 15:09:10,125][validate-manifest][WARNING] peregrine is on a branch (2022.07): not validating, returning string type
[2022-08-24 15:09:10,125][validate-manifest][WARNING] hatchery is on a branch (2022.07): not validating, returning string type
[2022-08-24 15:09:10,125][validate-manifest][WARNING] guppy is on a branch (2022.07): not validating, returning string type
[2022-08-24 15:09:10,126][validate-manifest][WARNING] tube is on a branch (2022.07): not validating, returning string type
[2022-08-24 15:09:10,126][validate-manifest][   INFO] OK

$ gen3utils validate-etl-mapping $etl $man
[2022-08-24 15:09:18,083][ gen3utils][   INFO] Validating ETL mapping data.bloodpac.org/etlMapping.yaml
[2022-08-24 15:09:18,083][ gen3utils][   INFO]   Using dictionary: https://s3.amazonaws.com/dictionary-artifacts/bpadictionary/0.8.6/schema.json
[2022-08-24 15:09:20,551][ gen3utils][   INFO]   OK!

$ gen3utils validate-portal-config $etl $man $ptlcfg uc-cdis/cdis-manifest 5027
[2022-08-24 15:10:33,259][ gen3utils][   INFO] Validating portal config file data.bloodpac.org/portal/gitops.json
[2022-08-24 15:10:35,249][ gen3utils][   INFO]   OK!

$ gen3utils post-deployment-changes uc-cdis/cdis-manifest 5027
See output in comment above this one

[paulineribeyre]

this change is causing the jenkins issues: aws-es-proxy and guppy cannot run properly because this image does not exist. Go back to 0.8

[divyaocc]

I changed back aws-es-proxy from 0.7 to 0.8 , I noticed that even Travis CI test failed 😞