HP-1044 Feat/aggmds vlmd

[mfshao]

Jira Ticket: HP-1044

⚠️ Important: After deploy this version of MDS, if you are using AggMDS, you are required to run AggMDS sync to migrate the AggMDS records syntax

Add variable-level metadata (VLMD) support to AggMDS

Currently AggMDS can only pull in study-level metadata (SLMD)

All AggMDS endpoints should be backward-compatible except for the following: /aggregate/metadata/guid/{guid} and /aggregate/metadata/{name}

Perviously these 2 endpoint will only return SLMD

{
  ...SLMD content
}

Now they will return both SLMD and VLMD (if exists) and their correspoiding parent, in the format of

{
  "gen3_discovery": {
     ...SLMD content
  },
  "data_dictionaries": {
     ...VLMD content
  }
}

New Features

• Add VLMD support to AggMDS
• Add AGG_MDS_DEFAULT_STUDY_DATA_FIELD to MDS config to indicate the SLMD field name in AggMDS records, default to gen3_discovery
• Add AGG_MDS_DEFAULT_DATA_DICT_FIELD to MDS config to indicate the VLMD field name in AggMDS records, if available, default to None
• Add data_dict_field to AggMDS adatper config to indicate the VLMD field name in metadata that will be populated into AggMDS, this field is optional

Breaking Changes

• Data format of response returned from /aggregate/metadata/guid/{guid} has changed, please refer to the PR description and/or API docs for details
• Data format of response returned from /aggregate/metadata/{name} has changed, please refer to the PR description and/or API docs for details

Deployment changes

• Envs using AggMDS before must run the AggMDS sync job after updating to this version to migrate AggMDS reocrds syntax

[github-actions]

The style in this PR agrees with black. ✔️

This formatting comment was generated automatically by a script in uc-cdis/wool.

[MichaelLukowski]

Looks good, I don't see any issues