Code

Misc DFP Documentation & fixes#368

Code

Merged

91 commits merged intonv-morpheus:branch-22.09nv-morpheus/Morpheus:branch-22.09from dagardner-nv:david_docs_345_p2dagardner-nv/Morpheus:david_docs_345_p2Copy head branch name to clipboardSep 29, 2022

+777-193

Commits

Commits on Sep 19, 2022

• Fix typing hint

  dagardner-nv

  committed
  2778f55

  Copy full SHA for 2778f55

• document DataFrameInputSchema

  dagardner-nv

  committed
  b45832d

  Copy full SHA for b45832d

• wip

  dagardner-nv

  committed
  9e2da5e

  Copy full SHA for 9e2da5e

• Rename variables and update comments to be generalized

  dagardner-nv

  committed
  bb82168

  Copy full SHA for bb82168

• Override the H4 style for the DFP guide preserving the camel casing of the stage names

  dagardner-nv

  committed
  5814bd4

  Copy full SHA for 5814bd4

• Revert "Override the H4 style for the DFP guide preserving the camel casing of the stage names"

  Show description for 5b6455a
  dagardner-nv

  committed
  5b6455a

  Copy full SHA for 5b6455a

• Fill in missing constructor arguments for DFPTraining and update doc for DFPInferenceStage

  dagardner-nv

  committed
  285cbdc

  Copy full SHA for 285cbdc

• Fill in sections from documentation in jupyter notebooks

  dagardner-nv

  committed
  63e0376

  Copy full SHA for 63e0376

• wip

  dagardner-nv

  committed
  808970d

  Copy full SHA for 808970d

Commits on Sep 20, 2022

• Script was renamed

  dagardner-nv

  committed
  363b5c5

  Copy full SHA for 363b5c5

• only_new_batches was removed from the stage

  dagardner-nv

  committed
  03ac69a

  Copy full SHA for 03ac69a

• only_new_batches was removed from the stage

  dagardner-nv

  committed
  645431e

  Copy full SHA for 645431e

• wip

  dagardner-nv

  committed
  3af40e5

  Copy full SHA for 3af40e5

• Rename morpheus_training service to morpheus_pipeline since it runs both training and inference pipelines

  dagardner-nv

  committed
  fe6a5d3

  Copy full SHA for fe6a5d3

• wip

  dagardner-nv

  committed
  4ac3656

  Copy full SHA for 4ac3656

• Explain --train_users=none

  dagardner-nv

  committed
  735382a

  Copy full SHA for 735382a

• Fix spelling of MLflow

  dagardner-nv

  committed
  809facb

  Copy full SHA for 809facb

• file://mlruns is no longer the default

  dagardner-nv

  committed
  71f550c

  Copy full SHA for 71f550c

• Document cli flags for dfp scripts

  dagardner-nv

  committed
  9b17645

  Copy full SHA for 9b17645

Commits on Sep 21, 2022

• wip

  dagardner-nv

  committed
  0b8848a

  Copy full SHA for 0b8848a

• wip

  dagardner-nv

  committed
  b19ce47

  Copy full SHA for b19ce47

• Add a Defining a New Data Source section

  dagardner-nv

  committed
  f178dce

  Copy full SHA for f178dce

• wip

  dagardner-nv

  committed
  2a9c487

  Copy full SHA for 2a9c487

• Restrict mlflow versions prior to 1.29.0 per Pete

  dagardner-nv

  committed
  c52dea3

  Copy full SHA for c52dea3

• Fix casing of header names, move schema section

  dagardner-nv

  committed
  92192c6

  Copy full SHA for 92192c6

• Fix spelling mistakes

  dagardner-nv

  committed
  8c4572c

  Copy full SHA for 8c4572c

• Troubleshooting ci

  dagardner-nv

  committed
  b4dc986

  Copy full SHA for b4dc986

• Fix spelling mistakes

  dagardner-nv

  committed
  332b4d6

  Copy full SHA for 332b4d6

• Spelling fixes

  dagardner-nv

  committed
  786ef95

  Copy full SHA for 786ef95

• Use a better url for duo

  dagardner-nv

  committed
  241c258

  Copy full SHA for 241c258

• Work-around for 404 error

  dagardner-nv

  committed
  2bd5724

  Copy full SHA for 2bd5724

• wip

  dagardner-nv

  committed
  a4b2739

  Copy full SHA for a4b2739

• Revert "Troubleshooting ci"

  Show description for fd9da32
  dagardner-nv

  committed
  fd9da32

  Copy full SHA for fd9da32

• Use 'docker-compose' rather than 'docker compose', restructure the system requirements a bit:

  dagardner-nv

  committed
  8f03d1c

  Copy full SHA for 8f03d1c

• Applying recomendations from @efajardo-nv

  dagardner-nv

  committed
  0efd559

  Copy full SHA for 0efd559

Commits on Sep 22, 2022

• Add Azure & Duo source stages to cli registry, update readme with fixed help strings

  dagardner-nv

  committed
  95d23c4

  Copy full SHA for 95d23c4

• Ensure the build is using the same docker tag as the morpheus release build

  dagardner-nv

  committed
  6f02e08

  Copy full SHA for 6f02e08

• Merge branch 'branch-22.09' into david_docs_345_p2

  dagardner-nv

  committed
  884ac8b

  Copy full SHA for 884ac8b

• MORPHEUS_CONTAINER_VERSION needs to be exported

  dagardner-nv

  committed
  b7bb8f9

  Copy full SHA for b7bb8f9

• Formatting suggestions from @efajardo-nv

  dagardner-nv

  committed
  e0e8c3e

  Copy full SHA for e0e8c3e

• Remove only_new_batches as it no longer exists

  dagardner-nv

  committed
  440b215

  Copy full SHA for 440b215

• Set runtime

  dagardner-nv

  committed
  2f88bb2

  Copy full SHA for 2f88bb2

• Update file pattern for duo files

  dagardner-nv

  committed
  69b5982

  Copy full SHA for 69b5982

• Revert "Update file pattern for duo files"

  Show description for 9edaaff
  dagardner-nv

  committed
  9edaaff

  Copy full SHA for 9edaaff

• Fix handling of enum command line flags

  dagardner-nv

  committed
  1bff5f3

  Copy full SHA for 1bff5f3

Commits on Sep 23, 2022

• fixed typos in digital_fingerpringing/production readme

  mpenn

  committed
  edadd4f

  Copy full SHA for edadd4f

• updated digital_fingerprinting/production Dockerfile to include JupyterLab nvdashboard

  mpenn

  committed
  7ff2bb5

  Copy full SHA for 7ff2bb5

Commits on Sep 26, 2022

• updated docker-compose.yml. changed runtime: nvidia to the device structure per docs https://docs.docker.com/compose/gpu-support/

  mpenn

  committed
  7d329ab

  Copy full SHA for 7d329ab

• Helm chart info for prod DFP

  pdmack

  committed
  68e7a0c

  Copy full SHA for 68e7a0c

• updated README with localhost url to mlflow ui and updated broken default mlflow uris in .py pipelines

  mpenn

  committed
  dd9ced6

  Copy full SHA for dd9ced6

• actually updated the readme this time with local host url for mlflow

  mpenn

  committed
  d893f0e

  Copy full SHA for d893f0e

Commits on Sep 27, 2022

• Merge branch 'branch-22.09' into david_docs_345_p2

  dagardner-nv

  committed
  a6bc016

  Copy full SHA for a6bc016

• Remove filecache arg as it raises an error when used with s3

  dagardner-nv

  committed
  d67e0e2

  Copy full SHA for d67e0e2

• Merge pull request #1 from pdmack/pdmack_dfp-helm

  Show description for fca142a
  dagardner-nv

  authored
  fca142a

  Copy full SHA for fca142a

• Start & end date wip

  dagardner-nv

  committed
  015697a

  Copy full SHA for 015697a

• Merge branch 'david_docs_345_p2' of github.com:dagardner-nv/Morpheus into david_docs_345_p2

  dagardner-nv

  committed
  c0b8e18

  Copy full SHA for c0b8e18

• Merge branch 'david_docs_345_p2' into david_docs_345_p2

  dagardner-nv

  authored
  ef1496d

  Copy full SHA for ef1496d

• Merge pull request #2 from mpenn/david_docs_345_p2

  Show description for b23fa64
  dagardner-nv

  authored
  b23fa64

  Copy full SHA for b23fa64

• Merge branch 'david_docs_345_p2' of github.com:dagardner-nv/Morpheus into david_docs_345_p2

  dagardner-nv

  committed
  47bdd65

  Copy full SHA for 47bdd65

• Apply time window filtering if defined.

  Show description for 767430e
  dagardner-nv

  committed
  767430e

  Copy full SHA for 767430e

• Ensure we always have a tz aware date window

  dagardner-nv

  committed
  20fb75d

  Copy full SHA for 20fb75d

• Handle case where no file match the date window

  dagardner-nv

  committed
  3ecc9e2

  Copy full SHA for 3ecc9e2

• Add start_time flag to azure pipeline

  dagardner-nv

  committed
  57e7ec8

  Copy full SHA for 57e7ec8

• Update help string for duration

  dagardner-nv

  committed
  a2b2697

  Copy full SHA for a2b2697

• Update docs for date filtering

  dagardner-nv

  committed
  15831b5

  Copy full SHA for 15831b5

• Merge branch 'branch-22.09' into david_docs_345_p2

  dagardner-nv

  committed
  242742a

  Copy full SHA for 242742a

Commits on Sep 28, 2022

• Merge branch 'branch-22.09' into david_docs_345_p2

  dagardner-nv

  authored
  18d6148

  Copy full SHA for 18d6148

• Merge branch 'branch-22.09' into david_docs_345_p2

  dagardner-nv

  committed
  7d9c8d7

  Copy full SHA for 7d9c8d7

• Merge branch 'david_docs_345_p2' of github.com:dagardner-nv/Morpheus into david_docs_345_p2

  dagardner-nv

  committed
  b87f4a6

  Copy full SHA for b87f4a6

• Enable verbose output from pytest

  dagardner-nv

  committed
  58f4206

  Copy full SHA for 58f4206

• Show std out during tests

  dagardner-nv

  committed
  08983e3

  Copy full SHA for 08983e3

Commits on Sep 29, 2022

• starter dfp readme updates

  efajardo-nv

  committed
  8ef2824

  Copy full SHA for 8ef2824

• Merge pull request #3 from efajardo-nv/starter-dfp-readme-updates

  Show description for 99e512c
  dagardner-nv

  authored
  99e512c

  Copy full SHA for 99e512c

• Pin numba version

  dagardner-nv

  committed
  e63f2a5

  Copy full SHA for e63f2a5

• Merge branch 'david_docs_345_p2' of github.com:dagardner-nv/Morpheus into david_docs_345_p2

  dagardner-nv

  committed
  32f4d5e

  Copy full SHA for 32f4d5e

• Revert "Show std out during tests"

  Show description for 014fa61
  dagardner-nv

  committed
  014fa61

  Copy full SHA for 014fa61

• Revert "Enable verbose output from pytest"

  Show description for db6cc38
  dagardner-nv

  committed
  db6cc38

  Copy full SHA for db6cc38

• Remove redundant call

  dagardner-nv

  committed
  4e2d35f

  Copy full SHA for 4e2d35f

• Update diagrams

  dagardner-nv

  committed
  93b34c5

  Copy full SHA for 93b34c5

• Update diagrams

  dagardner-nv

  committed
  5f35de3

  Copy full SHA for 5f35de3

• Update regect for both colon and underscore time separators

  dagardner-nv

  committed
  dca8850

  Copy full SHA for dca8850

• Document the --start_time flag

  dagardner-nv

  committed
  ecc55bd

  Copy full SHA for ecc55bd

• Formatting fix

  dagardner-nv

  committed
  63d924d

  Copy full SHA for 63d924d

• Merge branch 'branch-22.09' into david_docs_345_p2

  dagardner-nv

  authored
  a9d1a84

  Copy full SHA for a9d1a84

• Use ver 2022.8.2 of s3fs per Eli

  dagardner-nv

  committed
  c6368cb

  Copy full SHA for c6368cb

• Add instructions for downloading and running against the example datasets

  dagardner-nv

  committed
  a95cc81

  Copy full SHA for a95cc81

• Fix indenting of code examples

  dagardner-nv

  committed
  8d11605

  Copy full SHA for 8d11605

• Update paths in notebooks

  dagardner-nv

  committed
  c8fc64e

  Copy full SHA for c8fc64e

• Merge branch 'branch-22.09' into david_docs_345_p2

  dagardner-nv

  authored
  511bcc6

  Copy full SHA for 511bcc6

• Merge branch 'branch-22.09' into david_docs_345_p2

  dagardner-nv

  committed
  4c10784

  Copy full SHA for 4c10784

• Merge branch 'david_docs_345_p2' of github.com:dagardner-nv/Morpheus into david_docs_345_p2

  dagardner-nv

  committed
  4f674a8

  Copy full SHA for 4f674a8