Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Misc DFP Documentation & fixes #368

Merged
91 commits merged into from
Sep 29, 2022

Conversation

dagardner-nv
Copy link
Contributor

@dagardner-nv dagardner-nv commented Sep 20, 2022

  • Fills in examples/digital_fingerprinting/production/README.md with a bit more detail
  • Fix handling of command line enum values
  • Add date window filtering to DFPFileBatcherStage, since this stage is already performing date calculations, and occurs prior to the downloading of any remote data. Previously this was a part of the S3SourceStage.
  • Add a --start_time flag to dfp_azure_pipeline.py and dfp_duo_pipeline.py allowing an explicit time window.
  • morpheus_training service in docker compose renamed to morpheus_pipeline to reflect that it is used for both training and inference
  • Set nvidia runtime in docker compose yaml for users who don't have it as their default runtime.
  • MLflow version restricted to <1.29 to avoid a bug (per @pdmack )
  • Fix casing of class names in headings for Sphinx builds
  • Spelling fixes in docs & help strings
  • Fix launch script for morpheus_pipeline
  • from-azure and from-duo added to CLI
  • Remove usage of only_new_batches argument which no longer exists
  • CI work-around for https://gitlab.com/karolinepauls/pytest-kafka/-/issues/10
  • Update diagrams to reflect recent code changes
  • Support _ as a time separator in iso_date_regex
  • Adds the following to docs/source/developer_guide/guides/5_digital_fingerprinting.md:
    • Section on how to define a new data source schema
    • Explanation of Starter & Production examples
    • docker-compose commands for building & starting services in the production example
    • Helm Chart info for production example
    • Fix headings for stage classes

Fixes #345

@dagardner-nv dagardner-nv requested a review from a team as a code owner September 20, 2022 16:47
@dagardner-nv dagardner-nv added non-breaking Non-breaking change doc Improvements or additions to documentation DO NOT MERGE PR should not be merged; see PR for details 2 - In Progress labels Sep 20, 2022
@dagardner-nv dagardner-nv changed the title Draft: Misx DFP Draft: Misc DFP Sep 20, 2022
@dagardner-nv
Copy link
Contributor Author

rerun tests

@dagardner-nv
Copy link
Contributor Author

/rerun tests

@dagardner-nv
Copy link
Contributor Author

\rerun tests

@dagardner-nv
Copy link
Contributor Author

/rerun tests

@drobison00
Copy link
Contributor

@gpucibot merge

@ghost ghost merged commit 3a2d9c0 into nv-morpheus:branch-22.09 Sep 29, 2022
@dagardner-nv dagardner-nv deleted the david_docs_345_p2 branch November 7, 2024 17:47
This pull request was closed.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
doc Improvements or additions to documentation non-breaking Non-breaking change
Projects
Archived in project
Development

Successfully merging this pull request may close these issues.

[DOC] Complete Documentation for the Production DFP Workflow Example
5 participants