Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update metrics CLI invokation in dev docs #532

Merged
merged 1 commit into from
Nov 11, 2024
Merged

Update metrics CLI invokation in dev docs #532

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions DEVELOPMENT.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -134,7 +134,7 @@ To score data:
python -m iarpa_smart_metrics.run_evaluation \
--roi KR_R001 \
--gt_dir ../annotations/site_models/ \
--rm_dir ../KR_R001/region_models/ \
--rm_path ../KR_R001/region_model.geojson \
--sm_dir ../KR_R001/site_models/ \
--output_dir ../KR_R001/output \
--eval_num 12 \
Expand All @@ -148,6 +148,6 @@ To score data:
--sequestered_id KR_R001 \
--db_conn_str postgresql+psycopg2://scoring:secretkey@localhost:5433/scoring
```
- the rm_dir and sm_dir shgould be your test annotaitons.
- the rm_path and sm_dir shgould be your test annotaitons.
- gt annotations can be retrieved from the [Annotation Repo](https://smartgitlab.com/TE/annotations)
- be sure to set the val_num and eval_run_num and remember them when ingesting data into RGD. The region, eval_num, eval_run_num and performer are used to connect data loaded in RGD to the scoring data.
4 changes: 2 additions & 2 deletions docs/DevDocs/GettingStarted.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -136,7 +136,7 @@ To score data:
python -m iarpa_smart_metrics.run_evaluation \
--roi KR_R001 \
--gt_dir ../annotations/site_models/ \
--rm_dir ../KR_R001/region_models/ \
--rm_path ../KR_R001/region_model.geojson \
--sm_dir ../KR_R001/site_models/ \
--output_dir ../KR_R001/output \
--eval_num 12 \
Expand All @@ -150,6 +150,6 @@ To score data:
--sequestered_id KR_R001 \
--db_conn_str postgresql+psycopg2://scoring:secretkey@localhost:5433/scoring
```
- the rm_dir and sm_dir shgould be your test annotaitons.
- the rm_path and sm_dir shgould be your test annotaitons.
- gt annotations can be retrieved from the [Annotation Repo](https://smartgitlab.com/TE/annotations)
- be sure to set the val_num and eval_run_num and remember them when ingesting data into RGD. The region, eval_num, eval_run_num and performer are used to connect data loaded in RGD to the scoring data.
6 changes: 3 additions & 3 deletions docs/DevDocs/IngestingData.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -45,7 +45,7 @@ To score data:
python -m iarpa_smart_metrics.run_evaluation \
--roi KR_R001 \
--gt_dir ../annotations/site_models/ \
--rm_dir ../KR_R001/region_models/ \
--rm_path ../KR_R001/region_model.geojson \
--sm_dir ../KR_R001/site_models/ \
--output_dir ../KR_R001/output \
--eval_num 12 \
Expand All @@ -59,7 +59,7 @@ To score data:
--sequestered_id KR_R001 \
--db_conn_str postgresql+psycopg2://scoring:secretkey@localhost:5433/scoring
```
- the `rm_dir` and `sm_dir` should be your test annotations.
- the `rm_path` and `sm_dir` should be your test annotations.
- ground truth annotations can be retrieved from the [Annotation Repo](https://smartgitlab.com/TE/annotations)
- be sure to set the `val_num` and `eval_run_num` and remember them when ingesting data into RGD. The `region`, `eval_num`, `eval_run_num` and `performer` are used to connect data loaded in RGD to the scoring data.
- For Scoring data with points execute the following command:
Expand All @@ -77,7 +77,7 @@ To score data:
--no-viz-activity-metrics \
--sequestered_id KR_R002 \
--db_conn_str postgresql+psycopg2://scoring:secretkey@localhost:5433/scoring \
--rm_dir ../KR_R002/region_models/ \
--rm_path ../KR_R002/region_model.geojson \
--sm_dir ../KR_R002/site_models/ \
--gt_points_file ../annotations/supplemental_data/point_based_annotations.geojson
```
Expand Down
Loading