Skip to content

Commit

Permalink
document eval commands used for rankhist
Browse files Browse the repository at this point in the history
  • Loading branch information
14renus committed Jan 28, 2025
1 parent d598aca commit d61cb12
Show file tree
Hide file tree
Showing 2 changed files with 33 additions and 0 deletions.
32 changes: 32 additions & 0 deletions docs/archesweather/eval.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,32 @@
# Evaluate

Set model run name (used in hydra argument `++name=NAME`):
```sh
NAME=archesweathergen
```

## Commands to compute metrics

### Rank histogram
```sh
python -m geoarches.evaluation.eval_multistep \
--pred_path evalstore/${NAME}/ \
--output_dir evalstore/${NAME}_metrics/ \
--groundtruth_path data/era5_240/full/ \
--multistep 10 --num_workers 4 \
--metrics era5_rank_histogram_50_members
```

## Commands to plot

### Rank histogram
```sh
python -m geoarches.evaluation.plot --output_dir plots/
--metric_paths evalstore/${NAME}_metrics/test-multistep=10-era5_rank_histogram_50_members.nc
--model_names ArchesWeatherGen \
--model_colors red \
--metrics rankhist \
--vars Z500:geopotential:level:500 T850:temperature:level:850 Q700:specific_humidity:level:700 U850:u_component_of_wind:level:850 V850:v_component_of_wind:level:850 \
--rankhist_prediction_timedeltas 1 7 \
--figsize 10 4
```
1 change: 1 addition & 0 deletions mkdocs.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -48,4 +48,5 @@ nav:
- Setup: archesweather/setup.md
- Run: archesweather/run.ipynb
- Train: archesweather/train.md
- Evaluate: archesweather/eval.md

0 comments on commit d61cb12

Please sign in to comment.