[develop] Add smoke and dust verification #1174

mkavulich · 2025-01-08T16:23:12Z

DESCRIPTION OF CHANGES:

This PR adds verification of smoke and dust observations to the SRW verification workflow. These observations come from new data sources: AERONET (aerosol optical depth) and AIRNOW (particulate matter). This necessitated adding some new tasks to the verification section of the workflow, and modifying some existing tasks. A new test, MET_verification_smoke_only_vx, has been added to test out these new capabilities. Major updates include:

New observation types

Two new sets of observations (AERONET and AIRNOW) are now included for ingestion by verification tasks, and all the proper logic has been included for retrieving these obs from HPSS if necessary. In addition, a new capability allows for retrieval of AIRNOW obs from AWS over the internet without needing HPSS access: this can theoretically be extended to other ob types as well but the proper logic will need to be included in parm/data_locations.yml

By default, the new observation types also report all matched pairs in the output stat files.

New MET tool: ASCII2NC

This is a new MET tool for SRW, used for converting the ASCII-based AERONET and AIRNOW obs to NetCDF that can be processed by later MET tasks. This is a new task with a new J-Job and exscript, as well as a new METplus conf file template.

Generalizing some tasks and metatasks

Some metatasks were previously hard-coded to certain observation types or other variables that needed to become more generic:

metatask_PointStat_SFC_UPA_all_mems now has an outer loop of metatasks over the observation type, with an inner loop for each ensemble member. This was needed in order to accommodate the new observation types for the PointStat tool.
PCP combine is now used for additional functionality that adds two fields in the same forecast file (needed for appropriately creating the PM2.5 variable from forecast output)

MET and METplus upgrade

These new verification capabilities necessitated an update to a newer MET version, and bugs in 11.1.1 required updating further to MET 12.0.1 and METplus 6.0.0. These have been installed in all the usual places, thanks @RatkoVasic-NOAA!

Additional updates

In addition, several minor updates are included:

Include a fix for MET PCPCombine tasks where files were being over-written for forecasts longer than 24 hours
Additional HPSS data location for older NDAS obs
By default, verification for gridstat and pointstat is now run on the full domain, not just CONUS
Cleaned up the config variable sections imported for some verification tasks; this is part of a pre-resolution of conflicting changes in [develop] Integrate uwtools into the config layer #1204
A bug fix for some functionality in run_WE2E_tests.py when parsing an XML with broken/unsatisfied dependencies; now it will properly print an informational message if jobs aren't being submitted properly instead of silently hanging
Changed the default of NUM_MISSING_OBS_FILES_MAX from 2 to 0; we really shouldn't have missing files for any of our tests, users can bump this up if they need to
Replace references to ln_vrfy with create_symlink_to_file, and update the latter with wildcard functionality
Removed some exported variables from ush/generate_FV3LAM_wflow.py, separated out the setting of namelist variables into its own function
ush/retrieve_data.py now creates directories if they do not exist
Move dict_find() from setup.py to ush/python_utils/misc.py for more general use
Various typo and formatting fixes

Type of change

Bug fix (non-breaking change which fixes an issue)
- See above
New feature (non-breaking change which adds functionality)
- See above
Breaking change (fix or feature that would cause existing functionality to not work as expected)
- The REMOVE_RAW_OBS_* variables for different observation types are consolidated into a single REMOVE_RAW_OBS_DIRS variable
This change requires a documentation update

TESTS CONDUCTED:

DEPENDENCIES:

None.

DOCUMENTATION:

Added documentation to the Users Guide for new options where appropriate.

ISSUE:

None

CHECKLIST

My code follows the style guidelines in the Contributor's Guide
I have performed a self-review of my own code using the Code Reviewer's Guide
I have commented my code, particularly in hard-to-understand areas
My changes need updates to the documentation. I have made corresponding changes to the documentation
My changes generate no new warnings
New and existing tests pass with my changes
Any dependent changes have been merged and published

CONTRIBUTORS (optional):

Thanks to @RatkoVasic-NOAA, @ulmononian, @christinaholtNOAA, and @gsketefian for their help and contributions

…les, that are expected to be created once the task is finished actually get created. This is needed because it is possible that for some forecast hours for which there is overlap between cycles, the files are being retrieved and processed by the get_obs_... task for another cycle.

…nd EnsembleStat tasks such that GenEnsProd does not depend on the completion of get_obs_... tasks (because it doesn't need observations) but only forecast output while EnsembleStat does.

…d due to changes to dependencies of GenEnsProd tasks in previous commit(s).

…tending to time out for 48-hour forecasts.

…sure PcpCombine operates only on those hours unique to the cycle, i.e. for those times starting from the initial time of the cycle to just before the initial time of the next cycle. For the PcpCombine_obs task for the last cycle, allow it to operate on all hours of that cycle's forecast. This ensures that the PcpCombine tasks for the various cycles do not clobber each other's output. Accordingly, change the dependencies of downstream tasks that depend on PcpCombine obs output to make sure they include all PcpCombine_obs tasks that cover the forecast period of the that downstream task's cycle.

…ossibly also get_obs_ndas by putting in sleep commands.

…bs files.

…ks so far

- There are lots of task-specific checks that always run regardless of task inclusion: add some checks there so that we don't have to include unnecessary variables like PREDEF_GRID_NAME in vx-only experiments - There were a few task-specific checks that DO check for task inclusion, but the checks were broken: fix those - Move dict_find from an inline function in setup.py to a proper external python function

task-dependent logic checks - Break out all FV3 namelist logic out into a new function, setup_fv3_namelist - Only call this new function if the run_fcst task is active - Delay exporting of variables further down the page (need to completely eliminated this eventually) - Replace some *_vrfy commands with their proper versions - Eliminate some unnecessary variables and block comments

…, need to create observation directories if they don't exist

…not specified, include correct valid VX_FIELDS for new variables

…w; more tasks to come!

- New metplus conf file - New J-job and exscript for new task - New task entry in wflow/verify_pre.yaml - New variables for obs filenames and ASCII2NC output filenames - New entries in various scripts for new task - ush/get_metplus_tool_name.sh - ush/setup.py - ush/set_vx_fhr_list.sh - Updating some comments - Stage test observations on disk for faster testing

… non-smoke cases

- Add PM10 as a valid ob type - Update PcpCombine.conf template to allow obs other than CCPA, USER_DEFINED command - Fix task name for ASCII2NC - Add PCPCombine tasks for PM - Fix check of airnow ob file name in exregional_get_verif_obs.sh - ASCII2NC doesn't need beta version of MET - Update some comments in config_defaults.yaml - Pythonize ush/set_vx_fhr_list.sh with help from ChatGPT; this results in an insane speedup (100 seconds to check forecast files --> ~ 1 second)

importing the necessary METplus functions directly. This will need some attention before merging to ensure it is platform-independent, only working on Hera for now. But the smoke stuff is Hera-specific for now regardless.

don't get any matched pairs. However, it seems as if the example case has the same issue, so I'll need to figure out what's going on there. - Update vx_config_det.yaml for correct obs names - Update verify_det.yaml to make the PointStat metatask loop over obtypes, so we can combine NDAS with smoke vx - Add PM10 to ASCII2nc_obs - Remove verbose flag from set_vx_fhr_list.py call in exregional_check_post_output.sh so we get correct FHR results - Update exregional_run_met_gridstat_or_pointstat_vx.sh uses beta release, can handle smoke vx obtypes for PointStat - - Remove deleted script from ush/source_util_funcs.sh

files are unique! Also, make the metatask rules for ASCII2nc simpler

- Produce hourly nc obs files for AOD - Probably doesn't make a difference, but explicitly reference AOD as "AERONET_AOD" in POINT_STAT_MESSAGE_TYPE

…from RRFS is 550 nm. This gets us matched pairs!

mkavulich · 2025-02-21T20:29:02Z

@MichaelLueken I could also pull this create_symlink_to_file change out into its own PR; I'd really like to include it but I don't want that to be the thing holding up reviews of this PR.

MichaelLueken · 2025-02-21T20:42:32Z

@mkavulich -

Yeah, in improving the symlinking in generate_FV3LAM_wflow, I suspect that is the cause of this specific failure now.

EPIC does have the fix files in a S3 bucket - https://noaa-ufs-srw-pds.s3.amazonaws.com/index.html#develop-20240618/fix/.

It would be interesting to see if pulling from the S3 bucket and updating the FIXgsm path in ush/machine/linux.yaml to point to the retrieved fixed files will allow the test_generate_FV3LAM_wflow test to successfully run.

MichaelLueken · 2025-02-21T20:49:10Z

@mkavulich -

I would recommend attempting to pull the fixed files from the S3 bucket and seeing if the tests will pass using the pulled files. If everything works as expected, then we can move forward. Should the tests continue to fail even with the retrieved fixed files, then the create_symlink_to_file update will need to be pulled, since this PR is one of the required PRs to enter code slush.

…slashes in SED string

…ories.

…smoke/dust WE2E test to testing suites (ufs-community#1195) * Update weather model hash to 8933749 from February 19, 2025 * Add smoke_dust_grid_RRFS_CONUS_3km_suite_HRRR_gf WE2E test to coverage.gaea-c6, comprehensive and comprehensive.orion (sym linked to comprehensive.gaea-c6 and comprehensive.hercules) * Update modulefiles/build_hera_gnu.lua to allow smoke and dust WE2E test to run on Hera GNU. * Address documentation failures now that https://www.fvcom.org site's security certificate has been renewed * Change gaea to gaeac5 and gaea-c6 to gaeac6 throughout to address node name change in Jenkins * Remove Jet support in Jenkins --------- Co-authored-by: EdwardSnyder-NOAA <Edward.Snyder@noaa.gov>

mkavulich · 2025-02-22T01:22:14Z

@MichaelLueken I wasn't able to retrieve the fix file data because there wasn't enough disk space on the standard GitHub runner. I was able to get the tests to pass by creating "dummy" directories on the runner and modifying the machine file to point to those. See the changes to the first two files here: https://github.com/ufs-community/ufs-srweather-app/pull/1174/files/d30a8ce5364c98ae9dbbbf0e8939d16c35f567a4..644dbda46e4407ee959d1e9105b01847013b1a0b

MichaelLueken

@mkavulich -

Excellent job on finding a fix for the generate_FV3LAM_wflow unit test!

I only have two minor issues:

The changes in run_vx.local.lua should also be applied to modulefiles/tasks/gaeac5.
The changes in the machine files should also be applied to ush/machine/gaeac6.yaml.

I was able to successfully run the new MET_verification_smoke_only_vx WE2E test on Hercules:

----------------------------------------------------------------------------------------------------
Experiment name                                                  | Status    | Core hours used 
----------------------------------------------------------------------------------------------------
MET_verification_smoke_only_vx_20250224104122                      COMPLETE               0.52
----------------------------------------------------------------------------------------------------
Total                                                              COMPLETE               0.52

Will approve once modulefiles/tasks/gaeac5/run_vx.local.lua and ush/machine/gaeac6.yaml have been updated.

modulefiles/tasks/gaeac6/run_vx.local.lua

ush/machine/gaeac5.yaml

MichaelLueken

Thanks, @mkavulich!

christinaholtNOAA

I've left some change requests for minor changes that should be made and a few others that are optional. A few are questions that could lead to a new comment line. I don't need to review it again.

christinaholtNOAA · 2025-02-25T19:06:53Z

doc/UsersGuide/BuildingRunningTesting/RunSRW.rst

+   AIRNOW observations can be retrieved from AWS in addition to HPSS, but this requires changing some default settings.
+   See ``ush/config_defaults.yaml`` or :numref:`Section %s <GeneralVXParams>` for more details. 


Suggested change

AIRNOW observations can be retrieved from AWS in addition to HPSS, but this requires changing some default settings.

See ``ush/config_defaults.yaml`` or :numref:`Section %s <GeneralVXParams>` for more details.

AIRNOW observations can be retrieved from AWS or HPSS, but retrieving from AWS requires changing some default settings.

See ``ush/config_defaults.yaml`` or :numref:`Section %s <GeneralVXParams>` for more details.

christinaholtNOAA · 2025-02-25T19:09:51Z

doc/UsersGuide/CustomizingTheWorkflow/ConfigWorkflow.rst

@@ -633,7 +633,7 @@ Pre-Existing Directory Parameter

   * **"delete":** The preexisting directory is deleted and a new directory (having the same name as the original preexisting directory) is created.

-   * **"rename":** The preexisting directory is renamed and a new directory (having the same name as the original pre-existing directory) is created. The new name of the preexisting directory consists of its original name and the suffix "_old###", where ``###`` is a 3-digit integer chosen to make the new name unique.
+   * **"rename":** The preexisting directory is renamed and a new directory (having the same name as the original pre-existing directory) is created. The new name of the preexisting directory consists of its original name and the suffix "_old_YYYYMMDD_HHmmss", where ``YYYYMMDD_HHmmss`` is the full date and time of the rename


This line seems incomplete.

christinaholtNOAA · 2025-02-25T19:11:48Z

doc/UsersGuide/Reference/Glossary.rst

@@ -12,6 +12,12 @@ Glossary
   advection
      According to the American Meteorological Society (AMS) definition, `advection <https://glossary.ametsoc.org/wiki/Advection>`_ is "The process of transport of an atmospheric property solely by the mass motion (velocity field) of the atmosphere." In common parlance, advection is movement of atmospheric substances that are carried around by the wind.

+   AERONET
+      The "`AErosol RObotic NETwork <https://aeronet.gsfc.nasa.gov/>`_": A worldwide ground-based remote sensing aerosol networks established by NASA and PHOTONS. The SRW verification tasks can use "Level 1.5" (cloud-screened and quality-controlled) aerosol optical depth observations. 


Suggested change

The "`AErosol RObotic NETwork <https://aeronet.gsfc.nasa.gov/>`_": A worldwide ground-based remote sensing aerosol networks established by NASA and PHOTONS. The SRW verification tasks can use "Level 1.5" (cloud-screened and quality-controlled) aerosol optical depth observations.

The "`AErosol RObotic NETwork <https://aeronet.gsfc.nasa.gov/>`_": A worldwide ground-based remote sensing aerosol network established by NASA and PHOTONS. The SRW verification tasks can use "Level 1.5" (cloud-screened and quality-controlled) aerosol optical depth observations.

christinaholtNOAA · 2025-02-25T19:12:32Z

doc/UsersGuide/Reference/Glossary.rst

+      The "`AErosol RObotic NETwork <https://aeronet.gsfc.nasa.gov/>`_": A worldwide ground-based remote sensing aerosol networks established by NASA and PHOTONS. The SRW verification tasks can use "Level 1.5" (cloud-screened and quality-controlled) aerosol optical depth observations. 
+
+   AIRNOW
+      A North American ground-level air quality measurement network. The SRW verification tasks can use PM2.5 and PM10 observations. More information available at https://www.airnow.gov/


Should this be a hyperlink?

christinaholtNOAA · 2025-02-25T19:14:03Z

doc/UsersGuide/Reference/Glossary.rst

@@ -159,7 +165,8 @@ Glossary
      The `Modern-Era Retrospective analysis for Research and Applications, Version 2 <https://gmao.gsfc.nasa.gov/reanalysis/MERRA-2/>`__ provides satellite observation data back to 1980. According to NASA, "It was introduced to replace the original MERRA dataset because of the advances made in the assimilation system that enable assimilation of modern hyperspectral radiance and microwave observations, along with GPS-Radio Occultation datasets. It also uses NASA's ozone profile observations that began in late 2004. Additional advances in both the GEOS model and the GSI assimilation system are included in MERRA-2. Spatial resolution remains about the same (about 50 km in the latitudinal direction) as in MERRA."

   MET
-      The `Model Evaluation Tools <https://dtcenter.org/community-code/model-evaluation-tools-met>`__ is a highly-configurable, state-of-the-art suite of verification tools developed at the :term:`DTC`.
+   METplus
+      The `Model Evaluation Tools <https://dtcenter.org/community-code/model-evaluation-tools-met>`__ is a highly-configurable, state-of-the-art suite of verification tools developed at the :term:`DTC`. `METplus <https://dtcenter.org/community-code/metplus>`_ is a suite of python wrappers providing low-level automation of the MET tools.


Suggested change

The `Model Evaluation Tools <https://dtcenter.org/community-code/model-evaluation-tools-met>`__ is a highly-configurable, state-of-the-art suite of verification tools developed at the :term:`DTC`. `METplus <https://dtcenter.org/community-code/metplus>`_ is a suite of python wrappers providing low-level automation of the MET tools.

The `Model Evaluation Tools <https://dtcenter.org/community-code/model-evaluation-tools-met>`__ is a highly configurable, state-of-the-art suite of verification tools developed at the :term:`DTC`. `METplus <https://dtcenter.org/community-code/metplus>`_ is a suite of Python wrappers providing low-level automation of the MET tools.

christinaholtNOAA · 2025-02-25T19:28:49Z

scripts/exregional_run_met_ascii2nc_obs.sh

+#
+  'metplus_tool_name': '${metplus_tool_name}'
+  'MetplusToolName': '${MetplusToolName}'
+  'METPLUS_TOOL_NAME': '${METPLUS_TOOL_NAME}'


Why are all three of these needed? Seems like the same information repeated a lot.

christinaholtNOAA · 2025-02-25T19:32:56Z

ush/config_defaults.yaml

-  # with 0 quiet and 5 loudest.
+  # Logging verbosity level used by METplus verification tools.  0 to 9,
+  # with 0 having the fewest log messages and 9 having the most. Levels 5
+  # and above can result in very large log files and slower tool execution..


Suggested change

# and above can result in very large log files and slower tool execution..

# and above can result in very large log files and slower tool execution.

christinaholtNOAA · 2025-02-25T19:34:36Z

ush/generate_FV3LAM_wflow.py

-    # TODO: Reference all these variables in their respective
-    # dictionaries, instead.
-    import_vars(dictionary=flatten_dict(expt_config))
-    export_vars(source_dict=flatten_dict(expt_config))


christinaholtNOAA · 2025-02-25T19:38:16Z

ush/generate_FV3LAM_wflow.py

+    # TODO: Reference all these variables in their respective
+    # dictionaries, instead.
+    import_vars(dictionary=flatten_dict(expt_config))
+    export_vars(source_dict=flatten_dict(expt_config))


I made some similar clean up changes in my PR. I find that it's safer to limit the sections that you export here and you can avoid flattening for this section for the most part with:

export_vars(source_dict=expt_config["global"])

christinaholtNOAA · 2025-02-25T19:40:42Z

ush/machine/derecho.yaml

+  TEST_NOHRSC_OBS_DIR: '{{ platform.WE2E_TEST_DATA }}/obs_data/nohrsc/proc'
+  TEST_AERONET_OBS_DIR: '{{ platform.WE2E_TEST_DATA }}/obs_data/aeronet'
+  TEST_AIRNOW_OBS_DIR: '{{ platform.WE2E_TEST_DATA }}/obs_data/airnow'
+  DOMAIN_PREGEN_BASEDIR: '{{ platform.WE2E_TEST_DATA }}/FV3LAM_pregen'


gsketefian and others added 30 commits July 25, 2024 11:32

Fix the workflow task dependencies and ex-script for the GenEnsProd a…

dc4971d

…nd EnsembleStat tasks such that GenEnsProd does not depend on the completion of get_obs_... tasks (because it doesn't need observations) but only forecast output while EnsembleStat does.

Bug fixes after running WE2E vx suite.

13aba39

Bugfix to dependencies of ensemble vx tasks that come after GenEnsPro…

860f62e

…d due to changes to dependencies of GenEnsProd tasks in previous commit(s).

Bug fixes to get all WE2E vx tests to succeed.

e54ec16

Increase default wallclock time for get_obs_ccpa tasks since they're …

8e8a1c1

…tending to time out for 48-hour forecasts.

Bug fix in yaml.

5550a41

Fix still-existing problem of file clobbering with get_obs_mrms and p…

c76ed1a

…ossibly also get_obs_ndas by putting in sleep commands.

Improvements to jinja2 code to put in dependencies from other cycles.

3f1dea1

Bug fix.

53dd688

Minor typo fix.

f9af954

Add workflow configuration options for whether or not to remove raw o…

f81cd1c

…bs files.

First round of changes before testing, only including obs pulling tas…

cd19554

…ks so far

create_symlink_to_file() did not support wildcards. Now it does

6355655

Some fixes for new obs: need to define paths in default workflow task…

8353c5d

…, need to create observation directories if they don't exist

Add "get obs" tasks to list that gets deactivated if that ob type is …

880cf63

…not specified, include correct valid VX_FIELDS for new variables

Adding new smoke test! Only retrieving obs and checking output for no…

e30316c

…w; more tasks to come!

Fix location of aeronet data in HPSS tar files

7dbfc39

Fix incorrect task list for smoke variables so we get a valid XML for…

6b9aea9

… non-smoke cases

Implement pythonized set_vx_fhr_list for all scripts

f8c93c6

Fix the problem with AOD, turns out we just need to ensure METplus conf

e2fbdaf

files are unique! Also, make the metatask rules for ASCII2nc simpler

- Update some comments in config_defaults.yaml

01f0080

- Produce hourly nc obs files for AOD - Probably doesn't make a difference, but explicitly reference AOD as "AERONET_AOD" in POINT_STAT_MESSAGE_TYPE

Setting AOD ob level to 550; per Partha Bhattacharjee the AOD output …

51f31f9

…from RRFS is 550 nm. This gets us matched pairs!

mkavulich added 2 commits February 21, 2025 20:13

Incorporate fixes for 24+ hour forecasts from Gerard

d45a8bd

More correct error message in create_symlink_to_file.py

da29c88

mkavulich and others added 20 commits February 21, 2025 20:56

Attempt fix/enhancement of test_generate_FV3LAM_wflow.py

3b0baca

Attempted fix for test_generate_FV3LAM_wflow.py

0825486

Fix bad s3 retrieval command

be8d1e0

More test fixes: correct AWS retrieval command, correctly escape back…

22a1564

…slashes in SED string

Make the linter happy 😑

2e42b66

Correct AWS bucket path (I think)

aa4cfdb

Get public S3 data unauthentcated

f11ddad

Add --no-progress flag so log files arent enormous

b39bfeb

Github runners dont have enough space for fix files. Try dummy direct…

6b039a1

…ories.

Merge branch 'develop' into feature/add_smoke_vx

d33a3a7

Fix test file maybe

8d8ef29

Fix sed command

f3f8333

ACTUALLY fix sed command

0b92d49

More test debugging

e8705dc

another fix attempt!

e287312

Another attempt

b3d753a

Finally working?????

0fb7c8f

Unit test finally fixed!

e717e91

Revert inadvertant change to Gaea machine file

644dbda

MichaelLueken requested changes Feb 24, 2025

View reviewed changes

modulefiles/tasks/gaeac6/run_vx.local.lua Outdated Show resolved Hide resolved

ush/machine/gaeac5.yaml Outdated Show resolved Hide resolved

Missed gaea updates

489428c

MichaelLueken approved these changes Feb 25, 2025

View reviewed changes

christinaholtNOAA approved these changes Feb 25, 2025

View reviewed changes

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[develop] Add smoke and dust verification #1174

[develop] Add smoke and dust verification #1174

mkavulich commented Jan 8, 2025 •

edited

Loading

mkavulich commented Feb 21, 2025

MichaelLueken commented Feb 21, 2025

MichaelLueken commented Feb 21, 2025

mkavulich commented Feb 22, 2025

MichaelLueken left a comment

MichaelLueken left a comment

christinaholtNOAA left a comment

christinaholtNOAA Feb 25, 2025

christinaholtNOAA Feb 25, 2025

christinaholtNOAA Feb 25, 2025

christinaholtNOAA Feb 25, 2025

christinaholtNOAA Feb 25, 2025

christinaholtNOAA Feb 25, 2025

christinaholtNOAA Feb 25, 2025

christinaholtNOAA Feb 25, 2025

christinaholtNOAA Feb 25, 2025

christinaholtNOAA Feb 25, 2025

		AIRNOW observations can be retrieved from AWS in addition to HPSS, but this requires changing some default settings.
		See ``ush/config_defaults.yaml`` or :numref:`Section %s <GeneralVXParams>` for more details.

	The "`AErosol RObotic NETwork <https://aeronet.gsfc.nasa.gov/>`_": A worldwide ground-based remote sensing aerosol networks established by NASA and PHOTONS. The SRW verification tasks can use "Level 1.5" (cloud-screened and quality-controlled) aerosol optical depth observations.
	The "`AErosol RObotic NETwork <https://aeronet.gsfc.nasa.gov/>`_": A worldwide ground-based remote sensing aerosol network established by NASA and PHOTONS. The SRW verification tasks can use "Level 1.5" (cloud-screened and quality-controlled) aerosol optical depth observations.

	The `Model Evaluation Tools <https://dtcenter.org/community-code/model-evaluation-tools-met>`__ is a highly-configurable, state-of-the-art suite of verification tools developed at the :term:`DTC`. `METplus <https://dtcenter.org/community-code/metplus>`_ is a suite of python wrappers providing low-level automation of the MET tools.
	The `Model Evaluation Tools <https://dtcenter.org/community-code/model-evaluation-tools-met>`__ is a highly configurable, state-of-the-art suite of verification tools developed at the :term:`DTC`. `METplus <https://dtcenter.org/community-code/metplus>`_ is a suite of Python wrappers providing low-level automation of the MET tools.

	# and above can result in very large log files and slower tool execution..
	# and above can result in very large log files and slower tool execution.

[develop] Add smoke and dust verification #1174

Are you sure you want to change the base?

[develop] Add smoke and dust verification #1174

Conversation

mkavulich commented Jan 8, 2025 • edited Loading

DESCRIPTION OF CHANGES:

New observation types

New MET tool: ASCII2NC

Generalizing some tasks and metatasks

MET and METplus upgrade

Additional updates

Type of change

TESTS CONDUCTED:

DEPENDENCIES:

DOCUMENTATION:

ISSUE:

CHECKLIST

CONTRIBUTORS (optional):

mkavulich commented Feb 21, 2025

MichaelLueken commented Feb 21, 2025

MichaelLueken commented Feb 21, 2025

mkavulich commented Feb 22, 2025

MichaelLueken left a comment

Choose a reason for hiding this comment

MichaelLueken left a comment

Choose a reason for hiding this comment

christinaholtNOAA left a comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

mkavulich commented Jan 8, 2025 •

edited

Loading