:orphan:

==============================================
Code Testing Information for Code Contributors
==============================================

|

.. important::
   Before modifying code, consult `Information for WRF Code Contributors <info_for_contributors.rst>`_, which describes WRF coding standards, code testing, and code submission procedures. 

|

The following testing is required prior to submission for new or modified WRF code: 

*   :ref:`Software testing`
*   :ref:`Case testing`

|

|

|

.. _Software Testing:

Software Testing
================

Software testing checks different compilers and model configurations for bit-for-bit reproducibility. Modified WRF code must be run through the `WRF Testing Framework (WTF) <wtf.html>`_, which builds and tests WRF compilation and running and analyzes test results for new modifications. `Obtain the WTF materials <https://www2.mmm.ucar.edu/wrf/users/download/get_sources.html#testing>`_.

|

|

|

|

.. _Case Testing:

Case Testing
============

Case testing ensures code robustness and reasonable results. Reasonableness is verified by comparing WRF output from modified code with output from existing plots (provided below) or by reviewing the output. Robustness is addressed by running cases for summer and winter. 

|

At least one 24-hour summer and one 24-hour winter forecast are required for testing, using developer-selected cases from the provided list and input files.

|

|

Summer Cases
------------

The following Metgrid files for six test cases from Summer 2010 include the following details:

*   The domain is over the U.S.
*   Grid size (dx) : 20 km
*   Number of grid points : 290 x 190
*   Number of Eta levels : 40
*   `See the Case domain map <http://www2.mmm.ucar.edu/wrf/test_data/domain.png>`_
*   Obtain the `namelist.wps <http://www2.mmm.ucar.edu/wrf/test_data/namelist.wps>`_ and `namelist.input <http://www2.mmm.ucar.edu/wrf/test_data/namelist.input>`_ files
 
|

Tests may be conducted for any of the available initialization times. Note that verification plots are provided for the 2010-06-11 case to confirm reasonableness.

*   `2010-06-01_00 <http://www2.mmm.ucar.edu/wrf/test_data/met_em.2010060100.tar.gz>`_
*   `2010-06-05_00 <http://www2.mmm.ucar.edu/wrf/test_data/met_em.2010060500.tar.gz>`_
*   `2010-06-11_00 <http://www2.mmm.ucar.edu/wrf/test_data/met_em.2010061000.tar.gz>`_, see verification plots for `2010-06-11_12 <http://www2.mmm.ucar.edu/wrf/test_data/2010061112.pdf>`_ and `2010-06-12_00 <http://www2.mmm.ucar.edu/wrf/test_data/2010061200.pdf>`_
*   `2010-06-15_00 <http://www2.mmm.ucar.edu/wrf/test_data/met_em.2010061500.tar.gz>`_
*   `2010-06-20_00 <http://www2.mmm.ucar.edu/wrf/test_data/met_em.2010062000.tar.gz>`_
*   `2010-06-25_00 <http://www2.mmm.ucar.edu/wrf/test_data/met_em.2010062500.tar.gz>`_

|

|

Additional verification plots can be created using the `plot.ncl script <http://www2.mmm.ucar.edu/wrf/test_data/plot.ncl>`_ as a template.

|

|

|

Winter Cases
------------

The following Metgrid files for seven test cases from Winter 2012 include the following details:

*   The domain is over the U.S.
*   Grid size (dx) : 20 km
*   Number of grid points : 290 x 190
*   Number of Eta levels : 40
*   `See the Case domain map <http://www2.mmm.ucar.edu/wrf/test_data/domain.png>`_
*   Obtain the `namelist.wps <http://www2.mmm.ucar.edu/wrf/test_data/namelist.wps.feb2012>`_ and `namelist.input <http://www2.mmm.ucar.edu/wrf/test_data/namelist.input.feb2012>`_ files

|

Tests may be conducted for any of the available initialization times. Note that verification plots are provided for the 2012-02-03 case to confirm rea
sonableness.

*   `2012-02-01_00 <http://www2.mmm.ucar.edu/wrf/test_data/2012020100.tar.gz>`_
*   `2012-02-02_12 <http://www2.mmm.ucar.edu/wrf/test_data/2012020212.tar.gz>`_
*   `2012-02-03_00 <http://www2.mmm.ucar.edu/wrf/test_data/2012020300.tar.gz>`_, see verification plots for `2012-02-03_00 <http://www2.mmm.ucar.edu/wrf/test_data/2012020300.pdf>`_ and `2012-02-04_00 <http://www2.mmm.ucar.edu/wrf/test_data/2012020400.pdf>`_
*   `2012-02-04_00 <http://www2.mmm.ucar.edu/wrf/test_data/2012020400.tar.gz>`_
*   `2012-02-05_12 <http://www2.mmm.ucar.edu/wrf/test_data/2012020512.tar.gz>`_
*   `2012-02-07_00 <http://www2.mmm.ucar.edu/wrf/test_data/2012020700.tar.gz>`_
*   `2012-02-08_12 <http://www2.mmm.ucar.edu/wrf/test_data/2012020812.tar.gz>`_

|

|

Additional verification plots can be created using the `plot.ncl script <http://www2.mmm.ucar.edu/wrf/test_data/plot.ncl>`_ as a template.

|

|

|

|

|