==== OPER ==== -------------- Configurations -------------- Three sloop-hycom3d configurations are operated by the Meteo-France services. Hycom3d-Manga ============= * area : English channel and Gulf of Biscay * horizontal resolution : 1/40° * vertical resolution : 40 levels * atmospheric fluxes: arpege eurat01 (Meteo-France) * open boundaries and spectral nudging: psy4 (Mercator Ocean International) * rivers inflow: real time observations (CMEMS) .. image:: images/manga.png Hycom3d-Med =========== * area : Mediterranean Sea * horizontal resolution : 1/60° * vertical resolution : 32 levels * atmospheric fluxes: arpege eurat01 (Meteo-France) * open boundaries and spectral nudging: psy4 (Mercator Ocean International) * rivers inflow: climatology + real time observations (CMEMS) .. image:: images/med.png Hycom3d-Indien ============== * area : Arabian Sea, Red Sea and Persian Gulf * horizontal resolution : 1/40° * vertical resolution : 40 levels * atmospheric fluxes: arpege glob025 (Meteo-France) * open boundaries and spectral nudging: psy4 (Mercator Ocean International) * rivers inflow: climatology .. image:: images/indien.png ------------------------------------------------------------------------------- -------- Scenario -------- .. image:: images/scenario_avecSN.png Daily ===== The workflow starts at 05:40:00 UTC, and ends: * for the `manga` configuration at 06:10:00 UTC * for the `med` configuration at 07:05:00 UTC * for the `indien` configuration at 06:20:00 UTC Weekly ====== The workflow starts at 13:00:00 UTC, and ends: * for the `manga` configuration at 14:50:00 UTC * for the `med` configuration at 18:30:00 UTC * for the `indien` configuration at 15:06:00 UTC ------------------------------------------------------------------------------- ------------------------- Vortex jobs, tasks & conf ------------------------- .. table:: Operational workflow :class: longtable +------------------------------+--------------------------------+---------------------------------------------+--------------------------------+------------------------------------------+ | | Jobs | Execution Duration (hh:mm:ss) | Tasks | Description | | | +-----------+----------------+----------------+ | | | | |Manga |Med |Indien | | | +=====================+========+================================+===========+================+================+================================+==========================================+ | 1. Fetch flow data | Daily |recextspinup_shom[conf] | 00:00:30 | \#\#\#\#\#\#\# | 00:00:10 | recextfiles_spinup | Fetch arpege, psy4 and cmems data | | | +--------------------------------+-----------+----------------+----------------+--------------------------------+------------------------------------------+ | | |recextforecast_shom[conf] | 00:01:10 | \#\#\#\#\#\#\# | 00:00:30 | recextfiles_forecast | Fetch arpege, psy4 and cmems data | | +--------+--------------------------------+-----------+----------------+----------------+--------------------------------+------------------------------------------+ | | Weekly |recextspnudge_shom[conf] | 00:05:10 | \#\#\#\#\#\#\# | 00:01:10 | recextfiles_spnudge | Fetch arpege, psy4 and cmems data | +---------------------+--------+--------------------------------+-----------+----------------+----------------+--------------------------------+------------------------------------------+ | 2. Pre-processings | Daily |riverspinup_shom[conf] | 00:00:15 | 00:00:16 | 00:00:14 | run_rivers_spinup | Build rivers inflow .r files | | | +--------------------------------+-----------+----------------+----------------+--------------------------------+------------------------------------------+ | | |riverforecast_shom[conf] | 00:00:19 | 00:00:22 | 00:00:17 | run_rivers_forecast | Build rivers inflow .r files | | | +--------------------------------+-----------+----------------+----------------+--------------------------------+------------------------------------------+ | | |atmfrcspinup_shom[conf] | 00:01:27 | 00:02:18 | 00:02:29 | run_atmfrc_spinup | Build atmospheric fluxes .[a/b] files | | | +--------------------------------+-----------+----------------+----------------+--------------------------------+------------------------------------------+ | | |atmfrcforecast_shom[conf] | 00:04:11 | 00:06:04 | 00:09:28 | run_atmfrc_forecast | Build atmospheric fluxes .[a/b] files | | | +--------------------------------+-----------+----------------+----------------+--------------------------------+------------------------------------------+ | | |ibcspinup_shom[conf] | 00:03:14 | 00:06:06 | 00:02:07 | run_ibc_spinup | Build boundary conditions .[a/b] files | | | +--------------------------------+-----------+----------------+----------------+--------------------------------+------------------------------------------+ | | |ibcforecast_shom[conf] | 00:06:08 | 00:13:37 | 00:04:28 | run_ibc_forecast | Build boundary conditions .[a/b] files | | +--------+--------------------------------+-----------+----------------+----------------+--------------------------------+------------------------------------------+ | | Weekly |atmfrcspnudge_shom[conf] | 00:14:33 | 00:12:45 | 00:22:56 | run_atmfrc_spnudge | Build atmospheric fluxes .[a/b] file | | | +--------------------------------+-----------+----------------+----------------+--------------------------------+------------------------------------------+ | | |riverspnudge_shom[conf] | 00:00:55 | 00:00:46 | 00:00:35 | run_rivers_spnudge | Build rivers inflow .r files | | | +--------------------------------+-----------+----------------+----------------+--------------------------------+------------------------------------------+ | | |ibcspnudge_shom[conf] | 00:15:03 | 00:34:48 | 00:11:20 | run_ibc_spnudge | Build boundary conditions .[a/b] files | +---------------------+--------+--------------------------------+-----------+----------------+----------------+--------------------------------+------------------------------------------+ | 3. Model run | Daily |modelspinup_shom[conf] | 00:03:07 | 00:08:57 | 00:02:35 | run_model_spinup | Spinup free model execution | | | +--------------------------------+-----------+----------------+----------------+--------------------------------+------------------------------------------+ | | |modelforecast_shom[conf] | 00:14:11 | 00:41:08 | 00:11:38 | run_model_forecast | Forecast free model execution | | +--------+--------------------------------+-----------+----------------+----------------+--------------------------------+------------------------------------------+ | | Weekly |modelspnudge_shom[conf] | 01:21:17 | 04:19:02 | 01:05:17 | run_model_spnudge | Model execution with spectral nudging | +---------------------+--------+--------------------------------+-----------+----------------+----------------+--------------------------------+------------------------------------------+ | 4. Post-processings | Daily |postdatashomforecast_shom[conf] | 00:02:37 | 00:05:07 | \#\#\#\#\#\#\# | run_postprod_datashom_forecast | Formatting hycom3d outputs for data.shom | | | +--------------------------------+-----------+----------------+----------------+--------------------------------+------------------------------------------+ | | |postsoapforecast_shom[conf] | 00:08:28 | 00:28:19 | 00:16:44 | run_postprod_soap_forecast | Formatting hycom3d outputs for soap | | +--------+--------------------------------+-----------+----------------+----------------+--------------------------------+------------------------------------------+ | | Weekly |postdatashomspnudge_shom[conf] | 00:05:50 | 00:02:29 | \#\#\#\#\#\#\# | run_postprod_datashom_spnudge | Formatting hycom3d outputs for data.shom | | | +--------------------------------+-----------+----------------+----------------+--------------------------------+------------------------------------------+ | | |postsoapspnudge_shom[conf] | 00:09:10 | 00:30:27 | 00:21:52 | run_postprod_soap_spnudge | Formatting hycom3d outputs for soap | +---------------------+--------+--------------------------------+-----------+----------------+----------------+--------------------------------+------------------------------------------+ Vortex jobs, tasks and conf are available on the operational hpc cluster of Meteo-France at ``/homech/mxpt001/vortex/oper/[vapp]/[vconf]/``. Versioning of the operational tasks and conf is performed with git and the `GitLab `_ platform (see the `sloop-oper `_ project). We also archive the operational version of the conf and tasks on the Shom network at ``/usr/site/data/DOPS/STM/DTO/SLOOP_OPER/[vapp]/[vconf]/[tasks|conf]_[tag].tgz``. For instance, the operational tasks of the `manga` configuration of the `hycom3d` application tagged `oper_0.1.0` would be stored in ``/usr/site/data/DOPS/STM/DTO/SLOOP_OPER/hycom3d/manga/tasks_oper_0.1.0.tgz``. The archive is built by :doc:`cli.sloop.archive`. Informations about the archives are given by ``/usr/site/data/DOPS/STM/DTO/SLOOP_OPER/hycom3d/manga/info.json``. Example : .. literalinclude:: examples/info_tasksconf.json :language: json ------------------------------------------------------------------------------- ----- Softs ----- Libraries ========= The operational version of the sloop and vortex libraries are tagged and stored on the Shom network at ``/usr/site/data/DOPS/STM/DTO/SLOOP_OPER/softs/[sloop|vortex]_[tag].tar``. The archive is built by :doc:`cli.sloop.archive`. Informations about the archives are given by ``/usr/site/data/DOPS/STM/DTO/SLOOP_OPER/softs/info.json``. Example : .. literalinclude:: examples/info_soft.json :language: json Python ====== The sloop python environment is located on Meteo-France HPC clusters at ``/homech/mxpt001/vortex/sloop-env/``. Versioning of the python environment is performed with git and the `GitLab `_ platform (see the `sloop-oper `_ project). The python environment is saved in a `sloop-oper-environment.yml` file by running on belenos:: $ /homech/mxpt001/vortex/sloop-env/bin/conda env export -n root --file sloop-oper-environment.yml ------------------------------------------------------------------------------- ------ Inputs ------ Geoflow resources ================= Everyday geoflow resources are pushed in the operational products database of Meteo-France (BDPE). +---------+--------+--------------+---------------------+-----------------------------+ | | | | | | | Product | Model | Institution | BDPE Availability | Description | | | | | | | | | | +---------------------+ | | | | | | | | | | | Retention period: | | | | | | 7 days | | | | | | | | | | | +---------------------+ | | | | | | | | | | | Arrival time | | | | | | | | +=========+========+==============+=====================+=============================+ | | | | | analysis arpege | | 14620 | arpege | Meteo-France | | global instantaneous | | | | | | | +---------+--------+--------------+---------------------+-----------------------------+ | | | | | analysis arpege North | | 14621 | arpege | Meteo-France | 08:30 | Sea-Gascogne-Mediterrannee | | | | | | instantaneous | +---------+--------+--------------+---------------------+-----------------------------+ | | | | | forecast arpege global | | 14622 | arpege | Meteo-France | | instantaneous | | | | | | | +---------+--------+--------------+---------------------+-----------------------------+ | | | | | forecast arpege North | | 14623 | arpege | Meteo-France | 02:46 | Sea-Gascogne-Mediterrannee | | | | | | instantaneous | +---------+--------+--------------+---------------------+-----------------------------+ | | | | | analysis arpege global | | 14680 | arpege | Meteo-France | | cumulated | | | | | | | +---------+--------+--------------+---------------------+-----------------------------+ | | | | | analysis arpege North | | 14681 | arpege | Meteo-France | 08:30 | Sea-Gascogne-Mediterrannee | | | | | | cumulated | +---------+--------+--------------+---------------------+-----------------------------+ | | | | | forecast arpege global | | 14682 | arpege | Meteo-France | | cumulated | | | | | | | +---------+--------+--------------+---------------------+-----------------------------+ | | | | | forecast arpege North | | 14683 | arpege | Meteo-France | 03:29 | Sea-Gascogne-Mediterrannee | | | | | | cumulated | +---------+--------+--------------+---------------------+-----------------------------+ | | | | | daily mercator North | | 14674 | psy4 | MO-I | 01:53 | Sea-Gascogne-Mediterrannee | | | | | | | +---------+--------+--------------+---------------------+-----------------------------+ | | | | | weekly mercator North | | 14675 | psy4 | MO-I | | Sea-Gascogne-Mediterrannee | | | | | | | +---------+--------+--------------+---------------------+-----------------------------+ | | | | | daily mercator Arabian Sea | | 14676 | psy4 | MO-I | | | | | | | | | +---------+--------+--------------+---------------------+-----------------------------+ | | | | | weekly mercator Arabian Sea | | 14677 | psy4 | MO-I | | | | | | | | | +---------+--------+--------------+---------------------+-----------------------------+ | | | | | daily river observations | | 14679 | obs | CMEMS | | | | | | | | | +---------+--------+--------------+---------------------+-----------------------------+ Input data are available in the local operational vortex cache for 15 days at ``/chaine/mxpt001/vortex/mtool/cache/vortex/[vapp]/[vconf]/OPER``. Constants ========= The static files are stored in the GCO archive and accessible via the GCO cycles herebelow. +---------------+----------------------------------+ | Configuration | GCO cycle | +===============+==================================+ | Manga | hycom3d01_hycom3d@manga-main.11 | +---------------+----------------------------------+ | Med | hycom3d01_hycom3d@med-main.02 | +---------------+----------------------------------+ | Indien | hycom3d01_hycom3d@indien-main.07 | +---------------+----------------------------------+ The operational version of the constants are tagged via a cycle name by GCO (Meteo-France service) via a genv file, for instance : .. literalinclude:: examples/hycom3d01_hycom3d@indien-main.04 :language: ini We also archive on the Shom network the namelists and executables at ``/usr/site/data/DOPS/STM/DTO/SLOOP_OPER/softs/[vapp]/[vconf]/[exe|consts]_[cycle].tgz``. The archive is built by :doc:`cli.sloop.archive`. Informations about the archives are given by ``/usr/site/data/DOPS/STM/DTO/SLOOP_OPER/softs/info.json``. Example : .. literalinclude:: examples/info_consts.json :language: json ------------------------------------------------------------------------------- ------- Outputs ------- Log === The log files are stored and available on the Meteo-France HPC systems (i.e. belenos and taranis) at ``/home/ch/mxpt001/oldres/[yyyymmdd]/[job]_r00.[yyyymmddHHMMSS]``, for instance ``/homech/mxpt001/oldres/20220513/postsoapspnudge_shomindien_r00.20220513125404``. Model ===== The model outputs and restart files are stored on the Meteo-France archive system (hendrix) at ``/chaine/mxpt/mxpt001/vortex/hycom3d/[conf]/OPER/[YYYY/MM/DD]/T0000P/run_[mode]``, for instance ``/chaine/mxpt/mxpt001/vortex/hycom3d/manga/OPER/2022/05/11/T0000P/run_spinup``. The specifications of the model outputs depend on the regional configuration and are summarized hereafter. Manga ----- +--------------+---------------------------------------------+-----------+-----------------------+ | Product | Parameters | Time Step | Spatial extent | +--------------+--------+------------------------------------+-----------+-----------------------+ | MANGA | 2D | u, v, sst, sss, ssh, ubavg, vbavg | 1 hour | [-15°E : 2.875°E] ; | | +--------+------------------------------------+ | [43.0087°N : 51°N] | | | 3D | u, v, temp, saln, h, sigma | | | +--------------+--------+------------------------------------+ | | | MANGASTERNE | STERNE | ssh, h, difs, um, vm | | | +--------------+--------+------------------------------------+-----------+-----------------------+ Med --- +--------------+---------------------------------------------+-----------+-----------------------------+ | Product | Parameters | Time Step | Spatial extent | +--------------+--------+------------------------------------+-----------+-----------------------------+ | MED | 3D | u, v, temp, saln, h, sigma | 1 day | [-7°E : 36.2333°E] ; | | +--------+------------------------------------+-----------+ [30.2333°N : 45.8167°N] | | | 2D | u, v, sst, sss, ssh, ubavg, vbavg | 1 hour | | +--------------+--------+------------------------------------+-----------+-----------------------------+ | MEDSTERNE | STERNE | ssh, h, difs, um, vm | 2 hours | [2.0°E : 12.0°E] ; | | | | | | [40.75°N : 44.5°N] | +--------------+--------+------------------------------------+-----------+-----------------------------+ | MEDOC | 3D | u, v, temp, saln, h | 1 hour | [1.5°E : 12.5°E] ; | | +--------+------------------------------------+ | [37.7167°N : 44.9833°N] | | | 2D | u, v, sst, sss, ssh | | | +--------------+--------+------------------------------------+-----------+-----------------------------+ | MEDOR | 3D | u, v, temp, saln, h | 1 hour | [25.5°E : 36.2333°E] ; | | +--------+------------------------------------+ | [30.2333°N : 37.5°N] | | | 2D | u, v, sst, sss, ssh | | | +--------------+--------+------------------------------------+-----------+-----------------------------+ | MEDIO | 3D | u, v, temp, saln, h | 1 hour | [9.48333°E : 22.4833°E] ; | | +--------+------------------------------------+ | [30.2333°N : 39.4833°N] | | | 2D | u, v, sst, sss, ssh | | | +--------------+--------+------------------------------------+-----------+-----------------------------+ | GIBAL | 3D | u, v, temp, saln, h | 1 hour | [-7°E : 2.4833°E] ; | | +--------+------------------------------------+ | [33.4833°N : 39.4833°N] | | | 2D | u, v, sst, sss, ssh | | | +--------------+--------+------------------------------------+-----------+-----------------------------+ Indien ------ +--------------+---------------------------------------------+-----------+-----------------------+ | Product | Parameters | Time Step | Spatial extent | +--------------+--------+------------------------------------+-----------+-----------------------+ | INDIEN | 2D | u, v, sst, sss, ssh, ubavg, vbavg | 1 hour | [32.3°E : 77.05°E] ; | | +--------+------------------------------------+ | [5°N : 30.1155°N] | | | 3D | u, v, temp, saln, h, sigma | | | +--------------+--------+------------------------------------+-----------+-----------------------+ Post-production =============== The post-production outputs are stored on the Meteo-France archive system (hendrix). The release times are summarized in the table hereafter. +--------+---------------------------------------+-------------------------------+--------------------+ | | data.shom | soap | sterne | | +--------------------+------------------+----------------+--------------+--------------------+ | | daily | weekly | daily | weekly | daily | +========+====================+==================+================+==============+====================+ | Manga | 06:03 UTC | 14:44 UTC | 06:09 UTC | 14:50 UTC | ``(not oper yet)`` | +--------+--------------------+------------------+----------------+--------------+--------------------+ | Med | 06:41 UTC | 18:09 UTC | 07:06 UTC | 18:30 UTC | ``(not oper yet)`` | +--------+--------------------+------------------+----------------+--------------+--------------------+ | Indien | \#\#\#\#\#\#\#\#\# | \#\#\#\#\#\#\#\# | 06:18 UTC | 15:06 UTC | \#\#\#\#\#\#\#\#\# | +--------+--------------------+------------------+----------------+--------------+--------------------+ data.shom --------- The data.shom products are available at ``/chaine/mxpt/mxpt001/vortex/hycom3d/[manga/med]/OPER/[YYYY/MM/DD]/T0000P/postprod/datashom_[forecast/spnudge]/``. The data.shom production provides daily data from J-1 to J+5 and weekly data, on wednesday, from J-14 to J. +------------+----------------------------------------------+ | Production | Spatial extent | +============+==============================================+ | MANGA | [-15°E : 2.875°E] ; [43.0087°N : 51°N] | +------------+----------------------------------------------+ | MEDOCNORD | [2°E : 12°E] ; [38°N : 44.5°N] | +------------+----------------------------------------------+ .. image:: images/datashom.png The parameters saved for data.shom are : +------+------------------+------------------+--------------+ | Type | Parameters | Time frequency | Vertical | +======+==================+==================+==============+ | 2D | u, v, sst, sss | 1 hour | surface | +------+------------------+------------------+--------------+ | 3D | u, v, temp, saln | 25h mean | fixed depth | +------+------------------+------------------+--------------+ sterne ------ The sterne products are available at ``/chaine/mxpt/mxpt001/vortex/hycom3d/[manga/med]/OPER/[YYYY/MM/DD]/T0000P/postprod/sterne_forecast/``. The sterne production provides daily data from J-1 to J+5. +-------------+----------------------------------------+----------------+ | Production | Spatial extent | Time frequency | +=============+========================================+================+ | MANGASTERNE | [-15°E : 2.875°E] ; [43.0087°N : 51°N] | 1 hour | +-------------+----------------------------------------+----------------+ | MEDSTERNE | [2.0°E : 12.0°E] ; [40.75°N : 44.5°N] | 2 hours | +-------------+----------------------------------------+----------------+ .. image:: images/sterne.png The parameters saved for data.shom are : +------+------------------+--------------+ | Type | Parameters | Vertical | +======+==================+==============+ | 2D | ssh | surface | +------+------------------+--------------+ | 3D | h, um, vm, difs | model | +------+------------------+--------------+ soap ---- The soap products are available at ``/chaine/mxpt/mxpt001/vortex/hycom3d/[manga/med/indien]/OPER/[YYYY/MM/DD]/T0000P/postprod/soap_[forecast/spnudge]/``. The soap production provides daily data from J-1 to J+5 and weekly data, on wednesday, from J-14 to J-7. +------------+-------------------------------------+ | Production | Spatial extent | +============+=====================================+ | AZXMANGA | [-12°E : 2°E] ; [43°N : 51°N] | +------------+-------------------------------------+ | MZX | [3°E : 11°E] ; [40°N : 44.5°N] | +------------+-------------------------------------+ | MEDOR | [26°E : 36.23°E] ; [30.5°N : 37°N] | +------------+-------------------------------------+ | MEDIO | [10°E : 22°E] ; [30°N : 39°N] | +------------+-------------------------------------+ | GIBAL | [-7°E : 2°E] ; [34°N : 39°N] | +------------+-------------------------------------+ | GAPOMAN | [47°E : 64°E] ; [22°N : 31°N] | +------------+-------------------------------------+ | OMANARABIE | [56°E : 64°E] ; [10°N : 22°N] | +------------+-------------------------------------+ | ADEN | [42°E : 56°E] ; [8°N : 18°N] | +------------+-------------------------------------+ | MEROU | [32.35°E : 44°E] ; [10°N : 30.07°N] | +------------+-------------------------------------+ .. image:: images/soap.png The parameters saved for data.shom are : +------+--------------------+------------------+--------------+ | Type | Parameters | Time | Vertical | +======+====================+==================+==============+ | 2D | dyn (ssh) | demerliac, | surface | | | | 25h mean | | +------+--------------------+------------------+--------------+ | 3D | dyn (u, v), | 1 hour, | fixed depth | | | hydro (temp, saln) | 25h mean | | +------+--------------------+------------------+--------------+ ------------------------------------------------------------------------------- ----------- Pre-release ----------- Pre-release refers to the versions of configurations we consider ready to be pushed in the operational environment. Sources ======= The pre-released sources are pulled on the r&d hpc clustering system at ``~/Repos_prerelease/``. The sources are: - the Vortex library on the `shom_sloop-prerelease` branch - the Sloop library on the `prerelease` branch - the Vortex tasks in the ``sloop-oper/{vapp}/tasks`` directory Experiment ========== A `prerelease@sloopoper` experiment is initialised on the r&d hpc clustering system for the three configurations: - ``/scratch/work/morvanm/prerelease@sloopoper/hycom3d/manga`` - ``/scratch/work/morvanm/prerelease@sloopoper/hycom3d/med`` - ``/scratch/work/morvanm/prerelease@sloopoper/hycom3d/indien`` The daily and weekly workflows are ran by sloop via :doc:`cli.sloop.run`. - daily workflow named `{vconf}_forecast.cfg`: .. literalinclude:: examples/manga_forecast.cfg :language: ini - weekly workflow named `{vconf}_spnudge.cfg`: .. literalinclude:: examples/manga_spnudge.cfg :language: ini Real-time testing ================= The pre-release configurations are testing in real time on the r&d hpc system. For each configuration, two crontab are implemented, for instance, .. code-block:: bash 15 06 * * * /scratch/work/morvanm/prerelease@sloopoper/hycom3d/med/cron_med_daily.sh 15 13 * * 3 /scratch/work/morvanm/prerelease@sloopoper/hycom3d/med/cron_med_weekly.sh The bash script executed by the crontab contains the :doc:`cli.sloop.run` command as well as the shell environment setup. For instance, `cron_med_daily.sh` contains: .. literalinclude:: examples/cron_med_daily.sh :language: bash Archive ======= The model outputs, restart files and post-production outputs are pushed on `hendrix.meteo.fr` Output data have to be checked by the services in charge of the diffusion or the configuration development for instance. Validation ========== In the following sub-sections, we describe a procedure to set up and run a hindcast run with the pre-released resources. Initialisation -------------- - Load your sloop environment - Run :doc:`cli.sloop.init` with suitable arguments, for example: .. code-block:: bash sloop init hycom3d manga validprerelease@$LOGNAME -w $WORKDIR --sloop-env oper - Go to the experiment directory given by sloop, by running for example: .. code-block:: bash cd $WORKDIR/validprerelease@$LOGNAME/hycom3d/manga - At this stage, you should carefuly fill the ``conf/[vapp]_[vconf].ini`` file. You can either copy the corresponding file stored on belenos.meteo.fr at ``~morvanm/Repos_prerelease/conf`` or catch it from a clone of `sloop-oper `_ | prerelease.2023T1.01 | +------------------+----------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------------+ | **vortex** | `vortex `_ | prerelease.2023T1.01 | +------------------+----------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------------+ | **conf & tasks** | `sloop-oper `_ | prerelease.2023T1.01 | +------------------+----------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------------+ | **constants** | hendrix.meteo.fr | hycom3d01_hycom3d@manga-main.12@morvanm, hycom3d01_hycom3d@med-main.03@morvanm, hycom3d01_hycom3d@indien-main.08@morvanm | +------------------+----------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------------+ - Details - **Add the STERNE production for IRSN over MANGA and MED configurations** New fields are now computed (*um*, *vm* and *difs*) by hycom. The STERNE production is daily pushed on the vortex.archive.fr in ``[vapp]/[vconf]/prerelease/[YYYYMMDD]T0000P/postprod/sterne_forecast``. * Hycom sources modification in sloop, see merge requests `76 `_ and `77 `_ ; * New geometry and fields added in vortex, see merge request `25 `_ ; * The modified static files are ``postprod.cfg`` (manga and med), ``blkdat_cmo_*.input`` (manga, med and indien) and ``savefield_*.input`` (manga and med) ; * Since all regional configuration are impacted, three hycom executables have been generated ; * The impacted tasks & conf are ``run_model_spinup.py``, ``run_postprod_sterne_forecast.py``, ``hycom3d_manga.ini``, ``hycom3d_med.ini``, ``hycom3d_indien.ini``. - **Add the model and post-production outputs checking** Now we check the number of files generated by the model and post-production tasks, as well as the number of terms contained in each files. In case of missing files, an ascii file describing the missing files is generated and pushed on vortex.archive.fr in the same directory of task outputs. * The command sloop check promises has been implemented, see merge request `72 `_ ; * The vortex data components have been added, see the corresponding vortex `commit a27aa9... `_ ; * The impacted tasks are ``run_model_spinup.py``, ``run_postprod_datashom_forecast.py`` ; * A ``promises.cfg`` has been added for each regional configuration (manga, med, indien) ; - **Update SOAP production** The dynamical and hydrological fields are now separated in the SOAP production. The daily analysed data are no longer provided. We add the MEROU area. * Sloop has been modified, see merge request `75 `_ ; * The vortex data component have been modified, see the corresponding vortex `commit a04eac... `_ ; * The modified static file is ``postprod.cfg`` for each regional configuration. ------------------------------------------------------------------------------- -------- Delivery -------- In order to make a new version of a configuration operational, Shom has to deliver materials to 3 Meteo-France services: 1. vortex.support The vortex.support team is in charge of reviewing the Shom implementation in the vortex library. In order to be reviewed, a dedicated branch of the vortex library has to be pushed by Shom on the `cnrm git server `_. The push has to be accompanied by an e-mail to vortex.support. 2. GCO The constants (namelists, static binaries, executables...) are stored by the GCO service. The new cycle, genv and the files associated with, are provided on the R&D hpc cluster (belenos). An e-mail has to be sent to the GCO team with a documentation indicating the changes. 3. IGA The operational set up is performed by IGA. The tasks and conf files are provided on the R&D hpc cluster (belenos). The branch `release` of the sloop repository is also provided on the R&D hpc cluster. An e-mail has to be sent to the IGA team. ------------------------------------------------------------------------------- ----- Repro ----- For re-running the OPER experiment, we deploy a simili-oper installation on the R&D hpc cluster (belenos) at ``/scratch/work/morvanm/oper@morvanm``. The sources (vortex and sloop repositories, python installation and tasks) are stored at ``/home/ext/sh/csho/morvanm/Repos_oper``. The :doc:`cli.sloop.run` command can be used. ------------------------------------------------------------------------------- -------- Contacts -------- +------------------+------------------------------------------+ | Shom | - mathieu.morvan@shom.fr | | | - stephanie.correard@shom.fr | +------------------+--------+---------------------------------+ | Meteo-France | IGA | - gilles.versepuech@meteo.fr | | | | - karine.bouyer@meteo.fr | | | | - denis.ferriol@meteo.fr | | +--------+---------------------------------+ | | GCO | mathilde.moureaux@meteo.fr | | +--------+---------------------------------+ | | Vortex | vortex.support@meteo.fr | +------------------+--------+---------------------------------+