Skip to content

Commit 8ccec7d

Browse files
kasra-keshavarzkasra-keshavarz
authored
Adding multiple HPC locations (#84)
1 parent 6ab4e9d commit 8ccec7d

File tree

8 files changed

+127
-78
lines changed

8 files changed

+127
-78
lines changed

‎docs/scripts/ab-gov.rst‎

Lines changed: 6 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -5,19 +5,22 @@ Location of Dataset Files
55
-------------------------
66

77
The ``ab-gov`` dataset is located under the following directories
8-
accessible from Compute Canada (CC) Graham Cluster:
8+
accessible from multiple clusters:
99

1010
.. code:: console
1111
12+
# DRAC Graham HPC location
1213
/project/rpp-kshook/Climate_Forcing_Data/meteorological-data/ab-gov # rpp-kshook allocation
13-
/project/rrg-mclark/data/meteorological-data/ab-gov # rrg-mclark allocation
14+
15+
# UCalgary ARC HPC location
16+
/work/comphyd_lab/data/meteorological-data/ab-gov # comphyd_lab allocation
1417
1518
and the structure of the dataset yearly files (containing daily
1619
time-steps) is as following:
1720

1821
.. code:: console
1922
20-
/project/rpp-kshook/Climate_Forcing_Data/meteorological-data/ab-gov
23+
/path/to/dataset/dir/
2124
├── BCC-CSM2-MR
2225
│ ├── Downscaled_BCC-CSM2-MR_MBCDS_historical_pr_tmn_tmx_1950.nc
2326
│ ├── .

‎docs/scripts/eccc-rdrs.rst‎

Lines changed: 9 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -11,14 +11,20 @@ accessible from Compute Canada (CC) Graham Cluster:
1111

1212
.. code:: console
1313
14+
# DRAC Graham HPC location
1415
/project/rpp-kshook/Climate_Forcing_Data/meteorological-data/rdrsv2.1 # rpp-kshook allocation
15-
/project/rrg-mclark/data/meteorological-data/rdrsv2.1 # rrg-mclark allocation
16+
17+
# UCalgary ARC HPC location
18+
/work/comphyd_lab/data/meteorological-data/rdrsv2.1 # comphyd_lab location
19+
20+
# Perdue University Anvil HPC location
21+
/anvil/datasets/meteorological/ECCC_RDRSv2.1 # Anvil community storage
1622
1723
and the structure of the dataset hourly files is as following:
1824

1925
.. code:: console
2026
21-
/project/rpp-kshook/Model_Output/RDRSv2.1
27+
/path/to/dataset/dir/
2228
├── 1980
2329
│ ├── 1980010112.nc
2430
│ ├── 1980010212.nc
@@ -54,7 +60,7 @@ Coordinate Variables and Time-stamps
5460
Coordinate Variables
5561
~~~~~~~~~~~~~~~~~~~~
5662

57-
The coordinate variables of the ``ERA5`` simulations are ``lon`` and
63+
The coordinate variables of the ``RDRSv2.1`` simulations are ``lon`` and
5864
``lat`` representing the longitude and latitude points, respectively.
5965
### Time-stamps The time-stamps are included in the original files.
6066

‎docs/scripts/ecmwf-era5.rst‎

Lines changed: 8 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -11,14 +11,20 @@ accessible from Compute Canada (CC) Graham Cluster:
1111

1212
.. code:: console
1313
14+
# DRAC Graham HPC location
1415
/project/rpp-kshook/CompHydCore/climateForcingData/ERA5/ERA5_for_SUMMA/2_merged_data # rpp-kshook allocation
15-
/project/rrg-mclark/data/meteorological-data/era5 # rrg-mclark allocation
16+
17+
# UCalgary ARC HPC location
18+
/work/comphyd_lab/data/meteorological-data/era5 # comphyd_lab location
19+
20+
# Perdue University Anvil HPC location
21+
/anvil/datasets/meteorological/ERA5_small # Anvil community storage
1622
1723
and the structure of the dataset hourly files is as following:
1824

1925
.. code:: console
2026
21-
/project/rpp-kshook/CompHydCore/climateForcingData/ERA5/ERA5_for_SUMMA/2_merged_data
27+
/path/to/dataset/dir/
2228
├── ERA5_merged_195001.nc
2329
├── ERA5_merged_%y%m.nc
2430
├── .

‎docs/scripts/gwf-ncar-conus_i.rst‎

Lines changed: 3 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -16,9 +16,10 @@ Location of Dataset Files
1616
The ``WRF-CONUSI`` simulation outputs are located under the following
1717
directory accessible from Compute Canada (CC) Graham Cluster:
1818

19-
::
19+
.. code:: console
2020
21-
/project/rpp-kshook/Model_Output/WRF/CONUS/CTRL/
21+
# DRAC Graham HPC location
22+
/project/rpp-kshook/Model_Output/WRF/CONUS/CTRL/ # rpp-kshook location
2223
2324
and the structure of the dataset hourly files is as following:
2425

‎docs/scripts/nasa-nex-gddp-cmip6.rst‎

Lines changed: 9 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -7,11 +7,18 @@ Location of Dataset Files
77
-------------------------
88

99
The ``nex-gddp-cmip6`` dataset is located under the following
10-
directory(s) accessible from Compute Canada (CC) Graham Cluster:
10+
directory(s) accessible from multiple clusters:
1111

1212
.. code:: console
1313
14-
/project/rrg-mclark/data/meteorological-data/nasa-nex-gddp-cmip6/NEX-GDDP-CMIP6 # rrg-mclark allocation
14+
# DRAC Graham HPC location
15+
/project/rpp-kshook/Climate_Forcing_Data/meteorological-data/nasa-nex-gddp-cmip6 # rpp-kshook allocation
16+
17+
# UCalgary ARC HPC location
18+
/work/comphyd_lab/data/meteorological-data/nasa-nex-gddp-cmip6 # comphyd_lab location
19+
20+
# Perdue University Anvil HPC location
21+
/anvil/datasets/meteorological/NASA_NEX-GDDP-CMIP6
1522
1623
and the structure of the dataset’s yearly files (containing daily
1724
time-steps) is as following:

‎docs/scripts/ornl-daymet.rst‎

Lines changed: 10 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -13,18 +13,24 @@ Location of Dataset Files
1313
-------------------------
1414

1515
The global ``Daymet`` dataset is located under the following directory
16-
accessible from Digital Research Alliance of Canada (DRA) Graham
17-
cluster:
16+
accessible from multiple clusters:
1817

1918
.. code::
2019
21-
/project/rpp-kshook/Model_Output/Daymet_Daily_V4R1/data/
20+
# DRAC Graham HPC locations
21+
/project/rpp-kshook/Model_Output/Daymet_Daily_V4R1/data/ # rpp-kshook allocation
22+
23+
# UCalgary ARC HPC locations
24+
/work/comphyd_lab/data/meteorological-data/daymet-v4r1-ornl # comphyd_lab allocation
25+
26+
# Perdue University Anvil HPC locations
27+
/anvil/datasets/meteorological/ORNL_Daymet # community data storage
2228
2329
and the structure of the dataset hourly files is as following:
2430

2531
.. code:: console
2632
27-
/project/rpp-kshook/Model_Output/Daymet_Daily_V4R1/data/
33+
/path/to/dataset/files/
2834
├── daymet_v4_daily_hi_dayl_1980.nc
2935
├── daymet_v4_daily_hi_dayl_1981.nc
3036
├── .

‎docs/scripts/ouranos-espo-g6-r2.rst‎

Lines changed: 52 additions & 58 deletions
Original file line numberDiff line numberDiff line change
@@ -11,14 +11,20 @@ directory accessible from Compute Canada (CC) Graham Cluster:
1111

1212
.. code:: console
1313
14+
# DRAC Graham HPC locations
1415
/project/rpp-kshook/Climate_Forcing_Data/meteorological-data/ouranos-espo-g6-r2 # rpp-kshook allocation
15-
/project/rrg-mclark/data/meteorological-data/ouranos-espo-g6-r2 # rrg-mclark allocation
16+
17+
# UCalgary ARC HPC locations
18+
/work/comphyd_lab/data/meteorological-data/ouranos-espo-g6-r2 #comphyd_lab allocation
19+
20+
# Perdue University Anvil HPC locations
21+
/anvil/datasets/meteorological/Ouranos_ESPO-G6-R2
1622
1723
and the structure of the dataset hourly files is as following:
1824

1925
.. code:: console
2026
21-
/project/rrg-mclark/data/meteorological-data/ouranos-espo-g6-r2
27+
/path/to/dataset/dir/
2228
├── AS-RCEC
2329
│ └── TaiESM1
2430
│ ├── ssp245
@@ -145,7 +151,7 @@ see a list of variables by browsing the dataset files:
145151

146152
.. code:: console
147153
148-
foo@bar:~$ ls /project/rrg-mclark/data/meteorological-data/ouranos-espo-g6-r2/ESPO-G6-R2v1.0.0/AS-RCEC/TaiESM1/ssp245/r1i1p1f1/day
154+
foo@bar:~$ ls /path/to/dataset/dir/ESPO-G6-R2v1.0.0/AS-RCEC/TaiESM1/ssp245/r1i1p1f1/day
149155
150156
Spatial Extent
151157
--------------
@@ -182,61 +188,49 @@ describes the temporal extent for senarios included in this dataset:
182188
List of Ensemble Members
183189
------------------------
184190

185-
+---+---------------------------+---------------------------------------+
186-
| # | Models (keyword for | Ensemble Members (keyword for |
187-
| | ``--model``) | ``--ensemble``) |
188-
+===+===========================+=======================================+
189-
| 1 | ``AS-RCEC`` | ``r1i1p1f1`` |
190-
+---+---------------------------+---------------------------------------+
191-
| 2 | ``BCC`` | ``r1i1p1f1`` |
192-
+---+---------------------------+---------------------------------------+
193-
| 3 | ``CAS`` | ``r1i1p1f1`` |
194-
+---+---------------------------+---------------------------------------+
195-
| 4 | ``CCCma`` | ``r1i1p1f1`` |
196-
+---+---------------------------+---------------------------------------+
197-
| 5 | ``CMCC`` | ``r1i1p1f1`` |
198-
+---+---------------------------+---------------------------------------+
199-
| 6 | ``CNRM-CERFACS`` | ``r1i1p1f2`` |
200-
+---+---------------------------+---------------------------------------+
201-
| 7 | ``CSIRO`` | ``r1i1p1f1`` |
202-
+---+---------------------------+---------------------------------------+
203-
| 8 | ``CSIRO-ARCCSS`` | ``r1i1p1f1`` |
204-
+---+---------------------------+---------------------------------------+
205-
| 9 | ``DKRZ`` | ``r1i1p1f1`` |
206-
+---+---------------------------+---------------------------------------+
207-
| 1 | ``EC-Earth-Consortium`` | ``r1i1p1f1`` |
208-
| 0 | | |
209-
+---+---------------------------+---------------------------------------+
210-
| 1 | ``INM`` | ``r1i1p1f1`` |
211-
| 1 | | |
212-
+---+---------------------------+---------------------------------------+
213-
| 1 | ``IPSL`` | ``r1i1p1f1`` |
214-
| 2 | | |
215-
+---+---------------------------+---------------------------------------+
216-
| 1 | ``MIROC`` | ``r1i1p1f1``, ``r1i1p1f2`` |
217-
| 3 | | |
218-
+---+---------------------------+---------------------------------------+
219-
| 1 | ``MOHC`` | ``r1i1p1f2`` |
220-
| 4 | | |
221-
+---+---------------------------+---------------------------------------+
222-
| 1 | ``MPI-M`` | ``r1i1p1f1`` |
223-
| 5 | | |
224-
+---+---------------------------+---------------------------------------+
225-
| 1 | ``MRI`` | ``r1i1p1f1`` |
226-
| 6 | | |
227-
+---+---------------------------+---------------------------------------+
228-
| 1 | ``NCC`` | ``r1i1p1f1`` |
229-
| 7 | | |
230-
+---+---------------------------+---------------------------------------+
231-
| 1 | ``NIMS-KMA`` | ``r1i1p1f1`` |
232-
| 8 | | |
233-
+---+---------------------------+---------------------------------------+
234-
| 1 | ``NOAA-GFDL`` | ``r1i1p1f1`` |
235-
| 9 | | |
236-
+---+---------------------------+---------------------------------------+
237-
| 2 | ``NUIST`` | ``r1i1p1f1`` |
238-
| 0 | | |
239-
+---+---------------------------+---------------------------------------+
191+
+----+---------------------------+---------------------------------------+
192+
| # | Models (for ``--model``) | Ensemble Members (for ``ensemble``) |
193+
+====+===========================+=======================================+
194+
| 1 | ``AS-RCEC`` | ``r1i1p1f1`` |
195+
+----+---------------------------+---------------------------------------+
196+
| 2 | ``BCC`` | ``r1i1p1f1`` |
197+
+----+---------------------------+---------------------------------------+
198+
| 3 | ``CAS`` | ``r1i1p1f1`` |
199+
+----+---------------------------+---------------------------------------+
200+
| 4 | ``CCCma`` | ``r1i1p1f1`` |
201+
+----+---------------------------+---------------------------------------+
202+
| 5 | ``CMCC`` | ``r1i1p1f1`` |
203+
+----+---------------------------+---------------------------------------+
204+
| 6 | ``CNRM-CERFACS`` | ``r1i1p1f2`` |
205+
+----+---------------------------+---------------------------------------+
206+
| 7 | ``CSIRO`` | ``r1i1p1f1`` |
207+
+----+---------------------------+---------------------------------------+
208+
| 8 | ``CSIRO-ARCCSS`` | ``r1i1p1f1`` |
209+
+----+---------------------------+---------------------------------------+
210+
| 9 | ``DKRZ`` | ``r1i1p1f1`` |
211+
+----+---------------------------+---------------------------------------+
212+
| 10 | ``EC-Earth-Consortium`` | ``r1i1p1f1`` |
213+
+----+---------------------------+---------------------------------------+
214+
| 11 | ``INM`` | ``r1i1p1f1`` |
215+
+----+---------------------------+---------------------------------------+
216+
| 12 | ``IPSL`` | ``r1i1p1f1`` |
217+
+----+---------------------------+---------------------------------------+
218+
| 13 | ``MIROC`` | ``r1i1p1f1``, ``r1i1p1f2`` |
219+
+----+---------------------------+---------------------------------------+
220+
| 14 | ``MOHC`` | ``r1i1p1f2`` |
221+
+----+---------------------------+---------------------------------------+
222+
| 15 | ``MPI-M`` | ``r1i1p1f1`` |
223+
+----+---------------------------+---------------------------------------+
224+
| 16 | ``MRI`` | ``r1i1p1f1`` |
225+
+----+---------------------------+---------------------------------------+
226+
| 17 | ``NCC`` | ``r1i1p1f1`` |
227+
+----+---------------------------+---------------------------------------+
228+
| 18 | ``NIMS-KMA`` | ``r1i1p1f1`` |
229+
+----+---------------------------+---------------------------------------+
230+
| 19 | ``NOAA-GFDL`` | ``r1i1p1f1`` |
231+
+----+---------------------------+---------------------------------------+
232+
| 20 | ``NUIST`` | ``r1i1p1f1`` |
233+
+----+---------------------------+---------------------------------------+
240234

241235
Short Description on ``ESPO-G6-R2 v1.0.0`` Variables
242236
----------------------------------------------------

‎docs/scripts/ouranos-mrcc5-cmip6.rst‎

Lines changed: 30 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -11,14 +11,17 @@ accessible on the following locations:
1111

1212
.. code:: console
1313
14-
/project/rrg-mclark/data/meteorological-data/ouranos-mrcc5-cmip6 # rrg-mclark allocation with DRAC Graham
14+
# DRAC Graham HPC locations
15+
# only CanESM5 and MPI-ESM1-2-LR models
1516
/project/def-alpie-ab/data/meteorological-data/ouranos-mrcc5-cmip6 # def-alpie-ab allocation with DRAC Graham
17+
# only CNRM-ESM2-1 model
18+
/project/rpp-kshook/Climate_Forcing_Data/meteorological-data/ouranos-mrcc5-cmip6 # rpp-kshook allocation with DRAC Graham
1619
1720
and the structure of the dataset hourly files is as following:
1821

1922
.. code:: console
2023
21-
/project/rrg-mclark/data/meteorological-data/ouranos-espo-g6-r2
24+
/path/to/dataset/directory/
2225
├── MPI-ESM1-2-LR
2326
│ ├── ssp126
2427
| | └── r1i1p1f1
@@ -134,8 +137,8 @@ list of variables by browsing the dataset’s directory:
134137

135138
.. code:: console
136139
137-
foo@bar:~$ ls /path/to/NEX-GDDP-CMIP6/ACCESS-CM2/ssp126/r1i1p1f1/
138-
hurs huss pr rlds rsds vas uas tas ps
140+
foo@bar:~$ ls /path/to/dataset/dir/CanESM5/ssp126/r1i1p2f1/CRCM5/v1-r1/1hr/
141+
hurs huss pr ps rlds rsds tas uas vas
139142
140143
Spatial Extent
141144
--------------
@@ -179,6 +182,29 @@ describes the temporal extent for senarios included in this dataset:
179182
``--start-date`` and ``--end-date`` options with the main
180183
``datatool`` script.
181184

185+
.. note::
186+
``CanESM5`` model reports all variables at the beginning of
187+
the hour ``(YYYY-mm-ddTHH:00:00)``.
188+
189+
.. note::
190+
``MPI-ESM1-2-LR`` and ``CNRM-ESM2-1`` report ``pr``, ``rlds``,
191+
``rsds`` at the middle of the hour (YYYY-mm-ddTHH:30:00), while
192+
all other variables are reported at the top of the hour.
193+
194+
195+
Calendar
196+
--------
197+
+--------------------------+-------------------+
198+
| Model | Calendar Type |
199+
+==========================+===================+
200+
| ``MPI-ESM1-2-LR`` | standard |
201+
+--------------------------+-------------------+
202+
| ``CNRM-ESM2-1`` | standard |
203+
+--------------------------+-------------------+
204+
| ``CanESM5`` | 365_day |
205+
+--------------------------+-------------------+
206+
207+
182208
Short Description on ``MRCC5-CMIP6`` Variables
183209
----------------------------------------------
184210

0 commit comments

Comments
 (0)