Recent Changes

Sunday, June 17

  1. page ERA5 edited ... Currently data is available from 2008 to present. ERA5 comprises different data stream, we ha…
    ...
    Currently data is available from 2008 to present.
    ERA5 comprises different data stream, we have only a small subset of the surface operative analysis. For the moment we are not considering downloading model or pressure level data as the size of these are quite big and we wouldn't be able to provide enough data to use them to run a model.
    ...
    the ECMWF websitewebsite.
    If you need other variables for your current research then you can contact us at climate_help@nci.org.au
    NB this is a temporary fix so we will download only variables which are useful for a variety of projects and that are needed now, if you can use ERA-Interim instead or you will be using ERA5 in the future but not in the next few months, then we won't consider your request.
    Known Issues
    Known issues from ECMWF website

    License
    ERA5 data is open access and free to download for all uses, including commercial use.
    ...
    MSL/psl -analysis mean sea level pressure
    TP/ forecast total precipitation
    Note on forecast
    Forecast
    forecasts
    Forecasts
    are accumulated
    The accumulations are over the hour ending at the forecast step which is a different behaviour from era interim.
    The 0 step is always zero because it would be the accumulation from timestep and timestep +0 hours (I.e. 06.00 to 06.00)
    (view changes)
    9:10 pm
  2. page ERA5 edited ... filename: <var>_1hr_reanalysis_IFS-Cy41r2_<stream>_<from-date>_<to-date…
    ...
    filename:
    <var>_1hr_reanalysis_IFS-Cy41r2_<stream>_<from-date>_<to-date>.nc
    For example:
    psl_1hr_reanalysis_IFS-Cy41r2_an-sfc_20121201_20121231.nc
    This is temporary and both filenames and directory structure might chnage in the near future, including attributes in the files.
    ...
    MSL/psl -analysis mean sea level pressure
    TP/ forecast total precipitation
    Note on forecast
    Forecast are accumulated values defined at 20 steps (0-19) starting from times 06.00 and 18.00.
    The accumulations are over the hour ending at the forecast step which is a different behaviour from era interim.
    The 0 step is always zero because it would be the accumulation from timestep and timestep +0 hours (I.e. 06.00 to 06.00)
    The others would be for example for precipitation:
    Time 06.00 Step 1: forecast of accumulated precipitation between 06.00-07.00
    Time 06.00 Step 19: forecast of accumulated precipitation between 06.00-01.00+1 day

    (view changes)
    8:24 pm
  3. page ERA5 edited work in progress!!! ERA5 is a climate reanalysis dataset, covering the period 1950 to present. ER…
    work in progress!!!ERA5 is a climate reanalysis dataset, covering the period 1950 to present. ERA5 is being developed through the Copernicus Climate Change Service (C3S).
    Data processing for ERA5 is carried out by ECMWF, using ECMWFS' Earth System model IFS, cycle 41r2. The name ERA refers to 'ECMWF ReAnalysis', with ERA5 being the fifth major global reanalysis produced by ECMWF (after FGGE, ERA-15, ERA-40, ERA-Interim). The next reanalysis, ERA6, is planned for around 2020.

    We are providing a small subset of ERA5 while waiting for a longer term solution to store and manage this big dataset.
    Currently data is available from 2008 to present.
    ERA5 comprises different data stream, we have only a small subset of the surface operative analysis. For the moment we are not considering downloading model or pressure level data as the size of these are quite big and we wouldn't be able to provide enough data to use them to run a model.
    ...
    ERA5 data organization refer to
    ...
    ECMWF website
    If you need other variables for your current research then you can contact us at climate_help@nci.org.au
    NB this is a temporary fix so we will download only variables which are useful for a variety of projects and that are needed now, if you can use ERA-Interim instead or you will be using ERA5 in the future but not in the next few months, then we won't consider your request.
    License
    ERA5 data is open access and free to download for all uses, including commercial use.
    As for ERAI and other ECMWF datasets, though, you need to have an account with ECMWF and accept their terms and conditions, in this particular case ERA5 is covered by the Copernicus license

    ERA5 on raijin
    ...
    These are both the maximum allowedspatial and temporal resolutions possible for this
    The grib files are in
    /g/data/ub4/era5/grib/<level>/<variable>/<yr>/<files>/g/data/ub4/era5/grib/<stream>/<variable>/<yr>/<files>
    where <level><stream> currently is
    oper_an_sfc --> operative analysis surface
    oper_fc_sfc --> operative forecast surface
    filename:
    <var>_era5_<stream>_03x03_90N0E90S35970E_<from-date>_<to-date>
    For example:
    10U_era5_oper_an_sfc_03x03_90N0E90S35970E_20080101_20080131

    Files are then converted to netcdf applying CF convention and partly CMOR conventions to allowed for this to be more easily used with a variety of software.
    Currently the netcdf are in
    /g/data/ub4/era5/netcdf/1hr/<realm>/<stream>/v01/<cmip-variable>/<files>
    filename:
    <var>_1hr_reanalysis_IFS-Cy41r2_<stream>_<from-date>_<to-date>.nc
    For example:
    psl_1hr_reanalysis_IFS-Cy41r2_an-sfc_20121201_20121231.nc
    This is temporary and both filenames and directory structure might chnage in the near future, including attributes in the files.

    Variable list with ECMWF/CMIP names (where available) i.e. grib/netcdf names
    10U /uas - analysis 10 m wind eastward component
    (view changes)
    8:04 pm
  4. page ERA5 edited work in progress!!! We are providing a small subset of ERA5 while waiting for a longer term solut…
    work in progress!!!
    We are providing a small subset of ERA5 while waiting for a longer term solution to store and manage this big dataset.
    Currently data is available from 2008 to present.
    ERA5 comprises different data stream, we have only a small subset of the surface operative analysis. For the moment we are not considering downloading model or pressure level data as the size of these are quite big and we wouldn't be able to provide enough data to use them to run a model.
    For more information on ERA5 data organization refer to the ECMWF website
    ERA5 on raijin
    Data is downloaded as grib on a regular 0.3x0.3 longitude/latitude grid at 1 hr resolution. These are both the maximum allowed resolutions for this dataset.
    The grib files are in
    /g/data/ub4/era5/grib/<level>/<variable>/<yr>/<files>
    where <level> currently is
    oper_an_sfc --> operative analysis surface
    oper_fc_sfc --> operative forecast surface
    Files are then converted to netcdf applying CF convention and partly CMOR conventions to allowed for this to be more easily used with a variety of software.
    Variable list with ECMWF/CMIP names (where available) i.e. grib/netcdf names
    10U /uas - analysis 10 m wind eastward component
    10V /vas - analysis 10 m wind northward component
    MSL/psl -analysis mean sea level pressure
    TP/ forecast total precipitation

    (view changes)
    5:23 pm
  5. 5:11 pm
  6. page Data edited ... CMIP5 - Coupled Model Intercomparison Project Phase 5 data on raijin ERA INTERIM - ECMWF re-a…
    ...
    CMIP5 - Coupled Model Intercomparison Project Phase 5 data on raijin
    ERA INTERIM - ECMWF re-analysis on raijin
    ERA5 - ECMWF re-analysis
    YOTC - ECMWF re-analysis on raijin
    CABLE datasets collection (in collaboration with the CABLE users group)
    (view changes)
    4:59 pm

Thursday, June 7

  1. page GHCN edited Global Historical Climatology Network ... from GHCN. GHCN-Daily is an integrated database …

    Global Historical Climatology Network
    ...
    from GHCN.
    GHCN-Daily is an integrated database of daily climate summaries from land surface stations across the globe. It is comprised of daily climate records from numerous sources that have been integrated and subjected to a common suite of quality assurance reviews and contains records from over 100,000 stations in 180 countries and territories.
    This is an extract of the dataset description from the NOAA website where you can find more information on this data.
    We replicated only the precipitation daily station data organised "by_year". More details on how the data is organised and its status are available from the documentation files stored with the data.
    For more information on methods and data quality assurance: https://www.ncdc.noaa.gov/ghcn-daily-methods
    License
    Data is freely available but there are restrictions on commercial use, from their data access policy:
    Some of the data provided here are based on data exchanged under the World Meteorological Organization (WMO) World Weather Watch Program according to WMO Resolution 40 (Cg-XII)(link is external). This allows WMO member countries to place restrictions on the use or re-export of their data for commercial purposes outside of the receiving country. Those country's data summaries and products which are available here are intended for free and unrestricted use in research, education, and other non-commercial activities. For non-U.S. locations, the data or any derived product shall not be provided to other users or be used for their re-export for commercial services.
    For references: https://www.ncdc.noaa.gov/ghcn-daily-references
    GHCN on raijin
    GHCN is available on raijin under the ua8 project but is accessible to anyone.
    /g/data/ua8/GHNC/daily/by_year
    The files are ascii format: YYYY.csv
    The files format is described in /g/data/ua8/GHCN/ghcn-daily-by_year-format.rtf

    (view changes)
    5:53 pm
  2. page GSMaP edited Global Satellite Mapping of Precipitation from JAXA GSMaP is a dataset of hourly global rainfa…

    Global Satellite Mapping of Precipitation from JAXA
    GSMaP is a dataset of hourly global rainfall maps, a re-analysis version of the Near-Real-Time product by JAXA Global Rainfall Watch for meteorological and climate studies. Different products are part of GSMaP we copied the Gauge-calibrated Reanalysis product GSMaP_Gauge_RNL v6. Variable is rainfall rate and gauge-calibrated rain rate in mm/h, original units of raw product are mm/hr we converted to standard units kg m^-2 s^-1 in the netcdf version.
    (view changes)
    5:23 pm
  3. page GHCN edited Global Historical Climatology Network We replicated the daily station precipitation data from G…

    Global Historical Climatology Network
    We replicated the daily station precipitation data from GHCN.
    GHCN-Daily is an integrated database of daily climate summaries from land surface stations across the globe. It is comprised of daily climate records from numerous sources that have been integrated and subjected to a common suite of quality assurance reviews and contains records from over 100,000 stations in 180 countries and territories.
    This is an extract of the dataset description from the NOAA website where you can find more information on this data.

    (view changes)
    5:03 pm
  4. page Data edited ... CMORPH - GSMaP - Global Satellite Mapping of Precipitation GHCN - Global Historical Climato…
    ...
    CMORPH -
    GSMaP - Global Satellite Mapping of Precipitation
    GHCN - Global Historical Climatology Network
    Other datasets hosted on raijin
    NCI collections
    (view changes)
    4:57 pm

More