Skip to content

era5_rechunking: add script to rechunk and concatenate ERA5 forcing files#131

Open
ezhilsabareesh8 wants to merge 3 commits into
mainfrom
era5-rechunking
Open

era5_rechunking: add script to rechunk and concatenate ERA5 forcing files#131
ezhilsabareesh8 wants to merge 3 commits into
mainfrom
era5-rechunking

Conversation

@ezhilsabareesh8

Copy link
Copy Markdown
Contributor

Adds era5_rechunking/ with a Python script and PBS script to rechunk ERA5 single-level monthly files from the rt52 archive into yearly files optimised for ACCESS-OM3 / DATM.

Related issue ACCESS-NRI/access-om3-configs#1381

What it does:

  • Reads directly from /g/data/rt52/era5/single-levels/reanalysis/{stream}/{year}/
  • Rechunks from [93, 91, 180] (ERA5 default) → [1, 721, 1440] (one full-resolution timestep per chunk)
  • Concatenates 12 monthly files into one yearly file per stream
  • Preserves raw int16 values bit-for-bit (no unpack/repack)
  • Covers all 13 ERA5 streams, 1940–2026

Test output is here /g/data/tm70/ek4684/era5_rechunk_test/

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant