I'm trying to convert and process GrADS (grib) files into netcdf files. The files have values every 3 hours (2890 per year), 12 z levels, 120 variables, 241 columns and 236 rows. The data is almost 80 gb per year and I have to process a total of 50 years.
Before converting into netcdf I'm trying to calculate daily averages and sums for a subset of the variables. So far I've tried with GrADS but I still haven't been able to make the script to work. Going through the GrADS users forum to find some examples of a similar task I got the feeling that GrADS is not as commonly used as it used to be years ago so I'm curious about what people currently use when they have to deal with data as large as these (I come from a GIS background, so I'm not used to data as big).
First hand I'll say that I won't be able to use R or Python due to RAM limitation, the relational database option is also an issue due to not being able to find a tool to import from grib to SQL tables. What other options I have for such a "simple" task?