-
Notifications
You must be signed in to change notification settings - Fork 3
Description
I'd like to ask that we implement an option - which should become the new default - where the monthly means get calculated directly on the "archived" data as opposed to having a fetch step in advance of the calculation that pulls the data out onto another disc and then perform the calculation.
The present implementation, with the fetch step, was motivated during a time when the archive was a separate entity, when local disc within the archive was limited (after data was brought from tape down to disc), and mpi programs were not supposed to run off of the deporary holding disc. So the data had to be physically copied to a no-backup area so the calculation could take place.
Presently, with the old archiving system gone, all disc is local, so we should be able to do the calculation without having to copy the data anywhere else.
This issue request this no-fecth option to be implemented, as an option, that is, preserving still the currently ability to fetch the data and place the data in an alternative disc. The reason why I ask for us to preserve the present fetch ability is that I don't know how things will work when/if we do things on the cloud.
The no-fetch capability will also spare user space, avoiding temporary duplication of data.