Skip to content

Month Means: No need to fetch #382

@rtodling

Description

@rtodling

I'd like to ask that we implement an option - which should become the new default - where the monthly means get calculated directly on the "archived" data as opposed to having a fetch step in advance of the calculation that pulls the data out onto another disc and then perform the calculation.

The present implementation, with the fetch step, was motivated during a time when the archive was a separate entity, when local disc within the archive was limited (after data was brought from tape down to disc), and mpi programs were not supposed to run off of the deporary holding disc. So the data had to be physically copied to a no-backup area so the calculation could take place.

Presently, with the old archiving system gone, all disc is local, so we should be able to do the calculation without having to copy the data anywhere else.

This issue request this no-fecth option to be implemented, as an option, that is, preserving still the currently ability to fetch the data and place the data in an alternative disc. The reason why I ask for us to preserve the present fetch ability is that I don't know how things will work when/if we do things on the cloud.

The no-fetch capability will also spare user space, avoiding temporary duplication of data.

Sub-issues

Metadata

Metadata

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions