Storage#

The Storage configuration lets you configure via fsspec where pangeo-forge-runner puts intermediate & final data products.

TargetStorage#

class pangeo_forge_runner.storage.TargetStorage(**kwargs: Any)#

Storage configuration for where the baked data should be stored

fsspec_args c.TargetStorage.fsspec_args = Dict()#: Args to pass to fsspec_class during instantiation

fsspec_class c.TargetStorage.fsspec_class = Type(<class 'fsspec.spec.AbstractFileSystem'>)#: FSSpec Filesystem to instantiate as class for this target

root_path c.TargetStorage.root_path = Unicode('')#

Root path under which to put all our storage.

If {job_name} is present in the root_path, it will be expanded to the unique job_name of the current job.

class pangeo_forge_runner.storage.InputCacheStorage(**kwargs: Any)#

Storage configuration for caching input files during recipe baking

fsspec_args c.InputCacheStorage.fsspec_args = Dict()#: Args to pass to fsspec_class during instantiation

fsspec_class c.InputCacheStorage.fsspec_class = Type(<class 'fsspec.spec.AbstractFileSystem'>)#: FSSpec Filesystem to instantiate as class for this target

root_path c.InputCacheStorage.root_path = Unicode('')#

Root path under which to put all our storage.

If {job_name} is present in the root_path, it will be expanded to the unique job_name of the current job.