The launcher Module

Executing pipelines through this class requires a collection of shape files corresponding to geographies for which data is aggregated (for example, zip code areas or counties).

The data has to be placed in the following directory structure: ${year}/${geo_type: zip|county|etc.}/${shape:point|polygon}/

Which geography is used is defined by geography argument that defaults to “zip”. Only actually used geographies must have their shape files for the years actually used.

Output file format: At the moment output is a simple 3+ columns file (most files contain 3 columns, but parameter “metadata” can define more columns to include):

  1. Variable (aka band) mean value. The actual band is given in the arguments (or configuration object) and is printed in the header line of the file

  2. Date in YYYY-mm-dd format (SQL date format)

  3. Label, associated with location. E.g., zip code for zip shapes, county fips for county shapes or custom label for point file. For points file, the label is taken from the first column defined by “metadata” argument.

4+. If more than one column is included in metadata, the output file

will contain more than 3 columns

class Gridmet(context: Optional[GridMETContext] = None)[source]

Main class, describes the whole download and processing job for climate data

The pipeline consists of the collection of Task Objects

Creates a new instance

Parameters:

context – An optional GridMETContext object, if not specified, then it is constructed from the command line arguments

collect_tasks() List[source]
execute_sequentially()[source]

Executes all tasks in the pipeline sequentially without any parallelization :return: None

log_perf()[source]
main()[source]