The common Module

Common options for data manipulation

class DBConnectionConfig(subclass, doc)

Configuration class for connection to a database

Creates a new object

Parameters:

• subclass – A concrete class containing configuration information Configuration options must be defined as class memebers with names, starting with one ‘_’ characters and values be instances of :class Argument:

• description – Optional text to use as description. If not specified, then it is extracted from subclass documentation

autocommit

Use autocommit

db

Path to a database connection parameters file

connection

Section in the database connection parameters file

location

URI or path to file(s) or directory containing data (e.g., in Parquet format). Wildcards are supported

verbose

Generate verbose output

dryrun

Dry run: do no database modifications

class DBTableConfig(subclass, doc)

Creates a new object

Parameters:

• subclass – A concrete class containing configuration information Configuration options must be defined as class memebers with names, starting with one ‘_’ characters and values be instances of :class Argument:

• description – Optional text to use as description. If not specified, then it is extracted from subclass documentation

table

Name of the table to manipulate

class CommonConfig(subclass, doc)

Abstract base class for configurators used for data loading

Creates a new object

Parameters:

• subclass – A concrete class containing configuration information Configuration options must be defined as class memebers with names, starting with one ‘_’ characters and values be instances of :class Argument:

• description – Optional text to use as description. If not specified, then it is extracted from subclass documentation

domain

Name of the domain

registry

Path to domain registry. Registry is a directory or an archive containing YAML files with domain definition. Default is to use the built-in registry