Dorieh Data Platform
Contents
Introduction
What is Data Platform
Data Domains
Data Processing Pipelines
Python Packages
Data Modelling for Dorieh Data Platform
Examples
Data Platform Internals
Database Testing Framework
Adding more data
Executing containerized apps
Terms and Acronyms
Indices
Dorieh Data Platform
The tables Module
View page source
The tables Module
Module to create list of tables from the Domain Data Model
class
Table
(
schema
:
str
,
name
:
str
,
domain
:
Domain
,
domain_dict
)
[source]
add_master_columns
(
)
[source]
add_column_from_master
(
c
:
str
)
[source]
add_column_from_sql
(
identifier
:
Identifier
)
[source]
get_source_columns
(
identifier
:
Identifier
)
→
Set
[
str
]
[source]
get_aggregation
(
schema
:
str
,
name
:
str
,
create_block
:
dict
)
[source]
is_downstream
(
predecessor
:
str
)
[source]
add_predecessors_for_column
(
c
:
str
,
lst
:
List
)
[source]
get_predecessors
(
)
→
List
[source]
get_predecessors_for_column
(
column
:
str
)
→
List
[source]
get_column_links
(
column
:
Column
)
→
List
[source]
calculate_column_lineage
(
column
:
Column
,
graph
:
Graph
,
recursion
)
[source]
column_lineage_to_dot
(
column_name
:
str
,
out
)
[source]
describe_column_type
(
column
:
Column
)
[source]
describe
(
format
:
str
=
'html'
,
basedir
:
str
=
''
)
→
str
[source]
describe_html
(
basedir
:
str
=
''
)
→
str
[source]
columns_toctree
(
)
→
str
[source]
describe_markdown
(
basedir
:
str
=
''
)
→
str
[source]
link_to_table
(
name
:
str
,
format
:
str
=
'html'
)
→
str
[source]
link_to_column
(
name
:
str
,
basedir
:
str
,
format
:
str
=
'html'
)
→
str
[source]
html
(
of
:
str
,
svg
=
None
)
[source]
markdown
(
of
:
str
,
svg
=
None
)
[source]
class
Aggregation
(
schema
:
str
,
name
:
str
,
parent
:
str
,
columns
:
List
,
domain_dict
)
[source]
class
Union
(
schema
:
str
,
tables
:
List
[
str
]
,
domain_dict
)
[source]
class
Join
(
schema
:
str
,
s
:
str
,
domain_dict
)
[source]
class
Relation
(
reltype
:
str
,
x
:
Table
,
y
:
Table
,
data
=
None
)
[source]
label
(
)
[source]
as_edge_attr
(
)
→
Dict
[source]
class
ColumnLink
(
r
:
Relation
,
x
:
Column
,
y
:
Column
)
[source]
to_dot
(
)
[source]
class
GenericLink
(
node1
,
node2
,
width
=
5.0
)
[source]
to_dot
(
)
[source]