Dorieh Data Platform
Contents
Introduction
What is Data Platform
Data Domains
Data Processing Pipelines
Python Packages
Data Modelling for Dorieh Data Platform
Extensions used for creating federated view of different years
The Data Dictionary Generation tool
Medicare: Building a Data Warehouse from ResDac Files
Data dictionary and lineage for Medicare processing
Table Lineage Diagram
Table Lineage SVG Diagram
Table cms.mbsf_ab_2011
Table cms.mbsf_ab_2012
Table cms.mbsf_ab_2013
Table cms.mbsf_ab_2014
Table cms.mbsf_abcd_2015
Table cms.mbsf_abcd_2016
Table cms.mbsf_abcd_2017
Table cms.mbsf_abcd_2018
Table cms.mbsf_d_2011
Table cms.mbsf_d_2012
Table cms.mbsf_d_2013
Table cms.mbsf_d_2014
Table cms.medpar_2011
Table cms.medpar_2012
Table cms.medpar_2013
Table cms.medpar_2014
Table cms.medpar_2015
Table cms.medpar_2016
Table cms.medpar_2017
Table cms.medpar_2018
View medicare._beneficiaries
View medicare._enrollments
Materialized view medicare._ps
Table medicare.admissions
Table medicare.beneficiaries
Table medicare.enrollments
View medicare.ip
Materialized view medicare.mbsf_d
View medicare.ps
View medicare.qc_adm_union
Materialized view medicare.qc_admissions
View medicare.qc_enrl_bene
Materialized view medicare.qc_enrollments
Alphabetic list of all tables
Alphabetic list of all columns in all tables
The Data Dictionary Generation tool
Medicaid: Building a Data Warehouse from ResDac Files
Introduction to data modelling for Dorieh Data Platform
Domain
Table
Column
Multi-column indices
Generation of the database schema (DDL)
Indexing policies
Linking with nomenclature
Ingesting data
Examples
Data Platform Internals
Database Testing Framework
Adding more data
Executing containerized apps
Terms and Acronyms
Indices
Dorieh Data Platform
Data Domains
Dorieh CMS Package (manipulating ResDac Health Data)
Medicare: Building a Data Warehouse from ResDac Files
Data dictionary and lineage for Medicare processing
Table Lineage Diagram
Table medicare.admissions
Column medicare.admissions.diagnoses
Column medicare.admissions.diagnoses Lineage SVG
View page source
Column medicare.admissions.diagnoses Lineage SVG
medicare.admissions.diagnoses
medicare.admissions.diagnoses
array_remove(ARRAY[btrim(btrim(diag1)),btrim(diag2),btrim(diag3),btrim(diag4),btrim(diag5),btrim(diag6),btrim(diag7),btrim(diag8),btrim(diag9),btrim(diag10),btrim(diag11),btrim(diag12),btrim(diag13),btrim(diag14),btrim(diag15),btrim(diag16),btrim(diag17),btrim(diag18),btrim(diag19),btrim(diag20),btrim(diag21),btrim(diag22),btrim(diag23),btrim(diag24),btrim(diag25)], NULL) As diagnoses
medicare.ip.diag8_parent
8 incoming links (columns)
medicare.ip.diag8
medicare.ip.diag8
medicare.ip.diag8_parent->medicare.ip.diag8
medicare.ip.diag4_parent
8 incoming links (columns)
medicare.ip.diag4
medicare.ip.diag4
medicare.ip.diag4_parent->medicare.ip.diag4
medicare.ip.diag25_parent
8 incoming links (columns)
medicare.ip.diag25
medicare.ip.diag25
medicare.ip.diag25_parent->medicare.ip.diag25
medicare.ip.diag17_parent
8 incoming links (columns)
medicare.ip.diag17
medicare.ip.diag17
medicare.ip.diag17_parent->medicare.ip.diag17
medicare.ip.diag10_parent
8 incoming links (columns)
medicare.ip.diag10
medicare.ip.diag10
medicare.ip.diag10_parent->medicare.ip.diag10
medicare.ip.diag12_parent
8 incoming links (columns)
medicare.ip.diag12
medicare.ip.diag12
medicare.ip.diag12_parent->medicare.ip.diag12
medicare.ip.diag5_parent
8 incoming links (columns)
medicare.ip.diag5
medicare.ip.diag5
medicare.ip.diag5_parent->medicare.ip.diag5
medicare.ip.diag20_parent
8 incoming links (columns)
medicare.ip.diag20
medicare.ip.diag20
medicare.ip.diag20_parent->medicare.ip.diag20
medicare.ip.diag18_parent
8 incoming links (columns)
medicare.ip.diag18
medicare.ip.diag18
medicare.ip.diag18_parent->medicare.ip.diag18
medicare.ip.diag23_parent
8 incoming links (columns)
medicare.ip.diag23
medicare.ip.diag23
medicare.ip.diag23_parent->medicare.ip.diag23
medicare.ip.diag14_parent
8 incoming links (columns)
medicare.ip.diag14
medicare.ip.diag14
medicare.ip.diag14_parent->medicare.ip.diag14
medicare.ip.diag1_parent
8 incoming links (columns)
medicare.ip.diag1
medicare.ip.diag1
medicare.ip.diag1_parent->medicare.ip.diag1
medicare.ip.diag16_parent
8 incoming links (columns)
medicare.ip.diag16
medicare.ip.diag16
medicare.ip.diag16_parent->medicare.ip.diag16
medicare.ip.diag7_parent
8 incoming links (columns)
medicare.ip.diag7
medicare.ip.diag7
medicare.ip.diag7_parent->medicare.ip.diag7
medicare.ip.diag6_parent
8 incoming links (columns)
medicare.ip.diag6
medicare.ip.diag6
medicare.ip.diag6_parent->medicare.ip.diag6
medicare.ip.diag9_parent
8 incoming links (columns)
medicare.ip.diag9
medicare.ip.diag9
medicare.ip.diag9_parent->medicare.ip.diag9
medicare.ip.diag22_parent
8 incoming links (columns)
medicare.ip.diag22
medicare.ip.diag22
medicare.ip.diag22_parent->medicare.ip.diag22
medicare.ip.diag15_parent
8 incoming links (columns)
medicare.ip.diag15
medicare.ip.diag15
medicare.ip.diag15_parent->medicare.ip.diag15
medicare.ip.diag3_parent
8 incoming links (columns)
medicare.ip.diag3
medicare.ip.diag3
medicare.ip.diag3_parent->medicare.ip.diag3
medicare.ip.diag13_parent
8 incoming links (columns)
medicare.ip.diag13
medicare.ip.diag13
medicare.ip.diag13_parent->medicare.ip.diag13
medicare.ip.diag19_parent
8 incoming links (columns)
medicare.ip.diag19
medicare.ip.diag19
medicare.ip.diag19_parent->medicare.ip.diag19
medicare.ip.diag2_parent
8 incoming links (columns)
medicare.ip.diag2
medicare.ip.diag2
medicare.ip.diag2_parent->medicare.ip.diag2
medicare.ip.diag11_parent
8 incoming links (columns)
medicare.ip.diag11
medicare.ip.diag11
medicare.ip.diag11_parent->medicare.ip.diag11
medicare.ip.diag21_parent
8 incoming links (columns)
medicare.ip.diag21
medicare.ip.diag21
medicare.ip.diag21_parent->medicare.ip.diag21
medicare.ip.diag24_parent
8 incoming links (columns)
medicare.ip.diag24
medicare.ip.diag24
medicare.ip.diag24_parent->medicare.ip.diag24
medicare.ip.diag8->medicare.admissions.diagnoses
Transformed
medicare.ip.diag4->medicare.admissions.diagnoses
Transformed
medicare.ip.diag25->medicare.admissions.diagnoses
Transformed
medicare.ip.diag17->medicare.admissions.diagnoses
Transformed
medicare.ip.diag10->medicare.admissions.diagnoses
Transformed
medicare.ip.diag12->medicare.admissions.diagnoses
Transformed
medicare.ip.diag5->medicare.admissions.diagnoses
Transformed
medicare.ip.diag20->medicare.admissions.diagnoses
Transformed
medicare.ip.diag18->medicare.admissions.diagnoses
Transformed
medicare.ip.diag23->medicare.admissions.diagnoses
Transformed
medicare.ip.diag14->medicare.admissions.diagnoses
Transformed
medicare.ip.diag1->medicare.admissions.diagnoses
Transformed
medicare.ip.diag16->medicare.admissions.diagnoses
Transformed
medicare.ip.diag7->medicare.admissions.diagnoses
Transformed
medicare.ip.diag6->medicare.admissions.diagnoses
Transformed
medicare.ip.diag9->medicare.admissions.diagnoses
Transformed
medicare.ip.diag22->medicare.admissions.diagnoses
Transformed
medicare.ip.diag15->medicare.admissions.diagnoses
Transformed
medicare.ip.diag3->medicare.admissions.diagnoses
Transformed
medicare.ip.diag13->medicare.admissions.diagnoses
Transformed
medicare.ip.diag19->medicare.admissions.diagnoses
Transformed
medicare.ip.diag2->medicare.admissions.diagnoses
Transformed
medicare.ip.diag11->medicare.admissions.diagnoses
Transformed
medicare.ip.diag21->medicare.admissions.diagnoses
Transformed
medicare.ip.diag24->medicare.admissions.diagnoses
Transformed