Dorieh Data Platform
Contents
Introduction
What is Data Platform
Data Domains
Data Processing Pipelines
Python Packages
Data Modelling for Dorieh Data Platform
Extensions used for creating federated view of different years
The Data Dictionary Generation tool
Medicare: Building a Data Warehouse from ResDac Files
Data dictionary and lineage for Medicare processing
Table Lineage Diagram
Table Lineage SVG Diagram
Table cms.mbsf_ab_2011
Table cms.mbsf_ab_2012
Table cms.mbsf_ab_2013
Table cms.mbsf_ab_2014
Table cms.mbsf_abcd_2015
Table cms.mbsf_abcd_2016
Table cms.mbsf_abcd_2017
Table cms.mbsf_abcd_2018
Table cms.mbsf_d_2011
Table cms.mbsf_d_2012
Table cms.mbsf_d_2013
Table cms.mbsf_d_2014
Table cms.medpar_2011
Table cms.medpar_2012
Table cms.medpar_2013
Table cms.medpar_2014
Table cms.medpar_2015
Table cms.medpar_2016
Table cms.medpar_2017
Table cms.medpar_2018
View medicare._beneficiaries
View medicare._enrollments
Materialized view medicare._ps
Table medicare.admissions
Table medicare.beneficiaries
Table medicare.enrollments
View medicare.ip
Materialized view medicare.mbsf_d
View medicare.ps
View medicare.qc_adm_union
Materialized view medicare.qc_admissions
View medicare.qc_enrl_bene
Materialized view medicare.qc_enrollments
Alphabetic list of all tables
Alphabetic list of all columns in all tables
The Data Dictionary Generation tool
Medicaid: Building a Data Warehouse from ResDac Files
Introduction to data modelling for Dorieh Data Platform
Domain
Table
Column
Multi-column indices
Generation of the database schema (DDL)
Indexing policies
Linking with nomenclature
Ingesting data
Examples
Data Platform Internals
Database Testing Framework
Adding more data
Executing containerized apps
Terms and Acronyms
Indices
Dorieh Data Platform
Data Domains
Dorieh CMS Package (manipulating ResDac Health Data)
Medicare: Building a Data Warehouse from ResDac Files
Data dictionary and lineage for Medicare processing
Table Lineage Diagram
View medicare.qc_enrl_bene
Column medicare.qc_enrl_bene.yob_latest
Column medicare.qc_enrl_bene.yob_latest Lineage SVG
View page source
Column medicare.qc_enrl_bene.yob_latest Lineage SVG
medicare.qc_enrl_bene.yob_latest
medicare.qc_enrl_bene.yob_latest
CASE WHEN MAX(yob) <> MIN(yob) THEN MAX(yob)END
medicare.beneficiaries.yob
medicare.beneficiaries.yob
MIN(yob)
medicare.beneficiaries.yob->medicare.qc_enrl_bene.yob_latest
join natural
medicare._beneficiaries.yob
medicare._beneficiaries.yob
MIN(yob)
medicare._beneficiaries.yob->medicare.beneficiaries.yob
Copied
medicare._ps.yob
medicare._ps.yob
CASE WHEN age is not NULL THEN (year - age) ELSE NULL END as yob
medicare._ps.yob->medicare._beneficiaries.yob
Aggregated On bene_id
medicare.ps.age
medicare.ps.age
Age on January 1 of a given year, if
provided
medicare.ps.age->medicare._ps.yob
Transformed
medicare.ps.age_parent
8 incoming links (columns)
medicare.ps.age_parent->medicare.ps.age