Dorieh Data Platform
Contents
Introduction
What is Data Platform
Data Domains
Health
Handling Medicaid data
Medicare Files Handling
Data dictionary and lineage for Medicare processing
Table Lineage Diagram
Alphabetic list of all tables
Alphabetic list of all columns in all tables
The Data Dictionary Generation tool
Querying Medicaid Data
Overview of health data (Medicare and Medicaid)
Project Structure
Documentation Indices
Climate
Exposure (from Atmospheric Composition Analysis Group of Washington University in St. Louis)
Environmental Protection Agency (EPA) data
Demographics
Data Processing Pipelines
Python Packages
Data Modelling for Dorieh Data Platform
Examples
Data Platform Internals
Database Testing Framework
Adding more data
Executing containerized apps
Terms and Acronyms
Indices
Dorieh Data Platform
Data Domains
Dorieh CMS Package (manipulating with Health Data)
Medicare Files Handling
Data dictionary and lineage for Medicare processing
Table Lineage Diagram
Table medicare.enrollments
Column medicare.enrollments.residence_counties
Column medicare.enrollments.residence_counties Lineage SVG
View page source
Column medicare.enrollments.residence_counties Lineage SVG
medicare.enrollments.residence_counties
medicare.enrollments.residence_counties
string_agg(distinct fips3_list, ',')
medicare._enrollments.residence_counties
medicare._enrollments.residence_counties
string_agg(distinct fips3_list, ',')
medicare._enrollments.residence_counties->medicare.enrollments.residence_counties
Copied
medicare._ps.fips3_list
medicare._ps.fips3_list
CASE WHEN year > 2010 THEN (SELECT string_agg(distinct fips3::varchar, ',') from public.ssa as s where ps.ssa3 = s.ssa3 and ps.year = s.year and ps.fips2 = s.fips2) ELSE (SELECT string_agg(distinct fips3::varchar, ',') from public.ssa as s where ps.ssa3 = s.ssa3 and 2003 = s.year and ps.fips2 = s.fips2) END AS fips3_list
medicare._ps.fips3_list->medicare._enrollments.residence_counties
Aggregated On bene_id, year, state
medicare.ps.ssa3
medicare.ps.ssa3
Social Security Administration (SSA)
three digit code for county
medicare.ps.ssa3->medicare._ps.fips3_list
Transformed
medicare.ps.ssa3_parent
8 incoming links (columns)
medicare.ps.ssa3_parent->medicare.ps.ssa3
medicare.ps.fips2
medicare.ps.fips2
2 digit state FIPS, see https://en.wikip
edia.org/wiki/Federal_Information_Proces
sing_Standard_state_code
(SELECT fips2 FROM public.us_states as s WHERE s.ssa2 = "state")
medicare.ps.fips2->medicare._ps.fips3_list
Transformed
medicare.ps.year
medicare.ps.year
(CASE WHEN "year"::int < 20 THEN (2000 + "year"::int) WHEN (20 < "year"::int AND "year"::int < 100) THEN (1900 + "year"::int) WHEN "year" IS NULL THEN 2000 ELSE "year"::int END)
medicare.ps.year->medicare._ps.fips3_list
Transformed
medicare.ps.year_parent
8 incoming links (columns)
medicare.ps.year_parent->medicare.ps.year