Platform Capabilities

This section collects cross-cutting how-to guides for working with a deployed Dorieh data platform. Unlike the flagship climate tutorial and the Medicare case study, which each walk through building one pipeline end to end, the pages below apply regardless of which data domain you are working with: querying the database, monitoring its activity, and describing user requests for research data.

Capabilities

• How to query the database
• Querying Medicaid Data
• Monitoring database activity
• Approximate distinct counting with HLL
• Handling user requests
• Example user request

What each guide covers:

• How to query the database — sample SQL against the warehouse, including joins across domains.

• Querying Medicaid Data — a discussion of querying health data specifically, with its privacy caveats.

• Monitoring database activity — Dorieh utilities for watching long-running database operations such as indexing.

• Approximate distinct counting with HLL — how the QC tables use HyperLogLog sketches to count distinct beneficiaries cheaply.

• Handling user requests and the example request — describing research data requests declaratively in YAML.

See also

The generated Data Dictionaries — a page for every table and column, with lineage diagrams — are the companion reference for all the querying guides above.

The guides above apply to every data domain Dorieh supports — not only the flagship climate and Medicare examples but also exposure data, EPA data and census demographics; see the Data Domains page for the full list.