Dorieh Tutorials
Contents
- Building a data preparation Workflow
- Introduction:
- Prerequisites
- Design overview
- Directory layout
- Step 1. Create a minimal CWL workflow skeleton
- Step 2. Iteratively Defining Steps and Parameters
- Step 3. Parameterize for a single day (“toy” run)
- Step 4. Add database integration (PostgreSQL)
- Step 5. Building Medallion Layers (Bronze, Silver, Gold)
- Step 6. Testing the Pipeline
- Next Steps
- Documenting a Workflow