Implement stack run: execute any pipeline by name with target selection #9

Closed
opened 2026-03-12 17:38:46 +00:00 by kert · 0 comments
Owner

stack run [--target duckdb|databricks|trino]

  • Resolve pipeline module from name (core, cclf, pharmacy, etc.)
  • Select loader based on target (DuckDB connection, Databricks spark, Trino)
  • All 12 pipelines runnable: core, cclf, input_layer, claims_preprocessing, pharmacy, readmissions, ahrq_measures, quality_measures, cms_quality_measures, hcc_suspecting, provider_attribution, main
  • SchemaError validation active on every step
  • Print step-by-step progress with timing
stack run <pipeline> [--target duckdb|databricks|trino] - Resolve pipeline module from name (core, cclf, pharmacy, etc.) - Select loader based on target (DuckDB connection, Databricks spark, Trino) - All 12 pipelines runnable: core, cclf, input_layer, claims_preprocessing, pharmacy, readmissions, ahrq_measures, quality_measures, cms_quality_measures, hcc_suspecting, provider_attribution, main - SchemaError validation active on every step - Print step-by-step progress with timing
kert added this to the P3: Pipeline — Run, validate, observe milestone 2026-03-12 17:38:46 +00:00
kert added the clipipeline labels 2026-03-12 17:38:46 +00:00
kert closed this issue 2026-03-12 20:26:32 +00:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: homelab/stack#9