dab: plugin architecture for custom DAB resource types #178

New Issue

kert · 2026-03-24T05:50:04Z

kert commented

2026-03-24 05:50:04 +00:00

Goal

The generator should be extensible so new resource types (quality monitors, dashboards, DLT pipelines) can be added without modifying the core generator.

Scope

Define a DabPlugin protocol: resources(cfg, catalog) -> dict
Built-in plugins: JobsPlugin, SchemasPlugin, VolumesPlugin
Plugin discovery via [databricks.plugins] in stack.toml
Each plugin returns a dict merged into resources

Acceptance

Adding a new plugin + listing it in stack.toml emits new resources
Disabling a plugin removes its resources
Existing generation works unchanged

## Goal The generator should be extensible so new resource types (quality monitors, dashboards, DLT pipelines) can be added without modifying the core generator. ## Scope - Define a DabPlugin protocol: resources(cfg, catalog) -> dict - Built-in plugins: JobsPlugin, SchemasPlugin, VolumesPlugin - Plugin discovery via [databricks.plugins] in stack.toml - Each plugin returns a dict merged into resources ## Acceptance - [ ] Adding a new plugin + listing it in stack.toml emits new resources - [ ] Disabling a plugin removes its resources - [ ] Existing generation works unchanged

kert added this to the P22: DAB Generator — pluggable databricks.yml from pipeline registry milestone 2026-03-24 05:50:04 +00:00

kert added the databricks pipeline labels 2026-03-24 05:50:04 +00:00

kert referenced this issue from a commit

2026-03-24 05:58:38 +00:00

add DAB generator: databricks.yml from pipeline registry + stack.toml

kert referenced this issue

2026-03-24 05:59:05 +00:00

feat: DAB generator — databricks.yml from pipeline registry + stack.toml #180

kert closed this issue

2026-03-24 05:59:06 +00:00

Sign in to join this conversation.