dab: remove unused large cluster config from stack.toml #220

New Issue

kert · 2026-03-25T03:23:17Z

kert commented

2026-03-25 03:23:17 +00:00

Problem

[databricks.clusters.large] (i3.2xlarge, 4 workers) is defined but no pipeline uses cluster_profile = "large". Dead config.

Tasks

Remove [databricks.clusters.large] from stack.toml
Verify databricks.yml regenerates without it
Update tests if they reference the large cluster

## Problem `[databricks.clusters.large]` (i3.2xlarge, 4 workers) is defined but no pipeline uses `cluster_profile = "large"`. Dead config. ## Tasks - [ ] Remove `[databricks.clusters.large]` from stack.toml - [ ] Verify databricks.yml regenerates without it - [ ] Update tests if they reference the large cluster

kert added this to the P28: DAB Modernization — Python wheel tasks, databricks-bundles, schema cleanup milestone 2026-03-25 03:23:17 +00:00

kert commented

2026-03-25 03:23:55 +00:00

Starting in parallel with #219.

kert commented

2026-03-25 03:34:43 +00:00

Complete.

Removed [databricks.clusters.large] from stack.toml (i3.2xlarge, 4 workers — unused, no pipeline references it)
Regenerated databricks.yml — only default_cluster remains

✅ Clean.

Complete. - Removed `[databricks.clusters.large]` from stack.toml (i3.2xlarge, 4 workers — unused, no pipeline references it) - Regenerated databricks.yml — only `default_cluster` remains ✅ Clean.

kert closed this issue

2026-03-25 03:34:43 +00:00

kert referenced this issue from a commit

2026-03-25 03:41:40 +00:00

feat: modernize DAB — Python wheel tasks, schema cleanup, dead config removal

Sign in to join this conversation.

1 Participants

Notifications

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: homelab/stack#220