97852e818c
Some checks failed
CI / skinny-install (api) (push) Successful in 24s
CI / lint-test (push) Successful in 1m18s
CI / skinny-install (bib) (push) Successful in 30s
CI / skinny-install (bls) (push) Successful in 28s
CI / skinny-install (aco) (push) Successful in 50s
CI / skinny-install (bcda) (push) Successful in 33s
CI / skinny-install (ccw) (push) Successful in 32s
CI / skinny-install (cms) (push) Successful in 24s
CI / skinny-install (cli) (push) Successful in 36s
CI / skinny-install (conf) (push) Successful in 33s
CI / skinny-install (opps) (push) Successful in 30s
CI / skinny-install (perf) (push) Successful in 31s
CI / skinny-install (pfs) (push) Successful in 34s
CI / skinny-install (rex) (push) Has been cancelled
CI / skinny-install (aco) (pull_request) Successful in 51s
CI / lint-test (pull_request) Successful in 1m20s
CI / skinny-install (api) (pull_request) Successful in 29s
CI / skinny-install (bcda) (pull_request) Successful in 30s
CI / skinny-install (bib) (pull_request) Successful in 32s
CI / skinny-install (bls) (pull_request) Successful in 26s
CI / skinny-install (ccw) (pull_request) Successful in 27s
CI / skinny-install (cli) (pull_request) Successful in 29s
CI / skinny-install (cms) (pull_request) Successful in 34s
CI / skinny-install (conf) (pull_request) Successful in 22s
CI / skinny-install (opps) (pull_request) Successful in 33s
CI / skinny-install (perf) (pull_request) Successful in 31s
CI / skinny-install (pfs) (pull_request) Successful in 34s
CI / skinny-install (rex) (pull_request) Successful in 32s
Infra CI / notebooks (push) Successful in 8s
Infra CI / zotero (push) Successful in 6s
Infra CI / docs (push) Failing after 12s
Infra CI / api (push) Successful in 10s
Infra CI / mc (push) Successful in 9s
Infra CI / notebooks (pull_request) Successful in 7s
Infra CI / zotero (pull_request) Successful in 6s
Infra CI / docs (pull_request) Failing after 5s
Infra CI / api (pull_request) Successful in 6s
Infra CI / mc (pull_request) Successful in 6s
Expand Databricks SDK usage from 6 to 18 WorkspaceClient services. Tier 1 — Governance & Compliance: - governance.py: declarative GovernancePolicy with apply + audit drift - UnityClient: grants CRUD (ws.grants), secret management (ws.secrets), table constraints PK/FK (ws.table_constraints) - sync_secrets.py: push env vars to Databricks scopes per stack.toml Tier 2 — Job Orchestration: - jobs.py: JobManager translates Pipeline → Databricks Job with task dependencies, run_now, get_run_status, list/delete - UnityClient: warehouse lookup by name (ws.warehouses), start/stop Tier 3 — Data Quality & Monitoring: - quality.py: setup_monitors creates Lakehouse Monitoring profiles, list_monitors, run_refresh (ws.quality_monitors) - UnityClient: system schema access, table lineage queries, audit log queries (ws.system_schemas, ws.statement_execution) Config: stack.toml gains [databricks.warehouse], [databricks.secrets], [databricks.governance], [databricks.quality] sections. 23 new tests, all passing.
5.0 KiB
5.0 KiB