85ce5e719d
Some checks failed
CI / skinny-install (aco) (push) Successful in 45s
CI / skinny-install (api) (push) Successful in 29s
CI / skinny-install (bcda) (push) Successful in 25s
CI / skinny-install (bib) (push) Successful in 23s
CI / skinny-install (bls) (push) Successful in 20s
CI / skinny-install (ccw) (push) Successful in 36s
CI / skinny-install (cli) (push) Successful in 27s
CI / skinny-install (cms) (push) Successful in 24s
CI / skinny-install (conf) (push) Successful in 27s
CI / skinny-install (pfs) (push) Successful in 25s
CI / skinny-install (rex) (push) Successful in 25s
CI / lint-test (push) Successful in 6m2s
Infra CI / notebooks (push) Successful in 7s
Infra CI / zotero (push) Failing after 6s
Infra CI / docs (push) Successful in 33s
Infra CI / api (push) Successful in 6s
Infra CI / mc (push) Successful in 7s
Deploy / build-scan-report (push) Has been cancelled
- Fix all 72 ruff lint errors (unused imports, unused variables, E402) - Format all 14 unformatted dev/scripts files - Move generated artifacts to assets/ (dag.html, pfs.html) - Remove duplicate root coverage.svg (already in assets/icons/) - Update .dockerignore for infra/ tree layout - Update .gitignore: add .env.bak, mirrors/, htmlcov/ - Fix stale path refs in coverage_badge.py, woodpecker backend, test_network_isolation.sh, docs custom.css - Add .gitkeep to empty dirs (infra/polaris, cloud/*/terraform) - Delete 12 stale local branches, 10 stale remote branches
Azure Deployment
Service Mapping
| Component | Azure Service | Replaces |
|---|---|---|
| Object Storage | Azure Blob Storage (ABFS) | RustFS |
| Database | Azure Database for PostgreSQL | PostgreSQL container |
| Iceberg Catalog | Unity Catalog / Azure Purview | Nessie / Polaris |
| Query Engine | Azure Synapse / Databricks SQL | Trino |
| Compute | Container Apps / AKS | Docker Compose |
| Ingress | Application Gateway + Azure DNS | Traefik + CoreDNS |
| CI/CD | Azure DevOps / GitHub Actions | Gitea Actions |
| Observability | Azure Monitor + App Insights | Grafana stack |
Context
[context.azure]
db_backend = "iceberg"
storage_backend = "abfs"
catalog = "unity"
compute = "container-apps"
Environment Variables
export STACK_CONTEXT=azure
export AZURE_STORAGE_ACCOUNT=yourstorageaccount
export AZURE_STORAGE_CONTAINER=lakehouse
# Managed Identity handles auth on Container Apps
Required RBAC Roles
Storage Blob Data Contributoron lakehouse containerContributoron PostgreSQL serverDatabricks workspace accessif using Unity Catalog
Terraform
See terraform/ for resource definitions (placeholder).