chore: prune dead code and refresh stale docs

- Delete 4 empty, unreferenced orphan scripts in dev/scripts/
  (find_databricks_workspace, scrape_bls_data, generate_bls_express,
  test_databricks_connection).
- Remove the unconditionally-skipped TestFixFields.test_runs in
  tests/zot/test_ops.py — fix_fields is already exercised end-to-end by
  test_ops_deep.py::test_fix_fields_remap_and_delete (which builds the
  itemTypeFieldsCombined view the stub said it needed).
- Remove the empty .github/workflows/ orphan left from the Gitea move
  (CI lives entirely in .gitea/workflows/).
- Drop two dead locals in dev/scripts (F841): an unused authors_section
  loop and a `tags` assignment immediately overwritten by fresh_tags.
- docs/docs/intro.md listed only 9 of 17 modules — sync the packages
  table and src/ tree with the actual module set.
This commit is contained in:
kert
2026-07-08 10:12:24 -04:00
parent 58f49cb293
commit 90b37fe4c2
8 changed files with 20 additions and 23 deletions

View File

@@ -208,13 +208,6 @@ def detect_coi(extra: str, abstract: str, title: str) -> list[str]:
tags: list[str] = [] tags: list[str] = []
text = f"{extra}\n{abstract}\n{title}".lower() text = f"{extra}\n{abstract}\n{title}".lower()
# Check for manufacturer mentions in author affiliations
authors_section = ""
for line in extra.split("\n"):
if line.startswith("Authors:"):
authors_section = line.lower()
break
# Industry funding patterns # Industry funding patterns
for pattern in FUNDING_PATTERNS: for pattern in FUNDING_PATTERNS:
if re.search(pattern, text, re.IGNORECASE): if re.search(pattern, text, re.IGNORECASE):

View File

@@ -173,7 +173,6 @@ def main() -> None:
# Re-fetch with updated tags # Re-fetch with updated tags
evidence_rows = [] evidence_rows = []
for row in rows: for row in rows:
tags = item_tags.get(row["id"], [])
# Refresh tags from DB for newly enriched items # Refresh tags from DB for newly enriched items
fresh_tags = con.execute( fresh_tags = con.execute(
"""SELECT t.name FROM item_tags it """SELECT t.name FROM item_tags it

View File

@@ -13,14 +13,22 @@ narwhals DataFrame-agnostic expression functions backed by DuckDB.
| Package | Description | | Package | Description |
|---------|-------------| |---------|-------------|
| **aco** | ACO REACH analytics — express functions, pipe layer, lake | | **aco** | ACO REACH analytics — express functions, pipe layer, lake |
| **api** | API client modules for homelab services | | **api** | FastAPI service — pipelines, lineage, schema, bib, auth, health |
| **bcda** | Beneficiary Claims Data API client and pipeline | | **bcda** | Beneficiary Claims Data API client and pipeline |
| **bib** | Bibliography store — CMS rules, regulations, manuals | | **bib** | Bibliography store — CMS rules, regulations, manuals |
| **bls** | Bureau of Labor Statistics data access | | **bls** | Bureau of Labor Statistics data access |
| **ccw** | Chronic Conditions Warehouse documentation codex | | **ccw** | Chronic Conditions Warehouse documentation codex |
| **cli** | Typer CLI aggregating the module sub-apps |
| **cms** | CMS table models, logging, and shared utilities | | **cms** | CMS table models, logging, and shared utilities |
| **conf** | `stack.toml` loader + context switching (local/lake/cloud) |
| **mail** | Touchless mail-server automation for the domain |
| **opps** | Outpatient PPS models, rules, and payment calcs |
| **perf** | OpenTelemetry telemetry (opt-in) |
| **pfs** | Physician Fee Schedule pipeline and rules | | **pfs** | Physician Fee Schedule pipeline and rules |
| **prisma** | LLM-driven PRISMA systematic-review screening |
| **rec** | Payment reconciliation engine vs CMS ground-truth |
| **rex** | Record expression engine — copybook parsing, storage | | **rex** | Record expression engine — copybook parsing, storage |
| **sem** | AST-based semantic coverage / test-target ranking |
## Architecture ## Architecture
@@ -29,15 +37,23 @@ src/
├── aco/ # ACO REACH express functions + pipe layer ├── aco/ # ACO REACH express functions + pipe layer
│ ├── express/ # narwhals DataFrame functions │ ├── express/ # narwhals DataFrame functions
│ ├── pipe/ # pipeline runner + step modules │ ├── pipe/ # pipeline runner + step modules
│ └── lake.py # DuckDB lakehouse interface │ └── lake/ # multi-backend lakehouse engine
├── api/ # homelab API clients ├── api/ # FastAPI service (routes, auth, health)
├── bcda/ # BCDA API client + CCLF pipeline ├── bcda/ # BCDA API client + CCLF pipeline
├── bib/ # bibliography store (SQLite) ├── bib/ # bibliography store (SQLite)
├── bls/ # BLS data loader ├── bls/ # BLS data loader
├── ccw/ # CCW documentation codex ├── ccw/ # CCW documentation codex
├── cli/ # Typer CLI (aggregates module sub-apps)
├── cms/ # shared CMS models + logging ├── cms/ # shared CMS models + logging
├── conf/ # config loader + context switching
├── mail/ # mail-server automation
├── opps/ # Outpatient PPS models + calcs
├── perf/ # OpenTelemetry telemetry (opt-in)
├── pfs/ # Physician Fee Schedule ├── pfs/ # Physician Fee Schedule
└── rex/ # record expression engine ├── prisma/ # LLM PRISMA screening
├── rec/ # payment reconciliation engine
├── rex/ # record expression engine
└── sem/ # semantic coverage tooling
``` ```
## Links ## Links

View File

@@ -49,14 +49,3 @@ class TestFixKeys:
result = fix_keys(zot_path) result = fix_keys(zot_path)
assert isinstance(result, dict) assert isinstance(result, dict)
class TestFixFields:
@pytest.mark.skip(
reason="requires itemTypeFieldsCombined view from full Zotero schema"
)
def test_runs(self, zot_path):
from zot.ops import fix_fields
result = fix_fields(zot_path)
assert isinstance(result, dict)