test(pfs,llm): home-visit dossier golden (fixture + live) and chat golden entry; CLI docs
Some checks failed
CI / lint (push) Successful in 54s
CI / notebooks-smoke (push) Successful in 2m21s
Deploy / changes (push) Successful in 19s
CI / test (push) Failing after 4m46s
Infra CI / notebooks (push) Successful in 1m7s
Infra CI / zotero (push) Successful in 29s
Infra CI / api (push) Successful in 22s
Infra CI / bcda (push) Successful in 21s
Infra CI / llm (push) Successful in 17s
Infra CI / docs (push) Successful in 1m32s
Deploy / notebooks (push) Has been skipped
Deploy / zotero (push) Has been skipped
Infra CI / mc (push) Successful in 19s
Deploy / docs (push) Successful in 50s
Deploy / api (push) Successful in 1m40s
Deploy / bcda (push) Successful in 1m59s
Deploy / mc (push) Has been skipped
Deploy / llm (push) Successful in 1m11s
Deploy / report (push) Successful in 16s

This commit is contained in:
kert
2026-11-13 01:44:12 -05:00
parent bb1a373252
commit a790b74179
136 changed files with 1163 additions and 184 deletions

View File

@@ -46,6 +46,7 @@ _EXPECTATION_KEYS = (
"forbid",
"expect_events",
"expect_dockets",
"expect_dossier",
"min_eras",
)
@@ -109,6 +110,10 @@ class Transcript:
return e.get("events", [])
return []
@property
def dossier_events(self) -> list[dict]:
return [e for e in self.events if e.get("type") == "dossier"]
@property
def error(self) -> str | None:
for e in self.events:
@@ -224,6 +229,21 @@ def check_dockets(transcript: Transcript, expect_dockets: list[str]) -> CheckRes
return CheckResult("dockets", passed, detail)
def check_dossier(transcript: Transcript, expect: dict) -> CheckResult:
"""A ``dossier`` event for the expected family arrived, and a source
with ``kind == "dossier"`` is present."""
family = expect["family"]
got = any(e.get("family") == family for e in transcript.dossier_events)
linked = any(s.get("kind") == "dossier" for s in transcript.sources)
problems = []
if not got:
problems.append(f"no dossier event for {family}")
if not linked:
problems.append("no dossier source")
passed = not problems
return CheckResult("dossier", passed, "ok" if passed else "; ".join(problems))
def _rule_year(source: dict) -> int:
"""The rule year a source belongs to: the docket id's embedded year
for a comment, else the source's own date year — no imports, so this
@@ -258,6 +278,8 @@ def evaluate(entry: dict, transcript: Transcript) -> list[CheckResult]:
results.append(check_events(transcript, entry["expect_events"]))
if "expect_dockets" in entry:
results.append(check_dockets(transcript, entry["expect_dockets"]))
if "expect_dossier" in entry:
results.append(check_dossier(transcript, entry["expect_dossier"]))
if "min_eras" in entry:
results.append(check_eras(transcript, entry["min_eras"]))
return results

View File

@@ -1,6 +1,6 @@
---
title: stack api serve
sidebar_position: 82
sidebar_position: 95
---
# `stack api serve`

View File

@@ -1,6 +1,6 @@
---
title: stack api
sidebar_position: 81
sidebar_position: 94
---
# `stack api`

View File

@@ -1,6 +1,6 @@
---
title: stack bib attach-iom
sidebar_position: 37
sidebar_position: 43
---
# `stack bib attach-iom`

View File

@@ -1,6 +1,6 @@
---
title: stack bib attach-oig
sidebar_position: 42
sidebar_position: 48
---
# `stack bib attach-oig`

View File

@@ -1,6 +1,6 @@
---
title: stack bib backfill-comments
sidebar_position: 35
sidebar_position: 41
---
# `stack bib backfill-comments`

View File

@@ -1,6 +1,6 @@
---
title: stack bib cfr-jump
sidebar_position: 47
sidebar_position: 53
---
# `stack bib cfr-jump`

View File

@@ -1,6 +1,6 @@
---
title: stack bib code-tags
sidebar_position: 48
sidebar_position: 54
---
# `stack bib code-tags`

View File

@@ -0,0 +1,23 @@
---
title: stack bib discover-dmepos-rules
sidebar_position: 33
---
# `stack bib discover-dmepos-rules`
```
Usage: stack bib discover-dmepos-rules [OPTIONS]
Walk the Federal Register API for every DMEPOS rule since a date.
The benefit moved between the ESRD rule, a standalone HCPCS rule,
and the home health rule. A title filter keeps those vehicles and
drops a Physician Fee Schedule title that only mentions DMEPOS.
╭─ Options ────────────────────────────────────────────────────────────────────╮
│ --since <str> [default: 2017-01-01] │
│ --until <str> │
│ --dry-run │
│ --help Show this message and exit. │
╰──────────────────────────────────────────────────────────────────────────────╯
```

View File

@@ -0,0 +1,19 @@
---
title: stack bib discover-ipps-rules
sidebar_position: 31
---
# `stack bib discover-ipps-rules`
```
Usage: stack bib discover-ipps-rules [OPTIONS]
Walk the Federal Register API for every annual IPPS/LTCH rule.
╭─ Options ────────────────────────────────────────────────────────────────────╮
│ --since <str> [default: 2017-01-01] │
│ --until <str> │
│ --dry-run │
│ --help Show this message and exit. │
╰──────────────────────────────────────────────────────────────────────────────╯
```

View File

@@ -0,0 +1,19 @@
---
title: stack bib discover-opps-rules
sidebar_position: 32
---
# `stack bib discover-opps-rules`
```
Usage: stack bib discover-opps-rules [OPTIONS]
Walk the Federal Register API for every annual OPPS/ASC rule.
╭─ Options ────────────────────────────────────────────────────────────────────╮
│ --since <str> [default: 2017-01-01] │
│ --until <str> │
│ --dry-run │
│ --help Show this message and exit. │
╰──────────────────────────────────────────────────────────────────────────────╯
```

View File

@@ -11,7 +11,7 @@ Usage: stack bib discover-pfs-rules [OPTIONS]
Walk the Federal Register API for every PFS rule since a date.
Upserts each as a bib ``Rule`` record tagged ``module:pfs``,
``source:federal-register``, ``rule:<cms-id>``. Cheap — the FR API
``source:federal-register``, ``docket:<cms-id>``. Cheap — the FR API
has no auth and no rate charge we can trigger at this scale
(~20 rules since 2017).

View File

@@ -0,0 +1,44 @@
---
title: stack bib fetch-dmepos-comments
sidebar_position: 39
---
# `stack bib fetch-dmepos-comments`
```
Usage: stack bib fetch-dmepos-comments [OPTIONS]
Discover every DMEPOS proposed rule since *since* and pull its comments.
Combined ESRD and home-health vehicles come in whole: the comment
file is the docket's file, not a DMEPOS-only slice. Notices and final
rules are registered by ``discover-dmepos-rules`` and are not walked.
No title needle is passed to regulations.gov. The agency's copy of a
long title is often truncated (``etc.``) or hyphenated differently
from the Federal Register, and the short display posting is then
the only document that still contains "DMEPOS".
╭─ Options ────────────────────────────────────────────────────────────────────╮
│ --since <str> [default: 2017-01-01] │
│ --until <str> │
│ --attachments │
│ --per-docket-limit <int> Cap comments fetched per docket. 0 = │
│ unlimited. │
│ [default: 0] │
│ --sleep <float> [default: 1.3] │
│ --docket <str> Only pull this reg.gov docket (e.g. │
│ CMS-2026-2377). Filtered before any API │
│ call ONLY once the docket is known (a │
│ `dockets` row already exists for its CMS │
│ id) — a CMS id with no `dockets` row yet │
│ still costs one Federal Register │
│ rule-metadata fetch plus one │
│ resolve_docket call, because the reg.gov │
│ docket id isn't known until those calls │
│ resolve it. │
│ --force Walk every docket from page 1, sealed or │
│ not. Never unseals. │
│ --help Show this message and exit. │
╰──────────────────────────────────────────────────────────────────────────────╯
```

View File

@@ -1,6 +1,6 @@
---
title: stack bib fetch-docket-comments
sidebar_position: 31
sidebar_position: 34
---
# `stack bib fetch-docket-comments`

View File

@@ -0,0 +1,35 @@
---
title: stack bib fetch-ipps-comments
sidebar_position: 37
---
# `stack bib fetch-ipps-comments`
```
Usage: stack bib fetch-ipps-comments [OPTIONS]
Discover every annual IPPS/LTCH proposed rule and pull its comments.
╭─ Options ────────────────────────────────────────────────────────────────────╮
│ --since <str> [default: 2017-01-01] │
│ --until <str> │
│ --attachments │
│ --per-docket-limit <int> Cap comments fetched per docket. 0 = │
│ unlimited. │
│ [default: 0] │
│ --sleep <float> [default: 1.3] │
│ --docket <str> Only pull this reg.gov docket (e.g. │
│ CMS-2026-2377). Filtered before any API │
│ call ONLY once the docket is known (a │
│ `dockets` row already exists for its CMS │
│ id) — a CMS id with no `dockets` row yet │
│ still costs one Federal Register │
│ rule-metadata fetch plus one │
│ resolve_docket call, because the reg.gov │
│ docket id isn't known until those calls │
│ resolve it. │
│ --force Walk every docket from page 1, sealed or │
│ not. Never unseals. │
│ --help Show this message and exit. │
╰──────────────────────────────────────────────────────────────────────────────╯
```

View File

@@ -0,0 +1,35 @@
---
title: stack bib fetch-opps-comments
sidebar_position: 38
---
# `stack bib fetch-opps-comments`
```
Usage: stack bib fetch-opps-comments [OPTIONS]
Discover every annual OPPS/ASC proposed rule and pull its comments.
╭─ Options ────────────────────────────────────────────────────────────────────╮
│ --since <str> [default: 2017-01-01] │
│ --until <str> │
│ --attachments │
│ --per-docket-limit <int> Cap comments fetched per docket. 0 = │
│ unlimited. │
│ [default: 0] │
│ --sleep <float> [default: 1.3] │
│ --docket <str> Only pull this reg.gov docket (e.g. │
│ CMS-2026-2377). Filtered before any API │
│ call ONLY once the docket is known (a │
│ `dockets` row already exists for its CMS │
│ id) — a CMS id with no `dockets` row yet │
│ still costs one Federal Register │
│ rule-metadata fetch plus one │
│ resolve_docket call, because the reg.gov │
│ docket id isn't known until those calls │
│ resolve it. │
│ --force Walk every docket from page 1, sealed or │
│ not. Never unseals. │
│ --help Show this message and exit. │
╰──────────────────────────────────────────────────────────────────────────────╯
```

View File

@@ -1,6 +1,6 @@
---
title: stack bib fetch-pfs-comments
sidebar_position: 33
sidebar_position: 36
---
# `stack bib fetch-pfs-comments`

View File

@@ -1,6 +1,6 @@
---
title: stack bib fr-grab
sidebar_position: 45
sidebar_position: 51
---
# `stack bib fr-grab`
@@ -11,12 +11,17 @@ Usage: stack bib fr-grab [OPTIONS]
Grab federalregister.gov paragraph/page anchor maps into bib (#634).
One body-HTML fetch per rule; anchors persist in ``fr_anchors`` /
``fr_anchor_docs`` for offline jump-link resolution.
``fr_anchor_docs`` for offline jump-link resolution. A --force
re-grab moves the item's pincites, pin: tags, fr_links and note
links to the paragraphs holding the same text, and refuses (writing
nothing) when one has no confident home — add --map for those.
╭─ Options ────────────────────────────────────────────────────────────────────╮
│ --key <str> Grab one rule item by bib key. │
│ --all Backfill every rule item with an FR URL. │
│ --force Re-grab even if an anchor map already exists. │
│ --map <str> Place a pinned paragraph text matching cannot: │
│ p-OLD=p-NEW (repeatable; --key only). │
│ --help Show this message and exit. │
╰──────────────────────────────────────────────────────────────────────────────╯
```

View File

@@ -1,6 +1,6 @@
---
title: stack bib fr-jump
sidebar_position: 46
sidebar_position: 52
---
# `stack bib fr-jump`

View File

@@ -1,6 +1,6 @@
---
title: stack bib import-zotero
sidebar_position: 39
sidebar_position: 45
---
# `stack bib import-zotero`

View File

@@ -1,6 +1,6 @@
---
title: stack bib ingest-iom
sidebar_position: 36
sidebar_position: 42
---
# `stack bib ingest-iom`

View File

@@ -1,6 +1,6 @@
---
title: stack bib ingest-mail
sidebar_position: 34
sidebar_position: 40
---
# `stack bib ingest-mail`

View File

@@ -1,6 +1,6 @@
---
title: stack bib ingest-oig
sidebar_position: 41
sidebar_position: 47
---
# `stack bib ingest-oig`

View File

@@ -1,6 +1,6 @@
---
title: stack bib pull-open-dockets
sidebar_position: 32
sidebar_position: 35
---
# `stack bib pull-open-dockets`

View File

@@ -1,6 +1,6 @@
---
title: stack bib refresh-iom
sidebar_position: 44
sidebar_position: 50
---
# `stack bib refresh-iom`

View File

@@ -1,6 +1,6 @@
---
title: stack bib refresh-oig
sidebar_position: 43
sidebar_position: 49
---
# `stack bib refresh-oig`

View File

@@ -1,6 +1,6 @@
---
title: stack bib sync-zotero
sidebar_position: 40
sidebar_position: 46
---
# `stack bib sync-zotero`

View File

@@ -1,6 +1,6 @@
---
title: stack bib watch-iom
sidebar_position: 38
sidebar_position: 44
---
# `stack bib watch-iom`

View File

@@ -19,6 +19,12 @@ Usage: stack bib [OPTIONS] COMMAND [ARGS]...
│ query Search the bibliography store. │
│ discover-pfs-rules Walk the Federal Register API for every PFS rule │
│ since a date. │
│ discover-ipps-rules Walk the Federal Register API for every annual │
│ IPPS/LTCH rule. │
│ discover-opps-rules Walk the Federal Register API for every annual │
│ OPPS/ASC rule. │
│ discover-dmepos-rules Walk the Federal Register API for every DMEPOS rule │
│ since a date. │
│ fetch-docket-comments Walk one docket's comments from its stored watermark; │
│ upsert as Source items. │
│ pull-open-dockets Pull and enrich every docket that is not sealed yet — │
@@ -26,6 +32,12 @@ Usage: stack bib [OPTIONS] COMMAND [ARGS]...
│ fetch-pfs-comments Discover every PFS proposed rule since *since* and │
│ pull new comments │
│ on each docket from its stored watermark. │
│ fetch-ipps-comments Discover every annual IPPS/LTCH proposed rule and │
│ pull its comments. │
│ fetch-opps-comments Discover every annual OPPS/ASC proposed rule and pull │
│ its comments. │
│ fetch-dmepos-comments Discover every DMEPOS proposed rule since *since* and │
│ pull its comments. │
│ ingest-mail Pull UNSEEN mail from a mailbox via IMAPS, upsert as │
│ bib Sources. │
│ backfill-comments Enrich every reg-gov comment stub with body + │

View File

@@ -1,6 +1,6 @@
---
title: stack bls ces
sidebar_position: 51
sidebar_position: 57
---
# `stack bls ces`

View File

@@ -1,6 +1,6 @@
---
title: stack bls oews
sidebar_position: 50
sidebar_position: 56
---
# `stack bls oews`

View File

@@ -1,6 +1,6 @@
---
title: stack bls
sidebar_position: 49
sidebar_position: 55
---
# `stack bls`

View File

@@ -1,6 +1,6 @@
---
title: stack comments dockets
sidebar_position: 56
sidebar_position: 62
---
# `stack comments dockets`

View File

@@ -1,6 +1,6 @@
---
title: stack comments extract-ocr
sidebar_position: 54
sidebar_position: 60
---
# `stack comments extract-ocr`

View File

@@ -1,6 +1,6 @@
---
title: stack comments extract
sidebar_position: 53
sidebar_position: 59
---
# `stack comments extract`

View File

@@ -1,6 +1,6 @@
---
title: stack comments seal
sidebar_position: 57
sidebar_position: 63
---
# `stack comments seal`

View File

@@ -1,6 +1,6 @@
---
title: stack comments stats
sidebar_position: 55
sidebar_position: 61
---
# `stack comments stats`

View File

@@ -1,6 +1,6 @@
---
title: stack comments unseal
sidebar_position: 58
sidebar_position: 64
---
# `stack comments unseal`

View File

@@ -1,6 +1,6 @@
---
title: stack comments
sidebar_position: 52
sidebar_position: 58
---
# `stack comments`

View File

@@ -1,6 +1,6 @@
---
title: stack db comment
sidebar_position: 75
sidebar_position: 88
---
# `stack db comment`

View File

@@ -1,6 +1,6 @@
---
title: stack db inspect
sidebar_position: 76
sidebar_position: 89
---
# `stack db inspect`

View File

@@ -1,6 +1,6 @@
---
title: stack db
sidebar_position: 74
sidebar_position: 87
---
# `stack db`

View File

@@ -1,6 +1,6 @@
---
title: stack docs build
sidebar_position: 78
sidebar_position: 91
---
# `stack docs build`

View File

@@ -1,6 +1,6 @@
---
title: stack docs generate
sidebar_position: 80
sidebar_position: 93
---
# `stack docs generate`

View File

@@ -1,6 +1,6 @@
---
title: stack docs serve
sidebar_position: 79
sidebar_position: 92
---
# `stack docs serve`

View File

@@ -1,6 +1,6 @@
---
title: stack docs
sidebar_position: 77
sidebar_position: 90
---
# `stack docs`

View File

@@ -1,6 +1,6 @@
---
title: stack lake deploy
sidebar_position: 60
sidebar_position: 66
---
# `stack lake deploy`

View File

@@ -1,6 +1,6 @@
---
title: stack lake load
sidebar_position: 61
sidebar_position: 67
---
# `stack lake load`

View File

@@ -1,6 +1,6 @@
---
title: stack lake parity
sidebar_position: 63
sidebar_position: 69
---
# `stack lake parity`

View File

@@ -1,6 +1,6 @@
---
title: stack lake validate
sidebar_position: 62
sidebar_position: 68
---
# `stack lake validate`

View File

@@ -1,6 +1,6 @@
---
title: stack lake
sidebar_position: 59
sidebar_position: 65
---
# `stack lake`

View File

@@ -0,0 +1,23 @@
---
title: stack lead explore
sidebar_position: 72
---
# `stack lead explore`
```
Usage: stack lead explore [OPTIONS]
Open the read-only explorer on the local public-data mirror.
╭─ Options ────────────────────────────────────────────────────────────────────╮
│ --db <str> Path to the local public-data mirror. │
│ [default: │
│ /home/kert/stack/data/lead/public.duc… │
│ --port <int> Port for the Streamlit server. │
│ [default: 8502] │
│ --headless --no-headless Do not open a browser. │
│ [default: headless] │
│ --help Show this message and exit. │
╰──────────────────────────────────────────────────────────────────────────────╯
```

View File

@@ -0,0 +1,20 @@
---
title: stack lead ledger
sidebar_position: 74
---
# `stack lead ledger`
```
Usage: stack lead ledger [OPTIONS] COMMAND [ARGS]...
Evidence ledger.
╭─ Options ────────────────────────────────────────────────────────────────────╮
│ --help Show this message and exit. │
╰──────────────────────────────────────────────────────────────────────────────╯
╭─ Commands ───────────────────────────────────────────────────────────────────╮
│ status Print one status row per target. │
│ export Export one project's Zotero rows into the evidence ledger. │
╰──────────────────────────────────────────────────────────────────────────────╯
```

View File

@@ -0,0 +1,21 @@
---
title: stack lead load
sidebar_position: 73
---
# `stack lead load`
```
Usage: stack lead load [OPTIONS]
Load local public files into DuckDB. This does not download or publish.
╭─ Options ────────────────────────────────────────────────────────────────────╮
│ * --db <str> Path to the local DuckDB mirror. [required] │
│ --manifest <str> Enrichment manifest CSV. │
│ --root <str> Directory the manifest paths are under. │
│ --strand5 <str> Directory that holds files.tsv. │
│ --actor <str> Who loaded the rows. [default: stack] │
│ --help Show this message and exit. │
╰──────────────────────────────────────────────────────────────────────────────╯
```

View File

@@ -0,0 +1,19 @@
---
title: stack lead manifest
sidebar_position: 75
---
# `stack lead manifest`
```
Usage: stack lead manifest [OPTIONS] COMMAND [ARGS]...
Public-release manifest.
╭─ Options ────────────────────────────────────────────────────────────────────╮
│ --help Show this message and exit. │
╰──────────────────────────────────────────────────────────────────────────────╯
╭─ Commands ───────────────────────────────────────────────────────────────────╮
│ load Record manifest rows. This does not download the files. │
╰──────────────────────────────────────────────────────────────────────────────╯
```

View File

@@ -0,0 +1,24 @@
---
title: stack lead release
sidebar_position: 76
---
# `stack lead release`
```
Usage: stack lead release [OPTIONS] COMMAND [ARGS]...
Review releases (BagIt bag + RO-Crate).
╭─ Options ────────────────────────────────────────────────────────────────────╮
│ --help Show this message and exit. │
╰──────────────────────────────────────────────────────────────────────────────╯
╭─ Commands ───────────────────────────────────────────────────────────────────╮
│ build Write a release bag. Reads the ledger, labels and Zotero read-only. │
│ publish Publish a verified bag: serve it at reach /releases (same SSO as │
│ reach), archive it to rustfs, create the Gitea release, add a bib │
│ item. │
│ Refuses a bag that does not verify or a version already published. │
│ verify Check a bag: BagIt manifests and Payload-Oxum, then the RO-Crate. │
╰──────────────────────────────────────────────────────────────────────────────╯
```

View File

@@ -0,0 +1,16 @@
---
title: stack lead targets
sidebar_position: 71
---
# `stack lead targets`
```
Usage: stack lead targets [OPTIONS]
Print every target ID, family, and name.
╭─ Options ────────────────────────────────────────────────────────────────────╮
│ --help Show this message and exit. │
╰──────────────────────────────────────────────────────────────────────────────╯
```

25
docs/docs/cli/lead.md Normal file
View File

@@ -0,0 +1,25 @@
---
title: stack lead
sidebar_position: 70
---
# `stack lead`
```
Usage: stack lead [OPTIONS] COMMAND [ARGS]...
LEAD target registry, evidence ledger, and public-data mirror.
╭─ Options ────────────────────────────────────────────────────────────────────╮
│ --help Show this message and exit. │
╰──────────────────────────────────────────────────────────────────────────────╯
╭─ Commands ───────────────────────────────────────────────────────────────────╮
│ targets Print every target ID, family, and name. │
│ explore Open the read-only explorer on the local public-data mirror. │
│ load Load local public files into DuckDB. This does not download or │
│ publish. │
│ ledger Evidence ledger. │
│ manifest Public-release manifest. │
│ release Review releases (BagIt bag + RO-Crate). │
╰──────────────────────────────────────────────────────────────────────────────╯
```

View File

@@ -1,6 +1,6 @@
---
title: stack llm eval-tags
sidebar_position: 71
sidebar_position: 84
---
# `stack llm eval-tags`
@@ -8,26 +8,35 @@ sidebar_position: 71
```
Usage: stack llm eval-tags [OPTIONS]
Score the theme tagger against the golden set (P35 gate, #577): per-theme
precision/recall, micro-F1 and the abstain rate, then the fan-out gate
(micro-F1 ≥ 0.70; no theme with support ≥ 5 under 0.5 precision). Default
reads the tags the last run stored on each item (no model calls); --live
re-tags each golden comment now. Exit 1 when the gate fails.
Score the theme tagger against the golden set: per-theme precision/recall,
micro-F1 and the abstain rate, per docket, then the gate. Default: golden v3
(200 comments, 8 dockets), held-out half, micro-F1 ≥ 0.75 and no theme with
support ≥ 5 under 0.6 precision. Reads the tags the last run stored on each
item (no model calls); --live re-tags each golden comment now. Exit 1 when the
gate fails.
╭─ Options ────────────────────────────────────────────────────────────────────╮
│ --golden <str> Golden YAML (comment ids with expected │
│ themes). │
│ [default: tests/llm/golden_themes.yaml] │
│ [default: tests/llm/golden_themes_v3.yaml] │
│ --live Re-tag through the model instead of scoring │
│ what is stored on the items. │
│ --limit <int> Score only the first N golden entries. │
│ [default: 0] │
│ --top <int> [default: 8] │
│ --max-tags <int> [default: 3] │
│ --min-confidence <float> [default: 0.6] │
│ --top <int> .tag_top │
│ --max-tags <int> .tag_max_tags │
│ --min-confidence <float> .tag_min_confidence │
│ --dump <str> With --live: write every comment's │
│ shortlist, verdicts and confidences to this │
│ JSON file. │
│ --split <str> Golden half to score: heldout (the gate) | │
│ tune | all. │
│ [default: heldout] │
│ --docket <str> Score one docket's entries. │
│ --min-f1 <float> Gate: micro-F1 floor. [default: 0.75] │
│ --min-precision <float> Gate: per-theme precision floor (support >= │
│ 5). │
│ [default: 0.6] │
│ --help Show this message and exit. │
╰──────────────────────────────────────────────────────────────────────────────╯
```

View File

@@ -1,6 +1,6 @@
---
title: stack llm hosts
sidebar_position: 67
sidebar_position: 80
---
# `stack llm hosts`

View File

@@ -1,6 +1,6 @@
---
title: stack llm index
sidebar_position: 65
sidebar_position: 78
---
# `stack llm index`

View File

@@ -1,6 +1,6 @@
---
title: stack llm prune-rules
sidebar_position: 72
sidebar_position: 85
---
# `stack llm prune-rules`

View File

@@ -1,6 +1,6 @@
---
title: stack llm restamp
sidebar_position: 66
sidebar_position: 79
---
# `stack llm restamp`

View File

@@ -1,6 +1,6 @@
---
title: stack llm serve
sidebar_position: 68
sidebar_position: 81
---
# `stack llm serve`

View File

@@ -1,6 +1,6 @@
---
title: stack llm stamp-themes
sidebar_position: 73
sidebar_position: 86
---
# `stack llm stamp-themes`

View File

@@ -1,6 +1,6 @@
---
title: stack llm tag
sidebar_position: 70
sidebar_position: 83
---
# `stack llm tag`
@@ -25,13 +25,11 @@ Usage: stack llm tag [OPTIONS]
│ current. │
│ --dry-run Compute and print, write nothing. │
│ --top <int> Themes shortlisted per comment before │
│ judging. │
│ [default: 8] │
│ --max-tags <int> Most themes written per comment. │
│ [default: 3] │
│ --min-confidence <float> Shortlist similarity below which a │
│ judged yes is not written. │
│ [default: 0.0] │
│ judging .tag_top. │
│ --max-tags <int> Most themes written per comment │
│ .tag_max_tags. │
│ --min-confidence <float> Shortlist similarity a judged yes must │
│ reach .tag_min_confidence. │
│ --verbose Print every comment's tags. │
│ --help Show this message and exit. │
╰──────────────────────────────────────────────────────────────────────────────╯

View File

@@ -1,6 +1,6 @@
---
title: stack llm vocab
sidebar_position: 69
sidebar_position: 82
---
# `stack llm vocab`

View File

@@ -1,6 +1,6 @@
---
title: stack llm
sidebar_position: 64
sidebar_position: 77
---
# `stack llm`
@@ -35,17 +35,17 @@ Usage: stack llm [OPTIONS] COMMAND [ARGS]...
│ record state in the item's extra_json, and replace its llm: │
│ tags. │
│ Resumable — unchanged comments are skipped unless --force. │
│ eval-tags Score the theme tagger against the golden set (P35 gate, │
│ #577): │
│ per-theme precision/recall, micro-F1 and the abstain rate, │
│ eval-tags Score the theme tagger against the golden set: per-theme │
│ precision/recall, micro-F1 and the abstain rate, per docket, │
│ then the │
│ fan-out gate (micro-F1 ≥ 0.70; no theme with support ≥ 5 under │
│ 0.5 │
│ precision). Default reads the tags the last run stored on each │
│ item │
│ (no model calls); --live re-tags each golden comment now. Exit │
│ 1 when │
│ the gate fails. │
│ gate. Default: golden v3 (200 comments, 8 dockets), held-out │
│ half, │
│ micro-F1 ≥ 0.75 and no theme with support ≥ 5 under 0.6 │
│ precision. │
│ Reads the tags the last run stored on each item (no model │
│ calls); │
│ --live re-tags each golden comment now. Exit 1 when the gate │
│ fails. │
│ prune-rules Remove Federal Register rules from the corpus collection and │
│ stamp │
│ proposed/final/correction on their rules chunks. Rules are │

View File

@@ -1,6 +1,6 @@
---
title: stack mail attach-smarthost
sidebar_position: 124
sidebar_position: 152
---
# `stack mail attach-smarthost`

View File

@@ -1,6 +1,6 @@
---
title: stack mail dkim-export
sidebar_position: 123
sidebar_position: 151
---
# `stack mail dkim-export`

View File

@@ -1,6 +1,6 @@
---
title: stack mail dns
sidebar_position: 122
sidebar_position: 150
---
# `stack mail dns`

View File

@@ -1,6 +1,6 @@
---
title: stack mail down
sidebar_position: 120
sidebar_position: 148
---
# `stack mail down`

View File

@@ -1,6 +1,6 @@
---
title: stack mail provision
sidebar_position: 118
sidebar_position: 146
---
# `stack mail provision`

View File

@@ -1,6 +1,6 @@
---
title: stack mail rotate-creds
sidebar_position: 125
sidebar_position: 153
---
# `stack mail rotate-creds`

View File

@@ -1,6 +1,6 @@
---
title: stack mail seed-mailboxes
sidebar_position: 126
sidebar_position: 154
---
# `stack mail seed-mailboxes`

View File

@@ -1,6 +1,6 @@
---
title: stack mail status
sidebar_position: 121
sidebar_position: 149
---
# `stack mail status`

View File

@@ -1,6 +1,6 @@
---
title: stack mail up
sidebar_position: 119
sidebar_position: 147
---
# `stack mail up`

View File

@@ -1,6 +1,6 @@
---
title: stack mail wire-git
sidebar_position: 127
sidebar_position: 155
---
# `stack mail wire-git`

View File

@@ -1,6 +1,6 @@
---
title: stack mail
sidebar_position: 117
sidebar_position: 145
---
# `stack mail`

View File

@@ -1,6 +1,6 @@
---
title: stack nlm fetch
sidebar_position: 130
sidebar_position: 158
---
# `stack nlm fetch`

View File

@@ -1,6 +1,6 @@
---
title: stack nlm releases
sidebar_position: 129
sidebar_position: 157
---
# `stack nlm releases`

View File

@@ -1,6 +1,6 @@
---
title: stack nlm vsac
sidebar_position: 131
sidebar_position: 159
---
# `stack nlm vsac`

View File

@@ -1,6 +1,6 @@
---
title: stack nlm
sidebar_position: 128
sidebar_position: 156
---
# `stack nlm`

View File

@@ -1,6 +1,6 @@
---
title: stack perf show
sidebar_position: 84
sidebar_position: 97
---
# `stack perf show`

View File

@@ -1,6 +1,6 @@
---
title: stack perf
sidebar_position: 83
sidebar_position: 96
---
# `stack perf`

View File

@@ -0,0 +1,24 @@
---
title: stack pfs cms-summaries
sidebar_position: 118
---
# `stack pfs cms-summaries`
```
Usage: stack pfs cms-summaries [OPTIONS]
CMS's own Comment:/Response: summaries (pfs.cms_comment_summary): CMS's
quantifier, the stance of the summarized comments and CMS's response action,
per pair a rule prints. Kept apart from our own commenter counts.
╭─ Options ────────────────────────────────────────────────────────────────────╮
│ * --family <str> Curated family key. [required] │
│ --no-llm Make no model calls; the finished ledger is │
│ replayed. │
│ --limit <int> Cap new model calls (0 = all). [default: 0] │
│ --retry-failed Re-run ledger entries that failed. │
│ --write │
│ --help Show this message and exit. │
╰──────────────────────────────────────────────────────────────────────────────╯
```

View File

@@ -0,0 +1,25 @@
---
title: stack pfs commenters
sidebar_position: 119
---
# `stack pfs commenters`
```
Usage: stack pfs commenters [OPTIONS]
Who wrote each family comment (pfs.commenter): organization, type, specialty,
form-letter campaign and the submitter name as the regulations.gov record
posts it (official public record).
╭─ Options ────────────────────────────────────────────────────────────────────╮
│ * --family <str> Curated family key. [required] │
│ * --docket <str> regulations.gov docket id. [required] │
│ --limit <int> Cap new model calls (0 = all). [default: 0] │
│ --retry-failed Re-run ledger entries that failed. │
│ --dry-run Count the family's comments and │
│ regulations.gov categories; no model. │
│ --write │
│ --help Show this message and exit. │
╰──────────────────────────────────────────────────────────────────────────────╯
```

View File

@@ -1,6 +1,6 @@
---
title: stack pfs cpt-ingest
sidebar_position: 98
sidebar_position: 114
---
# `stack pfs cpt-ingest`

View File

@@ -0,0 +1,28 @@
---
title: stack pfs dossier
sidebar_position: 122
---
# `stack pfs dossier`
```
Usage: stack pfs dossier [OPTIONS]
Assemble a family's dossier (pfs.dossier): every stored fact with its resolved
citation, the computed gaps, and model prose that passes the sentence-level
citation check (template lines otherwise), through a resumable ledger. Prints
the fact count, the gaps, the stakeholder table and the check result; --write
stores it.
╭─ Options ────────────────────────────────────────────────────────────────────╮
│ --family <str> Curated family key. │
│ --all Every curated family. │
│ --no-llm Make no model calls; the finished prose ledger is │
│ replayed. │
│ --limit <int> Cap new model calls (0 = all). [default: 0] │
│ --dry-run Count facts and timeline events; no model calls, no │
│ writes. │
│ --write │
│ --help Show this message and exit. │
╰──────────────────────────────────────────────────────────────────────────────╯
```

View File

@@ -1,6 +1,6 @@
---
title: stack pfs elements
sidebar_position: 90
sidebar_position: 103
---
# `stack pfs elements`

View File

@@ -1,6 +1,6 @@
---
title: stack pfs exposure
sidebar_position: 95
sidebar_position: 108
---
# `stack pfs exposure`

View File

@@ -1,6 +1,6 @@
---
title: stack pfs families
sidebar_position: 92
sidebar_position: 105
---
# `stack pfs families`

View File

@@ -1,6 +1,6 @@
---
title: stack pfs guidance
sidebar_position: 93
sidebar_position: 106
---
# `stack pfs guidance`

View File

@@ -0,0 +1,25 @@
---
title: stack pfs guideline-facts
sidebar_position: 117
---
# `stack pfs guideline-facts`
```
Usage: stack pfs guideline-facts [OPTIONS]
Guideline facts from the licensed CPT books (pfs.code_guideline_fact):
selection basis, MDM level, time threshold, add-on and deletion per code and
edition, scope points and the Panel action as paraphrases, each cited by
(edition, page). Book text is never stored.
╭─ Options ────────────────────────────────────────────────────────────────────╮
│ * --family <str> Curated family key. [required] │
│ --limit <int> Cap new model calls (0 = all). [default: 0] │
│ --no-llm Make no model calls; the finished ledger is │
│ replayed. │
│ --retry-failed Re-run ledger entries that failed. │
│ --write │
│ --help Show this message and exit. │
╰──────────────────────────────────────────────────────────────────────────────╯
```

View File

@@ -0,0 +1,25 @@
---
title: stack pfs impacts
sidebar_position: 112
---
# `stack pfs impacts`
```
Usage: stack pfs impacts [OPTIONS]
CMS's estimated impact on total allowed charges by specialty
(pfs.specialty_impact): the 508 text files CMS posts with a rule and the table
printed in the 2012-2019 Federal Register texts.
╭─ Options ────────────────────────────────────────────────────────────────────╮
│ --scan Every CMS 508 impact file in bib / │
│ data/cms/pfs_final and every PFS rule whose FR text │
│ prints the table. │
│ --path <path> One impact file or FR text. │
│ --year <int> Rule year, with --path. [default: 0] │
│ --vintage <str> final | proposed [default: final] │
│ --write │
│ --help Show this message and exit. │
╰──────────────────────────────────────────────────────────────────────────────╯
```

View File

@@ -1,6 +1,6 @@
---
title: stack pfs lineage
sidebar_position: 91
sidebar_position: 104
---
# `stack pfs lineage`
@@ -15,8 +15,11 @@ Usage: stack pfs lineage [OPTIONS]
╭─ Options ────────────────────────────────────────────────────────────────────╮
│ --code <str> │
│ --family <str> A curated or registered family's codes. │
│ --all-payable Every A/R/T code in the newest RVU year, one │
│ inverted pass over fr_anchors. │
│ --all-seen Every code ever seen in any RVU year or CPT │
│ edition (incl. deleted codes). │
│ --limit <int> Only the first N target codes (sorted) — for │
│ smoke runs with --all-payable. │
│ [default: 0] │

View File

@@ -0,0 +1,29 @@
---
title: stack pfs origin
sidebar_position: 116
---
# `stack pfs origin`
```
Usage: stack pfs origin [OPTIONS]
Origin and formation rows per code (pfs.code_origin): the statute, regulation,
program, demonstration, CPT Editorial Panel action, G-code creation or
coverage rule behind them, from Federal Register paragraphs, the licensed CPT
Changes book (paraphrase + page only) and the guidance rows, through a
resumable local-model ledger.
╭─ Options ────────────────────────────────────────────────────────────────────╮
│ * --family <str> Curated family key. [required] │
│ --book <str> Bib item of a licensed EPUB to read (default │
│ 3ANRT854, CPT Changes 2023); repeatable. │
│ --limit <int> Cap new model calls (0 = all). [default: 0] │
│ --dry-run Count candidates; no model calls, no writes. │
│ --no-llm Make no model calls; the finished ledger is │
│ replayed. │
│ --retry-failed Re-run ledger entries that failed. │
│ --write │
│ --help Show this message and exit. │
╰──────────────────────────────────────────────────────────────────────────────╯
```

24
docs/docs/cli/pfs-psps.md Normal file
View File

@@ -0,0 +1,24 @@
---
title: stack pfs psps
sidebar_position: 110
---
# `stack pfs psps`
```
Usage: stack pfs psps [OPTIONS]
Medicare utilization by provider specialty for a family's codes
(pfs.utilization_specialty): the PSPS national totals per code, year and
specialty. --write pulls each (year, code) through the Data API, caches it
under data/cms/psps/ (never overwriting a cached file) and republishes;
without --write it prints what the replica holds.
╭─ Options ────────────────────────────────────────────────────────────────────╮
│ * --family <str> Family key, e.g. HOME-VISITS. [required] │
│ --year <int> Calendar year(s); default every PSPS year. │
│ --write Fetch data.cms.gov, load, cite, republish. │
│ --offline With --write: use the cached JSON, no network. │
│ --help Show this message and exit. │
╰──────────────────────────────────────────────────────────────────────────────╯
```

View File

@@ -1,6 +1,6 @@
---
title: stack pfs reaction
sidebar_position: 94
sidebar_position: 107
---
# `stack pfs reaction`

View File

@@ -1,6 +1,6 @@
---
title: stack pfs review
sidebar_position: 97
sidebar_position: 113
---
# `stack pfs review`

Some files were not shown because too many files have changed in this diff Show More