Files
stack/docs/docs/cli/zot.md
kert c354047e17 feat(llm): golden-set gate for theme tagging — llm.tageval, tests/llm/golden_themes.yaml, stack llm eval-tags; vocab v2 (refs #577)
Vocabulary v2 adds four themes the CY2027 docket's letters made
unmissable: modifier-25-same-day, lactation-services, health-coaching,
radiation-therapy (57 themes).

tests/llm/golden_themes.yaml: 39 CMS-2026-2377 comments labelled by
reading their opening text — expected themes (must carry) and
acceptable ones (allowed, not required). llm.tageval scores
predictions per slug (tp / fp outside expected∪acceptable / fn),
micro precision/recall/F1 and the abstain rate, and gate() applies the
spec thresholds (micro-F1 ≥ 0.70; no theme with support ≥ 5 under 0.5
precision). Predictions come from what the last run stored on the bib
items (CI, no model calls) or --live through the chain.

stack llm eval-tags [--golden] [--live] [--limit] exits 1 when the gate
fails.
2026-09-22 16:58:41 -04:00

2.0 KiB

title, sidebar_position
title sidebar_position
stack zot 81

stack zot

Usage: stack zot [OPTIONS] COMMAND [ARGS]...                                   
                                                                                
 Zotero database maintenance.                                                   
                                                                                
╭─ Options ────────────────────────────────────────────────────────────────────╮
│ --help          Show this message and exit.                                  │
╰──────────────────────────────────────────────────────────────────────────────╯
╭─ Commands ───────────────────────────────────────────────────────────────────╮
│ dump-schema    Dump itemType / field / creatorType IDs.                      │
│ fix-dates      Normalize item timestamps to ISO 8601 + install auto-fix      │
│                triggers.                                                     │
│ fix-keys       Replace invalid Zotero object keys (0/1/O/lowercase → valid). │
│ fix-fields     Remap base-field rows to type-specific fieldIDs; drop         │
│                orphans.                                                      │
│ verify-parity  Check that ``zot.db`` constants match the live Zotero schema. │
╰──────────────────────────────────────────────────────────────────────────────╯