Files
stack/docs/docs/cli/prisma-vpn.md
kert c354047e17 feat(llm): golden-set gate for theme tagging — llm.tageval, tests/llm/golden_themes.yaml, stack llm eval-tags; vocab v2 (refs #577)
Vocabulary v2 adds four themes the CY2027 docket's letters made
unmissable: modifier-25-same-day, lactation-services, health-coaching,
radiation-therapy (57 themes).

tests/llm/golden_themes.yaml: 39 CMS-2026-2377 comments labelled by
reading their opening text — expected themes (must carry) and
acceptable ones (allowed, not required). llm.tageval scores
predictions per slug (tp / fp outside expected∪acceptable / fn),
micro precision/recall/F1 and the abstain rate, and gate() applies the
spec thresholds (micro-F1 ≥ 0.70; no theme with support ≥ 5 under 0.5
precision). Predictions come from what the last run stored on the bib
items (CI, no model calls) or --live through the chain.

stack llm eval-tags [--golden] [--live] [--limit] exits 1 when the gate
fails.
2026-09-22 16:58:41 -04:00

1.9 KiB

title, sidebar_position
title sidebar_position
stack prisma vpn 97

stack prisma vpn

Usage: stack prisma vpn [OPTIONS] COMMAND [ARGS]...                            
                                                                                
 DigitalOcean SOCKS5 exit for fallback fetch (SSH tunnel, no sudo needed).      
                                                                                
╭─ Options ────────────────────────────────────────────────────────────────────╮
│ --help          Show this message and exit.                                  │
╰──────────────────────────────────────────────────────────────────────────────╯
╭─ Commands ───────────────────────────────────────────────────────────────────╮
│ up             Provision the droplet, wait for dante, wire Zotero up.        │
│ down           Destroy the droplet and wipe local state.                     │
│ status         Report whether a PRISMA VPN droplet is currently tracked.     │
│ attach-zotero  Start the sidecar tunnel + rewire Zotero prefs.               │
│ detach-zotero  Stop the sidecar and restore Zotero's pre-proxy prefs.        │
│ verify         Open the tunnel, curl ifconfig.co, print egress, close.       │
╰──────────────────────────────────────────────────────────────────────────────╯