homelab/stack
1
0
Fork 0
Code Issues 70 Pull Requests 1 Actions Packages Projects 1 Releases Wiki Activity

llm: retrieval endpoints — /search, /similar #570

New Issue
Closed
opened 2026-07-16 19:26:08 +00:00 by kert · 2 comments
kert commented 2026-07-16 19:26:08 +00:00
Owner
Copy Link

Similarity search over the comment + corpus collections.

Scope

  • /search: query text + metadata filters (docket, rule, year, doctype, collection), pagination
  • /similar/{key}: nearest neighbors of an existing bib item
  • results cite bib item keys + chunk snippets + distances

Acceptance

  • filtered search returns correct docket-scoped results on the pilot docket; p50 latency < 300ms

Spec: docs/superpowers/specs/2026-07-16-llm-module-design.md

Similarity search over the comment + corpus collections. **Scope** - [ ] `/search`: query text + metadata filters (docket, rule, year, doctype, collection), pagination - [ ] `/similar/{key}`: nearest neighbors of an existing bib item - [ ] results cite bib item keys + chunk snippets + distances **Acceptance** - filtered search returns correct docket-scoped results on the pilot docket; p50 latency < 300ms Spec: [`docs/superpowers/specs/2026-07-16-llm-module-design.md`](https://git.fhirworx.io/homelab/stack/src/branch/main/docs/superpowers/specs/2026-07-16-llm-module-design.md)
kert added this to the P34: LLM Query — RAG API, CLI, notebook client milestone 2026-07-16 19:26:08 +00:00
kert added the apillm labels 2026-07-16 19:26:08 +00:00
kert commented 2026-08-13 23:46:54 +00:00
Author
Owner
Copy Link

Status audit (2026-08-13, repo-verified): NOT DONE. api.py exposes only /health, /, /whoami, /chat. Retrieval exists internally (llm/rag.py:29 retrieve, k=6, comments collection) but no /search or /similar HTTP endpoints, no metadata filters, no pagination. Note: the rules pgvector collection added by P36 (#595) will want the same filters.

**Status audit (2026-08-13, repo-verified):** NOT DONE. api.py exposes only /health, /, /whoami, /chat. Retrieval exists internally ([`llm/rag.py:29`](https://git.fhirworx.io/homelab/stack/src/branch/main/src/llm/rag.py#L29) retrieve, k=6, comments collection) but no /search or /similar HTTP endpoints, no metadata filters, no pagination. Note: the `rules` pgvector collection added by P36 (#595) will want the same filters.
kert commented 2026-09-11 21:18:47 +00:00
Author
Owner
Copy Link

Done (192274e, merged to main): GET /search?q=&collection=all|comments|rules|corpus&docket=&item_key=&year=&kind=&limit=&offset= and GET /similar/{key} on the llm service (src/llm/search.py). One embedding per request, per-collection overfetch with docket/item_key/kind pushed into the pgvector store filter and year applied on the chunk date, merged by distance, paginated; /similar averages up to three of the item's own chunk vectors and excludes the item; results are the chat's source dicts (label, kind, url, title, date, docket, item_key, p_id/seq, snippet) plus distance. Acceptance: docket-scoped search on CMS-2023-0121 returned only that docket; p50 ≈ 120 ms over 5 in-process calls (first call 2.8 s includes model warm-up). 57 tests. Note: total is the page length (no COUNT query). Needs the llm image rolled to reach the live service.

Done (192274e, merged to main): GET /search?q=&collection=all|comments|rules|corpus&docket=&item_key=&year=&kind=&limit=&offset= and GET /similar/{key} on the llm service (src/llm/search.py). One embedding per request, per-collection overfetch with docket/item_key/kind pushed into the pgvector store filter and year applied on the chunk date, merged by distance, paginated; /similar averages up to three of the item's own chunk vectors and excludes the item; results are the chat's source dicts (label, kind, url, title, date, docket, item_key, p_id/seq, snippet) plus distance. Acceptance: docket-scoped search on CMS-2023-0121 returned only that docket; p50 ≈ 120 ms over 5 in-process calls (first call 2.8 s includes model warm-up). 57 tests. Note: total is the page length (no COUNT query). Needs the llm image rolled to reach the live service.
kert closed this issue 2026-09-11 21:18:47 +00:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
api
REST API (FastAPI)
 auth
Authentication and authorization
 bib
Bibliography, Zotero, citations
 ci
CI/CD pipelines and Woodpecker plugins
 cli
CLI commands and UX
 cloud
Cloud provider abstraction (AWS, GCP, Azure, self-hosted)
 config
Configuration and wiring
 data
Data loading, CCLF, BCDA, seeds
 databricks
Databricks jobs and deployment
 docs
Documentation and generated references
 image:api
image:docs
image:mc
image:notebooks
image:zotero
infra
lakehouse
Nessie, Polaris, Trino, Iceberg
 llm
llm module — local RAG over comments + Zotero corpus
 notebooks
marimo notebook errors (auto-filed by nb-watcher/nb-integration)
 packaging
Python packaging, optional deps, build system
 pfs
pipeline
Pipeline execution and validation
 pipeline:ci
pipeline:deploy
pipeline:harden
pipeline:infra-ci
pipeline:rebuild-all
pipeline:release
qpp
quality
Testing, coverage, error handling
 step:build
step:deploy
step:hadolint
step:lint
step:publish
step:scan
step:test
step:validate
styles
Charts, figures, visual theming
 tree
Project directory structure and file organization
No Label api llm
Milestone
No items
No Milestone P34: LLM Query — RAG API, CLI, notebook client
Projects
Clear projects
No project
Assignees
Clear assignees
kert renovate-bot
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: homelab/stack#570
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?