homelab/stack
1
0
Fork 0
Code Issues 133 Pull Requests 1 Actions Packages Projects 1 Releases Wiki Activity

llm: FastAPI service + compose + Traefik route #569

New Issue
Closed
opened 2026-07-16 19:26:08 +00:00 by kert · 2 comments
kert commented 2026-07-16 19:26:08 +00:00
Owner
Copy Link

Own service so LangChain deps stay out of the lean api image and tagging restarts don't touch the main API.

Scope

  • llm compose service (uvicorn) at llm.fhirworx.io behind Traefik + oauth2-proxy
  • /health endpoint (checks ollama + pgvector reachability)
  • OTel wiring like the api service (traces → tempo, logs → loki)

Acceptance

  • curl llm.fhirworx.io/health green from compose net; service in dashboard launcher

Spec: docs/superpowers/specs/2026-07-16-llm-module-design.md

Own service so LangChain deps stay out of the lean api image and tagging restarts don't touch the main API. **Scope** - [ ] `llm` compose service (uvicorn) at `llm.fhirworx.io` behind Traefik + oauth2-proxy - [ ] /health endpoint (checks ollama + pgvector reachability) - [ ] OTel wiring like the api service (traces → tempo, logs → loki) **Acceptance** - `curl llm.fhirworx.io/health` green from compose net; service in dashboard launcher Spec: [`docs/superpowers/specs/2026-07-16-llm-module-design.md`](https://git.fhirworx.io/homelab/stack/src/branch/main/docs/superpowers/specs/2026-07-16-llm-module-design.md)
kert added this to the P34: LLM Query — RAG API, CLI, notebook client milestone 2026-07-16 19:26:08 +00:00
kert added the apiinfrallm labels 2026-07-16 19:26:08 +00:00
kert commented 2026-08-13 23:46:54 +00:00
Author
Owner
Copy Link

Status audit (2026-08-13, repo-verified): PARTIAL. Service + compose (compose.yml:670) + Traefik/SSO route (infra/traefik/dynamic/services.yml:10) + OTel + launcher tile all shipped with P34. Missing vs body: /health is static {"status":"ok"} (src/llm/api.py:43) — no ollama/pgvector reachability check.

**Status audit (2026-08-13, repo-verified):** PARTIAL. Service + compose (compose.yml:670) + Traefik/SSO route ([`infra/traefik/dynamic/services.yml:10`](https://git.fhirworx.io/homelab/stack/src/branch/main/infra/traefik/dynamic/services.yml#L10)) + OTel + launcher tile all shipped with P34. Missing vs body: `/health` is static `{"status":"ok"}` ([`src/llm/api.py:43`](https://git.fhirworx.io/homelab/stack/src/branch/main/src/llm/api.py#L43)) — no ollama/pgvector reachability check.
kert commented 2026-09-11 18:55:18 +00:00
Author
Owner
Copy Link

Delivered: the llm compose service (uvicorn llm.api:app, /health, OTel env, Traefik route at llm.fhirworx.io behind oauth2-proxy) is live and rolled through the deploy procedure. Closing.

Delivered: the llm compose service (uvicorn llm.api:app, /health, OTel env, Traefik route at llm.fhirworx.io behind oauth2-proxy) is live and rolled through the deploy procedure. Closing.
kert closed this issue 2026-09-11 18:55:18 +00:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
api
REST API (FastAPI)
 auth
Authentication and authorization
 bib
Bibliography, Zotero, citations
 ci
CI/CD pipelines and Woodpecker plugins
 cli
CLI commands and UX
 cloud
Cloud provider abstraction (AWS, GCP, Azure, self-hosted)
 config
Configuration and wiring
 data
Data loading, CCLF, BCDA, seeds
 databricks
Databricks jobs and deployment
 docs
Documentation and generated references
 image:api
image:docs
image:mc
image:notebooks
image:zotero
infra
lakehouse
Nessie, Polaris, Trino, Iceberg
 llm
llm module — local RAG over comments + Zotero corpus
 notebooks
marimo notebook errors (auto-filed by nb-watcher/nb-integration)
 packaging
Python packaging, optional deps, build system
 pfs
pipeline
Pipeline execution and validation
 pipeline:ci
pipeline:deploy
pipeline:harden
pipeline:infra-ci
pipeline:rebuild-all
pipeline:release
qpp
quality
Testing, coverage, error handling
 step:build
step:deploy
step:hadolint
step:lint
step:publish
step:scan
step:test
step:validate
styles
Charts, figures, visual theming
 tree
Project directory structure and file organization
No Label api infra llm
Milestone
No items
No Milestone P34: LLM Query — RAG API, CLI, notebook client
Projects
Clear projects
No project
Assignees
Clear assignees
dom kert renovate-bot
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: homelab/stack#569
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?