Files
stack/infra/prometheus/targets/services.yml
kert dd4b5c0a80 fix(observability): live bring-up corrections
Surfaced when bringing the stack up alongside corwins.media:

- Promtail: filter docker_sd to compose project=stack. Both stacks share
  the host's docker.sock; without this, every promtail=true container
  from corwins.media also gets ingested into our Loki.
- Container name conflict: corwins.media also defines a "nvidia-exporter"
  container; rename ours to "stack-nvidia-exporter". Service-name DNS
  ("nvidia-exporter:9400") still resolves on the observability network
  so the Prometheus scrape target is unchanged.
- Grafana datasources: provisioning is additive; add deleteDatasources
  block so the legacy Jaeger datasource is removed from the DB.
- Trino prometheus target: /metrics requires auth (Trino rejects
  unauthenticated scrapes). Drop the target until the openmetrics
  catalog is wired with a shared secret. Loki still captures the
  query lifecycle for the data-lake dashboard.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-05-01 12:01:21 -04:00

53 lines
1.1 KiB
YAML

# ── Scrape Target Registry ───────────────────────────
# To add a service: append one entry below.
# Pattern: container_name:port, job label, optional __metrics_path__.
# Traefik
- targets: ['traefik:8080']
labels:
job: traefik
__metrics_path__: /metrics
# Tempo
- targets: ['tempo:3200']
labels:
job: tempo
__metrics_path__: /metrics
# Loki
- targets: ['loki:3100']
labels:
job: loki
# cAdvisor
- targets: ['cadvisor:8080']
labels:
job: cadvisor
# NVIDIA GPU (DCGM)
- targets: ['nvidia-exporter:9400']
labels:
job: nvidia-gpu
# Nessie
- targets: ['nessie:9000']
labels:
job: nessie
__metrics_path__: /q/metrics
# Polaris
- targets: ['polaris:8182']
labels:
job: polaris
__metrics_path__: /q/metrics
# Trino — /metrics requires auth (Trino rejects unauthenticated scrapes
# even with no auth configured). Skipped until the openmetrics catalog
# is wired with a shared secret. Loki still captures query lifecycle
# events for the data-lake dashboard.
# OTel Collector
- targets: ['otel-collector:8889']
labels:
job: otel-collector