1c2eb6688b
- Replace Elastic Stack with Loki + Promtail throughout - Add LiteLLM (LLM proxy), agentmemory, athome (personal homepage) to applications - Add Raspberry Pi (naruto) to hardware table — Zigbee2MQTT + Mosquitto via Ansible - Update CloudNativePG note to include LiteLLM as consumer - Add raspberry_pi role to repo layout
30 lines
987 B
Markdown
30 lines
987 B
Markdown
# Observability
|
|
|
|
Metrics and logs both surface in Grafana, keeping dashboards and log queries in one place.
|
|
|
|
---
|
|
|
|
## Metrics
|
|
|
|
kube-prometheus-stack runs in the `prometheus` namespace (ArgoCD-managed). Prometheus scrapes all nodes, pods, and control plane components. Grafana has dashboards for cluster overview, node resources, Longhorn, ArgoCD, and Traefik.
|
|
|
|
Node Exporter is deployed via Ansible on every VM including `docker-host11` and the edge VPS, so coverage isn't limited to what's inside Kubernetes.
|
|
|
|
Goldilocks and VPA run alongside and analyze actual resource usage to suggest better request/limit values.
|
|
|
|
Alertmanager routes alerts to Ntfy via a custom webhook bridge.
|
|
|
|
---
|
|
|
|
## Logs
|
|
|
|
Loki runs in the `loki` namespace (single-node, filesystem storage). Promtail runs as a DaemonSet and ships pod logs from every cluster node to Loki. Logs are queryable in Grafana alongside metrics.
|
|
|
|
---
|
|
|
|
## Alerting flow
|
|
|
|
```
|
|
Prometheus Alertmanager ──► Ntfy (push notification)
|
|
```
|