Commit Graph

37 Commits

Author SHA1 Message Date
855321bebf FIX(prometheus): ignore relabelings default value diff in ServiceMonitor 2026-01-08 00:15:09 +09:00
4286296591 PERF(resources): remove CPU limits - keep memory limits only
- CPU throttling prevents app startup, not crashes
- Memory OOM is the real cascading failure cause
- CPU request ensures fair scheduling
2026-01-07 23:48:35 +09:00
69dc3b34be REFACTOR(secrets): flatten Vault paths
- Change secret paths from <category>/<app> to <app>
- monitoring/alertmanager → alertmanager
- monitoring/grafana → grafana
- databases/postgresql → postgresql
2026-01-06 16:52:58 +09:00
7888aeff36 REFACTOR(repo): move vault/ to manifests/
- Move ExternalSecret files from vault/ to manifests/secret.yaml
- Update kustomization.yaml references
- Remove vault/ folders

Apps: alertmanager, grafana, prometheus
2026-01-06 16:42:33 +09:00
28ba50d1a3 REFACTOR(repo): observability repo structure
- Add application.yaml for ArgoCD app-of-apps
- Add kustomization.yaml with observability components
- Add renovate.json for automated updates
- Update all component argocd.yaml repoURLs to observability repo

Components: prometheus, alertmanager, grafana, loki, promtail,
node-exporter, kube-state-metrics, goldilocks, uptime-kuma, vpa
2026-01-05 00:40:01 +09:00
864c2c45d8 REFACTOR(alertmanager): change storageClass
- Update storageClass to local-path-retain
- Change storage backend configuration
2026-01-05 00:40:01 +09:00
200c6e97ae REFACTOR(repo): migrate repoURL to K3S-HOME
- Update repository URL to K3S-HOME organization
- Change from personal to organization repo
2026-01-05 00:40:01 +09:00
e4b477a510 REFACTOR(longhorn): migrate to local-path
- alertmanager, grafana, loki, prometheus: storageClass -> local-path-retain
- Change storage backend configuration
2026-01-05 00:40:01 +09:00
60dfa5cf7b CHORE(resources): disable apiserver/etcd metrics
- Disable kubeApiServer ServiceMonitor (~37k series)
- Disable kubeEtcd ServiceMonitor (~26k series)
- Expected memory reduction: ~30-40%
2026-01-05 00:40:01 +09:00
658a81b4c1 REFACTOR(repo): remove ServerSideApply
- Remove ServerSideApply configuration
- Add RespectIgnoreDifferences syncOption
2026-01-05 00:40:01 +09:00
2c841c2b6e FEAT(vault): add ignoreDiff for ES/SM
- Add ignoreDifferences for ExternalSecret
- Prevent ArgoCD sync drift
2026-01-05 00:40:01 +09:00
d8360c10a1 FEAT(repo): add cAdvisor metrics_path relabel
- Add relabeling for cAdvisor metrics
- Support recording rules
2026-01-05 00:40:01 +09:00
1befeb68c4 FEAT(prometheus): add ServerSideApply
- Enable ServerSideApply for CRD annotation handling
- Fix resource management
2026-01-05 00:40:01 +09:00
cd575d94a6 PERF(prometheus): optimize prometheus memory usage
- Increase scrapeInterval: 30s → 60s
- Increase evaluationInterval: 30s → 60s
- Reduce retention: 7d → 3d
- Add memory limit: 1Gi (prevent unlimited growth)
- Increase memory request: 256Mi → 512Mi (reflect actual usage)
2026-01-05 00:40:01 +09:00
2ec87ca7a5 PERF(prometheus): increase Prometheus CPU request from 50m to 200m
- Increase CPU request based on actual usage
- Optimize resource allocation
2026-01-05 00:40:01 +09:00
b3ad6338ac FIX(prometheus): grafana prometheus datasource
- url with full namespace
2026-01-04 23:38:05 +09:00
340c6fea11 FIX(alertmanager): prometheus alertingendpoints
- to connect to alertma...
2026-01-04 23:38:05 +09:00
bc1cf0d223 REFACTOR(argocd): remove serversideapply
- from argocd applications
2026-01-04 23:38:05 +09:00
79b34aaca6 FEAT(prometheus): add ServerSideApply
- Enable ServerSideApply for CRD annotation handling
- Fix resource management
2026-01-04 23:38:05 +09:00
0cb7438d79 CHORE(external-secrets): update ESO API version from v1beta1 to v1
- Update ExternalSecret API version
- Migrate to stable API
2026-01-04 23:38:05 +09:00
c75798065f CHORE(postgresql): update PostgreSQL namespace reference
- Update namespace reference for PostgreSQL
- Fix service discovery
2026-01-04 23:38:05 +09:00
ea4152a0d6 REFACTOR(gitea): migrate repoURL from Gitea
- to GitHub
2026-01-04 23:38:05 +09:00
5ec1a3323d REFACTOR(goldilocks): use managedNamespaceMetad...
- Remove namespace.yaml files
- Add managedNamespaceMetadata with Goldilocks label
- Set CreateNamespace=true in syncOptions
- Update kustomization.yaml to remove namespace.yaml references
2026-01-04 23:38:05 +09:00
ac2abde8b5 FIX(prometheus): servicemonitor namespace
- from monitoring to prometheus
2026-01-04 23:38:05 +09:00
bbf6fa5001 CHORE(repo): clean kustomization files
- Remove unused entries from kustomization
- Clean up configuration
2026-01-04 23:38:05 +09:00
a2e0ef4477 REFACTOR(prometheus): remove path sources
- from grafana and prometheus...
- Remove 'path: grafana' source from grafana Application
- Remove 'path: prometheus' source from prometheus Application
- ExternalSecret and Ingress will be managed manually via kubectl apply
  -k
- Fixes circular dependency issue causing Progressing state
2026-01-04 23:38:05 +09:00
4e0f27192f FIX(prometheus): namespaces in grafana
- and prometheus resources
- Update grafana ExternalSecret namespace: monitoring → grafana
- Update grafana Ingress namespace: monitoring → grafana
- Update prometheus ExternalSecret namespace: monitoring → prometheus
- Aligns with per-app namespace strategy
2026-01-04 23:38:05 +09:00
2309254fc9 FIX(repo): circular reference in app kustomizes
- Comment out argocd.yaml in all app kustomization.yaml files
- Prevents circular reference when apps have 'path:' source (grafana,
  prometheus)
- ArgoCD Applications are managed manually, not via kustomize
2026-01-04 23:38:05 +09:00
b4ec13618a REFACTOR(repo): to independent app management
- pattern
- monitoring/kustomization.yaml now only manages application.yaml (App
  of Apps)
- Each app independently manages its own ArgoCD Application via
  kustomization.yaml
- Apps are fully self-contained: argocd.yaml, namespace.yaml, and app-
  specific resources
- Cleaner separation: no central app list to maintain
2026-01-04 23:38:05 +09:00
078850f77a FIX(argocd): sharedresourcewarning by referencing
- argocd.yaml files d...
- Change monitoring/kustomization.yaml to reference argocd.yaml files
  instead of folders
- Comment out argocd.yaml in each app's kustomization.yaml
- Matches applications folder pattern to avoid resource conflicts
2026-01-04 23:38:05 +09:00
6dec7e0a46 REFACTOR(argocd): monitoring apps
- to self-manage ArgoCD Applications
- Each app now includes its own argocd.yaml in kustomization.yaml
- Main monitoring/kustomization.yaml references app folders instead of
  individual argocd.yaml files
- Better separation of concerns - each app is self-contained and
  independently managed
2026-01-04 23:38:05 +09:00
5c4676ca9a REFACTOR(repo): restructure monitoring folder
- and add namespace resou...
- Remove argocd/, helm-values/, ingress/ subdirectories
- Move files to parent directory (argocd.yaml, helm-values.yaml,
  ingress.yaml)
- Update helm valueFiles paths in ArgoCD Applications
- Add namespace.yaml to all applications with Goldilocks labels
- Update destination namespaces to match folder names
- Update kustomization.yaml files to reference new structure
2026-01-04 23:38:05 +09:00
5df6fc7b52 FIX(postgresql): pg-password ExternalSecret
- to use databases/...
2026-01-04 23:38:05 +09:00
1a2f15c468 REFACTOR(longhorn): migrate monitoring PVCs
- from local-path to Longhorn
- Grafana: 2Gi (replica=3)
- Loki: 10Gi (replica=3)
- Alertmanager: 1Gi (replica=3)
- Prometheus: 5Gi (replica=3)
- Use dedicated 50GB Longhorn storage on each node
2026-01-04 23:38:05 +09:00
b416b76c18 REFACTOR(postgresql): vault secret update secret
- paths (monitoring/po...
2025-12-17 21:32:32 +09:00
a11a9ab329 CHORE(argocd): update ArgoCD applications
- to point to monitoring repo...
2025-12-17 15:12:56 +09:00
baee94b69d INIT(repo): monitoring stack setup 2025-12-17 15:06:58 +09:00