Skip to content
Merged
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
21 changes: 1 addition & 20 deletions helm/bundles/cortex-placement-shim/templates/alerts.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -104,7 +104,7 @@ spec:
degraded placement functionality until the issue is resolved.

# Upstream HTTP errors (shim -> Placement API)
- alert: CortexPlacementShimUpstreamHttp5xxTooHigh
- alert: CortexPlacementShimUpstreamHttp500sTooHigh
expr: rate(cortex_placement_shim_upstream_request_duration_seconds_count{service="cortex-placement-shim-metrics-service", responsecode=~"5.."}[5m]) > 0.1
for: 5m
labels:
Expand All @@ -122,25 +122,6 @@ spec:
problems. The shim forwards these errors to its clients. Investigate
the Placement API service health and logs.

- alert: CortexPlacementShimUpstreamUnreachable
expr: rate(cortex_placement_shim_upstream_request_duration_seconds_count{service="cortex-placement-shim-metrics-service", responsecode="502"}[5m]) > 0.1
for: 5m
labels:
context: upstream
dashboard: cortex-placement-shim-status-dashboard/cortex-placement-shim-status-dashboard
service: cortex
severity: warning
support_group: workload-management
playbook: docs/support/playbook/cortex/alerts/shim-api-errors
annotations:
summary: "Placement Shim cannot reach the upstream Placement API"
description: >
The Placement Shim is unable to reach the upstream OpenStack Placement
API and is returning 502 Bad Gateway errors. This means all forwarded
requests are failing. Check network connectivity, the Placement API
service endpoint configuration, and whether the upstream service is
running.

# Latency alerts
- alert: CortexPlacementShimDownstreamLatencyTooHigh
expr: |
Expand Down