Increased 4xx errors

Uptime Impact: 33 minutes
Resolved
Resolved

For exactly 33 mins between 20:26 UTC and 20:59 UTC a misonfigured load balancer rate limit caused API requests to be rejected resulting in customers being unable to access the API, dashboard and authentication to fail. The load balancer distributing traffic to our API has a rate limiter that was configured incorrectly causing requests to be rejected. The rate limit was a legacy configuration that applied rate limits across an incorrect source IP header causing requests to be rejected globally.

Avatar for
Identified

We're experiencing an increase in rate limiting errors to customers resulting in increased 4xx errors and authentication failures.

Avatar for
Began at:

Affected components
  • API