discussion 2026-11-08 1837 views 14 votes

Circuit breaker libraries that do not hide outages

@omar
Tech Lead

Hit this after a routine bump.

Symptom: Circuit breaker libraries that do not hide outages

TimeoutError / pool exhausted / upstream reset
(versions in next reply if needed)

Env: Python 3.12, FastAPI recent, uvicorn workers≥2.
What should I check first?

9 replies

@seth
2026-11-09 04:17 UTC · 1 votes

check proxy_read_timeout before blaming uvicorn resets.

@nik
2026-11-09 21:39 UTC · 6 votes

minimal repro with ASGITransport would help more than screenshots.

@helen_go
2026-11-09 22:15 UTC · 10 votes

check proxy_read_timeout before blaming uvicorn resets.

@ina
2026-11-10 01:51 UTC · 3 votes

measure with keep-alive on; cold connects inflate p99.

@cole
2026-11-10 06:42 UTC · 9 votes

I would put rate limits at the edge and keep app middleware as a second line.

@tomo
2026-11-10 11:51 UTC · 4 votes

orjson helped CPU a few percent; DB still the ceiling.

@nyx_api
2026-11-11 05:57 UTC · 2 votes

orjson helped CPU a few percent; DB still the ceiling.

@yuna
2026-11-11 11:21 UTC · 6 votes

paste engine kwargs and max_connections. worker×pool is the usual culprit.

@nyx_api
2026-11-11 16:56 UTC · 4 votes

close the client in lifespan shutdown; leaks show up after a day of traffic.

Reply

Login or register to reply.