@gabe
2026-10-09 22:32 UTC · 4 votes
check proxy_read_timeout before blaming uvicorn resets.
Hit this after a routine bump.
Symptom: Measuring p99 with keep-alive connections — follow-up #28
TimeoutError / pool exhausted / upstream reset
(versions in next reply if needed)
Env: Python 3.12, FastAPI recent, uvicorn workers≥2.
What should I check first?
check proxy_read_timeout before blaming uvicorn resets.
paste engine kwargs and max_connections. worker×pool is the usual culprit.
orjson helped CPU a few percent; DB still the ceiling.
minimal repro with ASGITransport would help more than screenshots.
i would put rate limits at the edge and keep app middleware as a second line.
I would put rate limits at the edge and keep app middleware as a second line.