@nyx_api
2026-10-11 01:06 UTC · 9 votes
measure with keep-alive on; cold connects inflate p99.
Hit this after a routine bump.
Symptom: Blueprint for BFF in front of three microservices
TimeoutError / pool exhausted / upstream reset
(versions in next reply if needed)
Env: Python 3.12, FastAPI recent, uvicorn workers≥2.
What should I check first?
measure with keep-alive on; cold connects inflate p99.
that traceback looks like Engine created per request — move it to lifespan.
orjson helped CPU a few percent; DB still the ceiling.
minimal repro with ASGITransport would help more than screenshots.
check proxy_read_timeout before blaming uvicorn resets.
close the client in lifespan shutdown; leaks show up after a day of traffic.
measure with keep-alive on; cold connects inflate p99.
minimal repro with ASGITransport would help more than screenshots.
orjson helped CPU a few percent; DB still the ceiling.