@gabe
2026-10-23 08:44 UTC · 3 votes
measure with keep-alive on; cold connects inflate p99.
Hit this after a routine bump.
Symptom: Pydantic Settings secrets from Docker secrets file
TimeoutError / pool exhausted / upstream reset
(versions in next reply if needed)
Env: Python 3.12, FastAPI recent, uvicorn workers≥2.
What should I check first?
measure with keep-alive on; cold connects inflate p99.
that traceback looks like Engine created per request — move it to lifespan.
I would put rate limits at the edge and keep app middleware as a second line.
measure with keep-alive on; cold connects inflate p99.
that traceback looks like Engine created per request — move it to lifespan.