@cole
2026-11-13 08:53 UTC · 2 votes
measure with keep-alive on; cold connects inflate p99.
Hit this after a routine bump.
Symptom: Cache-Control for public OpenAPI JSON — follow-up #19
TimeoutError / pool exhausted / upstream reset
(versions in next reply if needed)
Env: Python 3.12, FastAPI recent, uvicorn workers≥2.
What should I check first?
measure with keep-alive on; cold connects inflate p99.
check proxy_read_timeout before blaming uvicorn resets.
measure with keep-alive on; cold connects inflate p99.
measure with keep-alive on; cold connects inflate p99.