Restore 304 performance after fixing `FileResponse` replace race #9009

Job	Run time
Generate llhttp sources	8s
Linter	1m 53s
Benchmark	5m 19s
Test (3.9, ubuntu, false)	3m 54s
Test (3.9, macos, false)	4m 54s
Test (3.9, windows, false)	5m 10s
Test (3.9, Y, ubuntu, false)	4m 16s
Test (3.10, ubuntu, false)	3m 32s
Test (3.10, macos, false)	3m 23s
Test (3.10, windows, false)	4m 15s
Test (3.10, Y, ubuntu, false)	4m 7s
Test (3.11, ubuntu, false)	3m 38s
Test (3.11, macos, false)	2m 55s
Test (3.11, windows, false)	4m 22s
Test (3.11, Y, ubuntu, false)	4m 7s
Test (3.12, ubuntu, false)	4m 15s
Test (3.12, macos, false)	3m 42s
Test (3.12, windows, false)	5m 3s
Test (3.12, Y, ubuntu, false)	4m 25s
Test (3.13, ubuntu, false)	3m 57s
Test (3.13, macos, false)	3m 52s
Test (3.13, windows, false)	5m 30s
Test (3.13, Y, ubuntu, false)	4m 17s
Test (pypy-3.9, Y, ubuntu, false)	8m 3s
check	2s
Pre-Deploy	0s
Build wheels on ${{ matrix.os }} ${{ matrix.qemu }}	0s
Tarball	0s
Deploy	0s
	1h 38m 59s

Provide feedback