# Wed Oct 28 04:10:23 PM +03 2026 mode=batch server=127.0.0.1:18020
ROW 64conc 128in/512out | e2e=2366.51 tok/s | decode(C/medTPOT)=2542 | medTPOT=25.18 ms | meanTTFT=978.71 ms | dur=55.39s
ROW 64conc 256in/256out | e2e=1823.83 tok/s | decode(C/medTPOT)=2014 | medTPOT=31.77 ms | meanTTFT=1179.14 ms | dur=35.93s
ROW cohort C1 real prompts T=default | e2e=85.82 tok/s | decode(C/meanTPOT)=86.3 | tok/step=- | meanTTFT=77.56 ms
ROW cohort C2 real prompts T=default | e2e=146.50 tok/s | decode(C/meanTPOT)=156.0 | tok/step=- | meanTTFT=155.61 ms
ROW cohort C4 real prompts T=default | e2e=300.32 tok/s | decode(C/meanTPOT)=305.1 | tok/step=- | meanTTFT=160.45 ms
ROW cohort C8 real prompts T=default | e2e=603.31 tok/s | decode(C/meanTPOT)=647.8 | tok/step=- | meanTTFT=246.08 ms
ROW prefill len=1024 conc=1 | 5041 tok/s | meanTTFT=202.57 ms
ROW prefill len=1024 conc=4 | 5498 tok/s | meanTTFT=738.73 ms
ROW prefill len=1024 conc=16 | 5739 tok/s | meanTTFT=2635.03 ms
ROW prefill len=4096 conc=1 | 5354 tok/s | meanTTFT=765.26 ms
ROW prefill len=4096 conc=4 | 5507 tok/s | meanTTFT=2793.49 ms
ROW prefill len=4096 conc=16 | 5503 tok/s | meanTTFT=9364.01 ms
ROW prefill len=16384 conc=1 | 4777 tok/s | meanTTFT=3428.29 ms
ROW prefill len=16384 conc=4 | 4838 tok/s | meanTTFT=11160.33 ms
ROW prefill len=16384 conc=8 | 4848 tok/s | meanTTFT=21303.42 ms
ROW prefill len=65536 conc=1 | 3551 tok/s | meanTTFT=18454.83 ms
ROW prefill len=65536 conc=2 | 3593 tok/s | meanTTFT=32012.36 ms
ROW prefill len=102400 conc=1 | 2998 tok/s | meanTTFT=34152.46 ms
ROW 1x100k/256 | meanTTFT=33089.39 ms | TPOT=14.30 ms
ROW 4x60k/1024 conc4 | e2e=48.09 tok/s | medITL=19.55 ms | dur=85.18s
# raw logs in /home/zeka/ai/benchmarks/hyperqwen-5090-2026-10-28/results/batch-extra/raw
