ROW en C1 T=default | e2e=120.63 tok/s | decode(C/meanTPOT)=123.2 | tok/step=2.61 | meanTTFT=103.60 ms
ROW tr C1 T=default | e2e=123.63 tok/s | decode(C/meanTPOT)=125.3 | tok/step=2.71 | meanTTFT=116.73 ms
ROW en C4 T=default | e2e=350.45 tok/s | decode(C/meanTPOT)=401.2 | tok/step=2.53 | meanTTFT=214.59 ms
ROW tr C4 T=default | e2e=371.96 tok/s | decode(C/meanTPOT)=409.8 | tok/step=2.63 | meanTTFT=248.35 ms
ROW en C8 T=default | e2e=577.50 tok/s | decode(C/meanTPOT)=708.0 | tok/step=2.55 | meanTTFT=444.38 ms
ROW tr C8 T=default | e2e=611.08 tok/s | decode(C/meanTPOT)=676.2 | tok/step=2.57 | meanTTFT=460.41 ms
