SPB Git

spb/wp33_uqo

Public MIT
1.4 KB · 27 lines latex
1\begin{table}[t]2\centering\small3\caption{Cold-NVMe tier on the M5 Max laptop (purge + F\_NOCACHE), OLMoE 4-bit, held-out general/code/reasoning prompts, 64 tokens, 12 runs per row.}4\label{tab:cold}5\begin{tabular}{llrrrrrr}6\toprule7Backend & cfg & $n$ & decode tok/s (median) & p95 ITL ms & hit & stall s & TTFT ms \\8\midrule9titan & C=16, none, m=8, cold & 12 & 36.4 & 35.2 & 0.526 & 1.15 & 371 \\10titan & C=16, prev\_rank, m=16, cold & 12 & 19.1 & 62.2 & 0.647 & 1.69 & 467 \\11titan & C=16, transition, m=8, cold & 12 & 27.9 & 45.2 & 0.670 & 1.24 & 446 \\12titan & C=16, transition2, m=16, cold & 12 & 25.9 & 50.8 & 0.736 & 1.21 & 423 \\13titan & C=16, transition2, m=8, cold & 12 & 35.0 & 35.7 & 0.654 & 0.77 & 339 \\14titan & C=16, transition3, m=8, cold & 12 & 29.1 & 43.4 & 0.639 & 1.17 & 393 \\15titan & C=32, none, m=8, cold & 12 & 50.6 & 25.9 & 0.788 & 0.62 & 236 \\16titan & C=32, prev\_rank, m=16, cold & 12 & 28.4 & 45.7 & 0.785 & 0.91 & 263 \\17titan & C=32, transition, m=8, cold & 12 & 41.3 & 30.4 & 0.825 & 0.63 & 249 \\18titan & C=32, transition2, m=16, cold & 12 & 41.0 & 32.3 & 0.848 & 0.56 & 243 \\19titan & C=32, transition2, m=8, cold & 12 & 42.0 & 30.3 & 0.820 & 0.59 & 239 \\20titan & C=32, transition3, m=8, cold & 12 & 41.0 & 31.2 & 0.813 & 0.60 & 242 \\21\bottomrule22\end{tabular}23\begin{tablenotes}\footnotesize24\item Sources: \code{benchmarks/raw/gateC/cold\_nvme\_laptop/sweep.jsonl}.25\end{tablenotes}26\end{table}27
Files · main
Menu

Theme