SPB Git

spb/wp33_uqo

Public MIT
331 B · 7 lines text
1mlx_lm       sync-eval decode 370.4 tok/s   async 468.7 tok/s2titan_fast   sync-eval decode 380.3 tok/s   async 479.0 tok/s3titan_ident  sync-eval decode 384.6 tok/s   async 475.9 tok/s4titan_i32    sync-eval decode 365.2 tok/s5titan_map32  sync-eval decode 352.2 tok/s   async 469.4 tok/s6dtype of mlx-lm indices: mlx.core.uint327
Files · cace0649d23ae4b05f5d0ecfe5e53d0fab557853
Menu

Theme