spb/localvm-research Public License
Running LLMs larger than memory on a consumer Mac — falsification-driven research: margin-gated deferred refinement, out-of-core verification on Apple Silicon. TR-01 published.
Python 63.2%
JavaScript 23.5%
CSS 11.8%
Shell 0.9%
Makefile 0.5%
1 disk0 disk4 2 KB/t tps MB/s KB/t tps MB/s 3 51.56 2593 130.57 5.75 1 0.00 4 16.12 16037 252.46 0.00 0 0.00 5 15.94 16289 253.58 0.00 0 0.00 6 16.00 16647 260.11 0.00 0 0.00 7 15.97 16595 258.75 0.00 0 0.00 8 16.00 16559 258.74 0.00 0 0.00 9 15.92 16556 257.43 0.00 0 0.00 10 16.00 16292 254.57 0.00 0 0.00 11 16.00 16136 252.13 0.00 0 0.00 12 16.00 15981 249.71 0.00 0 0.00 13 16.00 16190 252.96 0.00 0 0.00 14 16.00 15953 249.26 0.00 0 0.00 15 16.00 16627 259.78 0.00 0 0.00 16 16.00 38944 608.50 0.00 0 0.00 17 15.98 62053 968.65 0.00 0 0.00 18 15.99 62016 968.38 0.00 0 0.00 19 16.00 60441 944.39 0.00 0 0.00 20 16.00 62185 971.64 0.00 0 0.00 21 16.00 62076 969.94 0.00 0 0.00 22 16.00 60783 949.75 0.00 0 0.00 23 disk0 disk4 24 KB/t tps MB/s KB/t tps MB/s 25 16.00 62239 972.48 0.00 0 0.00 26 16.00 62163 971.30 0.00 0 0.00 27 16.00 68518 1070.59 0.00 0 0.00 28 16.00 116964 1827.57 0.00 0 0.00 29 16.00 116792 1824.87 0.00 0 0.00 30 15.99 111233 1737.12 0.00 0 0.00 31 16.00 116397 1818.70 0.00 0 0.00 32 16.00 116349 1817.93 0.00 0 0.00 33 16.00 112007 1750.12 0.00 0 0.00 34 16.00 118523 1851.93 0.00 0 0.00 35 16.00 118763 1855.67 0.00 0 0.00 36 16.00 95981 1499.70 0.00 0 0.00 37 16.00 16315 254.92 0.00 0 0.00 38 16.00 16610 259.56 0.00 0 0.00 39 16.00 16558 258.73 0.00 0 0.00 40 16.00 16669 260.46 0.00 0 0.00 41 15.91 16718 259.77 0.00 0 0.00 42 16.00 16505 257.90 0.00 0 0.00 43 16.00 16518 258.09 0.00 0 0.00 44 16.00 16671 260.50 0.00 0 0.00 45 disk0 disk4 46 KB/t tps MB/s KB/t tps MB/s 47 16.00 32941 514.70 0.00 0 0.00 48 16.00 61267 957.29 0.00 0 0.00 49 16.00 63503 992.20 0.00 0 0.00 50 16.00 62117 970.61 0.00 0 0.00 51 16.00 61915 967.42 0.00 0 0.00 52 15.98 61487 959.55 0.00 0 0.00 53 16.00 60847 950.74 0.00 0 0.00 54 16.00 62028 969.18 0.00 0 0.00 55 16.00 62071 969.86 0.00 0 0.00 56 16.00 68604 1071.95 0.00 0 0.00 57 16.00 116187 1815.42 0.00 0 0.00 58 16.00 115969 1812.01 0.00 0 0.00 59 16.00 110965 1733.83 0.00 0 0.00 60 16.00 115952 1811.75 0.00 0 0.00 61 16.00 115886 1810.73 0.00 0 0.00 62 16.00 112896 1764.00 0.00 0 0.00 63 16.00 118474 1851.16 0.00 0 0.00 64 16.00 118319 1848.72 0.00 0 0.00 65 19.49 70678 1345.01 0.00 0 0.00 66 63.98 11797 737.16 0.00 0 0.00 67 disk0 disk4 68 KB/t tps MB/s KB/t tps MB/s 69 64.00 11993 749.59 0.00 0 0.00 70 63.99 11720 732.37 0.00 0 0.00 71 64.00 11755 734.69 0.00 0 0.00 72 64.00 11779 736.17 0.00 0 0.00 73 63.99 11580 723.66 0.00 0 0.00 74 64.00 11730 733.14 0.00 0 0.00 75 62.47 11807 720.33 0.00 0 0.00 76 63.64 28738 1786.06 0.00 0 0.00 77 64.00 44708 2794.25 0.00 0 0.00 78 64.00 44584 2786.34 0.00 0 0.00 79 64.00 43729 2733.08 0.00 0 0.00 80 64.00 44631 2789.39 0.00 0 0.00 81 64.00 44604 2787.64 0.00 0 0.00 82 64.00 43783 2736.42 0.00 0 0.00 83 64.00 44672 2792.01 0.00 0 0.00 84 63.85 46502 2899.71 0.00 0 0.00 85 64.00 79651 4978.13 0.00 0 0.00 86 64.00 71132 4445.76 0.00 0 0.00 87 64.00 80040 5002.52 0.00 0 0.00 88 64.00 78573 4910.65 0.00 0 0.00 89 disk0 disk4 90 KB/t tps MB/s KB/t tps MB/s 91 65.08 76205 4842.99 0.00 0 0.00 92 256.00 8590 2147.52 0.00 0 0.00 93 256.00 8543 2135.76 0.00 0 0.00 94 256.00 8671 2167.82 0.00 0 0.00 95 256.00 9044 2261.02 0.00 0 0.00 96 253.70 9102 2254.99 0.00 0 0.00 97 255.97 9083 2270.61 0.00 0 0.00 98 256.00 8900 2224.91 0.00 0 0.00 99 255.92 8644 2160.19 0.00 0 0.00 100 255.89 8494 2122.49 0.00 0 0.00 101 256.00 27668 6916.90 0.00 0 0.00 102 256.00 30970 7742.42 0.00 0 0.00 103 255.99 30826 7706.35 0.00 0 0.00 104 255.98 40151 10037.11 0.00 0 0.00 105 256.00 43750 10937.48 0.00 0 0.00 106 317.12 25290 7832.23 0.00 0 0.00 107 1023.77 4361 4359.66 0.00 0 0.00 108 1024.00 4365 4364.58 0.00 0 0.00 109 1024.00 4340 4339.73 0.00 0 0.00 110 1017.08 4320 4290.92 0.00 0 0.00 111 disk0 disk4 112 KB/t tps MB/s KB/t tps MB/s 113 1024.00 4340 4339.83 0.00 0 0.00 114 1024.00 11736 11735.95 0.00 0 0.00 115 1024.00 12987 12986.59 0.00 0 0.00 116 1023.77 13115 13111.65 0.00 0 0.00 117 952.44 13471 12529.50 0.00 0 0.00 118 642.62 10570 6633.21 0.00 0 0.00 119 825.39 5566 4486.08 0.00 0 0.00 120 989.60 12392 11975.58 0.00 0 0.00 121 16.00 38208 597.00 0.00 0 0.00 122 15.99 42383 661.92 0.00 0 0.00 123 16.00 37086 579.47 0.00 0 0.00 124 16.00 35432 553.63 0.00 0 0.00 125 16.00 45184 706.00 0.00 0 0.00 126 16.00 37732 589.57 0.00 0 0.00 127 16.00 34148 533.56 0.00 0 0.00 128 16.00 39729 620.77 0.00 0 0.00 129 16.00 40573 633.95 0.00 0 0.00 130 16.00 38236 597.54 0.00 0 0.00 131 16.00 59766 933.83 0.00 0 0.00 132 16.00 60772 949.56 0.00 0 0.00 133 disk0 disk4 134 KB/t tps MB/s KB/t tps MB/s 135 16.00 55729 870.74 0.00 0 0.00 136 16.00 57991 906.11 0.00 0 0.00 137 16.00 59162 924.40 0.00 0 0.00 138 15.97 55768 869.88 0.00 0 0.00 139 16.00 56541 883.44 0.00 0 0.00 140 15.98 59459 927.95 0.00 0 0.00 141 16.00 73704 1151.59 0.00 0 0.00 142 16.00 93571 1462.00 0.00 0 0.00 143 16.00 93667 1463.56 0.00 0 0.00 144 16.00 88656 1385.26 0.00 0 0.00 145 16.00 93727 1464.56 0.00 0 0.00 146 16.00 99183 1549.73 0.00 0 0.00 147 16.00 91423 1428.49 0.00 0 0.00 148 16.00 90901 1420.32 0.00 0 0.00 149 15.98 84671 1321.66 0.00 0 0.00 150 16.00 34224 534.73 0.00 0 0.00 151 16.00 28573 446.45 0.00 0 0.00 152 16.00 29612 462.68 0.00 0 0.00 153 16.00 34311 536.12 0.00 0 0.00 154 16.00 29231 456.73 0.00 0 0.00 155 disk0 disk4 156 KB/t tps MB/s KB/t tps MB/s 157 16.00 29114 454.91 0.00 0 0.00 158 16.00 32543 508.48 0.00 0 0.00 159 16.00 32896 513.99 0.00 0 0.00 160 15.97 28469 443.91 0.00 0 0.00 161 16.00 31565 493.14 0.00 0 0.00 162 16.00 58762 918.13 0.00 0 0.00 163 16.00 59475 929.31 0.00 0 0.00 164 16.00 57386 896.66 0.00 0 0.00 165 16.00 58807 918.86 0.00 0 0.00 166 16.00 58982 921.58 0.00 0 0.00 167 16.00 57015 890.86 0.00 0 0.00 168 16.00 59713 933.01 0.00 0 0.00 169 16.00 60612 947.07 0.00 0 0.00 170 16.01 83808 1309.96 0.00 0 0.00 171 16.00 81735 1277.08 0.00 0 0.00 172 15.97 85750 1337.43 0.00 0 0.00 173 16.00 81619 1275.30 0.00 0 0.00 174 16.00 83357 1302.45 0.00 0 0.00 175 21.82 45496 969.53 0.00 0 0.00 176 63.85 10563 658.60 0.00 0 0.00 177 disk0 disk4 178 KB/t tps MB/s KB/t tps MB/s 179 62.62 10419 637.15 0.00 0 0.00 180 64.00 10160 635.01 0.00 0 0.00 181 63.36 10722 663.43 0.00 0 0.00 182 63.94 11010 687.53 0.00 0 0.00 183 63.99 10610 663.06 0.00 0 0.00 184 63.98 10736 670.77 0.00 0 0.00 185 64.00 10795 674.69 0.00 0 0.00 186 64.00 10196 637.24 0.00 0 0.00 187 63.99 24947 1558.99 0.00 0 0.00 188 64.00 40171 2510.53 0.00 0 0.00 189 64.00 40434 2527.13 0.00 0 0.00 190 64.00 55060 3441.27 0.00 0 0.00 191 64.00 65407 4087.65 0.00 0 0.00 192 128.45 18118 2272.77 0.00 0 0.00 193 255.87 7460 1864.01 0.00 0 0.00 194 255.97 7617 1904.10 0.00 0 0.00 195 255.97 7587 1896.47 0.00 0 0.00 196 256.00 26463 6615.87 0.00 0 0.00 197 255.97 30589 7646.21 0.00 0 0.00 198 787.77 4745 3650.17 0.00 0 0.00 199 disk0 disk4 200 KB/t tps MB/s KB/t tps MB/s 201 1022.82 3440 3436.34 0.00 0 0.00 202 1023.80 4873 4872.41 0.00 0 0.00 203 1023.56 6893 6889.56 0.00 0 0.00 204 960.23 6259 5869.09 0.00 0 0.00 205 1024.00 3372 3371.96 0.00 0 0.00 206 988.85 10505 10144.75 0.00 0 0.00 207 709.43 6718 4654.06 0.00 0 0.00 208 16.00 1 0.02 0.00 0 0.00 209 18.00 4 0.07 0.00 0 0.00 210 0.00 0 0.00 0.00 0 0.00 211 0.00 0 0.00 0.00 0 0.00 212 0.00 0 0.00 0.00 0 0.00 213 0.00 0 0.00 0.00 0 0.00 214 24.00 1 0.02 0.00 0 0.00 215 5.19 100 0.51 0.00 0 0.00 216 8.00 3 0.02 0.00 0 0.00 217 20.00 2 0.04 0.00 0 0.00 218 0.00 0 0.00 0.00 0 0.00 219 18.00 4 0.07 0.00 0 0.00 220 0.00 0 0.00 0.00 0 0.00 221 disk0 disk4 222 KB/t tps MB/s KB/t tps MB/s 223 0.00 0 0.00 0.00 0 0.00 224 0.00 0 0.00 0.00 0 0.00 225 0.00 0 0.00 0.00 0 0.00 226 0.00 0 0.00 0.00 0 0.00 227 7.06 88 0.61 0.00 0 0.00 228 8.00 3 0.02 0.00 0 0.00 229 0.00 0 0.00 0.00 0 0.00 230 0.00 0 0.00 0.00 0 0.00 231 18.00 4 0.07 0.00 0 0.00 232 0.00 0 0.00 0.00 0 0.00 233 4.00 2 0.01 0.00 0 0.00 234 24.00 1 0.02 0.00 0 0.00 235 24.00 1 0.02 0.00 0 0.00 236 0.00 0 0.00 0.00 0 0.00 237 6.08 99 0.59 0.00 0 0.00 238 11.58 133 1.50 0.00 0 0.00 239 0.00 0 0.00 0.00 0 0.00 240 0.00 0 0.00 0.00 0 0.00 241 15.20 5 0.07 0.00 0 0.00 242 4.00 2 0.01 0.00 0 0.00 243 disk0 disk4 244 KB/t tps MB/s KB/t tps MB/s 245 0.00 0 0.00 0.00 0 0.00 246 0.00 0 0.00 0.00 0 0.00 247 0.00 0 0.00 0.00 0 0.00 248 0.00 0 0.00 0.00 0 0.00 249 6.12 161 0.96 0.00 0 0.00 250 16.00 1 0.02 0.00 0 0.00 251 10.67 3 0.03 0.00 0 0.00 252 4.00 1 0.00 0.00 0 0.00 253 18.00 4 0.07 0.00 0 0.00 254 0.00 0 0.00 0.00 0 0.00 255 0.00 0 0.00 0.00 0 0.00 256 0.00 0 0.00 0.00 0 0.00 257 24.00 1 0.02 0.00 0 0.00 258 0.00 0 0.00 0.00 0 0.00 259 0.00 0 0.00 0.00 0 0.00 260 16.00 1 0.02 0.00 0 0.00 261 15.43 7 0.10 0.00 0 0.00 262 0.00 0 0.00 0.00 0 0.00 263 7.93 1345 10.41 0.00 0 0.00 264 0.00 0 0.00 0.00 0 0.00 265 disk0 disk4 266 KB/t tps MB/s KB/t tps MB/s 267 6.06 104 0.62 0.00 0 0.00 268 22.40 5 0.11 0.00 0 0.00 269 0.00 0 0.00 0.00 0 0.00 270 5.66 246 1.36 0.00 0 0.00 271 10.49 234 2.39 0.00 0 0.00 272 16.00 2 0.03 0.00 0 0.00 273 0.00 0 0.00 0.00 0 0.00 274 0.00 0 0.00 0.00 0 0.00 275 18.00 4 0.07 0.00 0 0.00 276 0.00 0 0.00 0.00 0 0.00 277 8.03 128 1.01 0.00 0 0.00 278 4.00 1 0.00 0.00 0 0.00 279 24.00 1 0.02 0.00 0 0.00 280 5.37 66 0.35 0.00 0 0.00 281 0.00 0 0.00 0.00 0 0.00 282 16.00 2 0.03 0.00 0 0.00 283 4.00 2 0.01 0.00 0 0.00 284 24.00 1 0.02 0.00 0 0.00 285 18.00 4 0.07 0.00 0 0.00 286 0.00 0 0.00 0.00 0 0.00 287 disk0 disk4 288 KB/t tps MB/s KB/t tps MB/s 289 132.00 1 0.13 0.00 0 0.00 290 0.00 0 0.00 0.00 0 0.00 291 0.00 0 0.00 0.00 0 0.00 292 16.00 2 0.03 0.00 0 0.00 293 124.80 5 0.61 0.00 0 0.00 294 16.00 1 0.02 0.00 0 0.00 295 0.00 0 0.00 0.00 0 0.00 296 0.00 0 0.00 0.00 0 0.00 297 5.64 193 1.07 0.00 0 0.00 298 6.52 46 0.29 0.00 0 0.00 299 5.91 91 0.53 0.00 0 0.00 300 117.60 5 0.57 0.00 0 0.00 301 12.80 5 0.06 0.00 0 0.00 302 4.00 1 0.00 0.00 0 0.00 303 12.21 261 3.11 0.00 0 0.00 304 951.83 2543 2363.61 0.00 0 0.00 305 905.23 6532 5774.04 0.00 0 0.00 306 16.00 110571 1728.03 0.00 0 0.00 307 16.00 117808 1840.66 0.00 0 0.00 308 16.00 113138 1767.77 0.00 0 0.00 309 disk0 disk4 310 KB/t tps MB/s KB/t tps MB/s 311 16.00 118035 1844.30 0.00 0 0.00 312 16.00 116647 1822.61 0.00 0 0.00 313 16.00 110491 1726.42 0.00 0 0.00 314 16.00 116742 1824.09 0.00 0 0.00 315 16.00 116735 1823.98 0.00 0 0.00 316 16.00 109081 1704.35 0.00 0 0.00 317 16.00 115677 1807.43 0.00 0 0.00 318 16.00 115588 1806.06 0.00 0 0.00 319 16.00 109279 1707.50 0.00 0 0.00 320 16.00 114269 1785.43 0.00 0 0.00 321 16.00 116080 1813.76 0.00 0 0.00 322 16.00 107318 1676.85 0.00 0 0.00 323 16.00 115766 1808.84 0.00 0 0.00 324 16.00 116779 1824.67 0.00 0 0.00 325 46.58 88651 4032.80 0.00 0 0.00 326 64.00 80049 5003.02 0.00 0 0.00 327 64.00 81712 5107.00 0.00 0 0.00 328 64.00 79099 4943.66 0.00 0 0.00 329 64.00 82501 5156.16 0.00 0 0.00 330 210.83 48738 10034.73 0.00 0 0.00 331 disk0 disk4 332 KB/t tps MB/s KB/t tps MB/s 333 255.95 43990 10995.49 0.00 0 0.00 334 508.97 24373 12114.33 0.00 0 0.00 335 1023.68 12748 12743.58 0.00 0 0.00 336 728.33 17860 12703.08 0.00 0 0.00 337