SPB Git
1.1 KB · 18 lines json
1{2  "id": "knowledge_synthesis",3  "category": "Knowledge synthesis",4  "grader": "synthesis",5  "max_tokens": 4000,6  "prompt": "You are given three excerpts from the user's private notes. Write a short synthesis (120-200 words) answering: 'What do we know about the inference speed of the TITAN-MoE runtime, and are the notes consistent?' Cite sources inline as [S1], [S2], [S3]. Explicitly flag any contradiction between the sources and say which figure is more recent.\n\n[S1] (2026-10-20, lab notebook) First end-to-end run of TITAN-MoE on the M3 Ultra: 41 tokens/s on the 30B-A3B model, prefetching one layer ahead gave no gain.\n[S2] (2026-10-28, benchmark sheet) After the contiguous SSD layout change, TITAN-MoE reaches 58 tokens/s on the same 30B-A3B model and bit-exact parity with mlx-lm was confirmed.\n[S3] (2026-10-15, meeting notes) Thunderbolt networking is not available between the nodes; only 1 GbE, so multi-node expert streaming was abandoned.",7  "must_contain": [8    "[S1]",9    "[S2]",10    "[S3]",11    "41",12    "58"13  ],14  "words": [15    100,16    23017  ]18}
Files · main
Menu

Theme