spb/note-spboucher-ai
Public
1{2 "id": "knowledge_synthesis",3 "category": "Knowledge synthesis",4 "grader": "synthesis",5 "max_tokens": 4000,6 "prompt": "You are given three excerpts from the user's private notes. Write a short synthesis (120-200 words) answering: 'What do we know about the inference speed of the TITAN-MoE runtime, and are the notes consistent?' Cite sources inline as [S1], [S2], [S3]. Explicitly flag any contradiction between the sources and say which figure is more recent.\n\n[S1] (2026-10-20, lab notebook) First end-to-end run of TITAN-MoE on the M3 Ultra: 41 tokens/s on the 30B-A3B model, prefetching one layer ahead gave no gain.\n[S2] (2026-10-28, benchmark sheet) After the contiguous SSD layout change, TITAN-MoE reaches 58 tokens/s on the same 30B-A3B model and bit-exact parity with mlx-lm was confirmed.\n[S3] (2026-10-15, meeting notes) Thunderbolt networking is not available between the nodes; only 1 GbE, so multi-node expert streaming was abandoned.",7 "must_contain": [8 "[S1]",9 "[S2]",10 "[S3]",11 "41",12 "58"13 ],14 "words": [15 100,16 23017 ]18}