SPB Git

spb/wp33_uqo

Public MIT
2.2 KB · 35 lines yaml
1# Prompt families for WP33. "fit" prompts may be used to fit predictors; "heldout" never are.2# Prompts are short synthetic instructions written for this study (no third-party data).3families:4  general:5    fit:6      - "Explain in three sentences why mixture-of-experts models are memory-bound during decoding."7      - "Write a short paragraph describing the climate of Gatineau, Québec, across the four seasons."8      - "Give five practical tips for a first-year university student learning to manage their time."9    heldout:10      - "Describe the main differences between a Mac Studio and a MacBook Pro for scientific computing."11      - "Summarize the history of the Rideau Canal in one paragraph."12  code:13    fit:14      - "def fibonacci(n):\n    \"\"\"Return the n-th Fibonacci number.\"\"\"\n"15      - "Write a Python function that parses a CSV file of timestamps and returns the median inter-arrival time in milliseconds.\n\n```python\n"16      - "Implement an LRU cache class in Python with get and put methods in O(1).\n\n```python\n"17    heldout:18      - "Write a C function that computes the dot product of two float arrays using NEON intrinsics.\n\n```c\n"19      - "Write a bash script that lists the ten largest files under a directory.\n\n```bash\n"20  reasoning:21    fit:22      - "Q: If a train travels 60 km in 45 minutes, what is its average speed in km/h? Think step by step.\nA:"23      - "Q: A rectangle has a perimeter of 36 cm and a length twice its width. What is its area? Think step by step.\nA:"24      - "Q: Three friends split a bill of 84 dollars; one pays twice as much as each of the others. How much does each pay? Think step by step.\nA:"25    heldout:26      - "Q: A tank fills in 6 hours with pipe A and 9 hours with pipe B. How long with both pipes? Think step by step.\nA:"27      - "Q: What is the smallest positive integer divisible by 2, 3, 4, 5 and 6? Think step by step.\nA:"28  multilingual:29    fit:30      - "Les modèles à mélange d'experts activent seulement une fraction de leurs paramètres parce que"31      - "Explique en français pourquoi la mémoire unifiée des puces Apple est utile pour l'inférence des grands modèles de langage."32    heldout:33      - "Décris en quelques phrases le fonctionnement d'un cache LRU."34output_lengths: [64, 256]35
Files · d4fadc193f18d2cc8824349d4ba0438b68347c94
Menu

Theme