SPB Git

spb/wp33_uqo

Public MIT
8.8 KB · 85 lines yaml
1# Workload v2 (2026-11-01): larger prompt set for predictor fitting and held-out evaluation. Synthetic prompts written for this2# study. Families: general, code, reasoning, multilingual, longctx (long instructions), drift (domain switch mid-prompt).3families:4  general:5    fit:6      - "Explain in three sentences why mixture-of-experts models are memory-bound during decoding."7      - "Write a short paragraph describing the climate of Gatineau, Québec, across the four seasons."8      - "Give five practical tips for a first-year university student learning to manage their time."9      - "Describe how a hydroelectric dam converts the energy of falling water into electricity."10      - "Write a friendly email inviting colleagues to a Friday afternoon seminar on housing economics."11      - "What are the main arguments for and against remote work in knowledge industries?"12      - "Explain the difference between weather and climate to a ten-year-old."13      - "Draft a two-paragraph product description for a quiet mechanical keyboard."14      - "List the steps to prepare a simple vegetable soup, with approximate timings."15      - "Why do leaves change colour in autumn? Answer in one paragraph."16    heldout:17      - "Describe the main differences between a Mac Studio and a MacBook Pro for scientific computing."18      - "Summarize the history of the Rideau Canal in one paragraph."19      - "Write a short motivational note for someone starting to learn the piano as an adult."20      - "What should a visitor know before hiking in Gatineau Park in winter?"21  code:22    fit:23      - "def fibonacci(n):\n    \"\"\"Return the n-th Fibonacci number.\"\"\"\n"24      - "Write a Python function that parses a CSV file of timestamps and returns the median inter-arrival time in milliseconds.\n\n```python\n"25      - "Implement an LRU cache class in Python with get and put methods in O(1).\n\n```python\n"26      - "Write a Python script that walks a directory tree and reports the total size per file extension.\n\n```python\n"27      - "Implement binary search over a sorted list of integers in Python and return the insertion index when absent.\n\n```python\n"28      - "Write a SQL query that returns the three most recent orders per customer from tables orders(customer_id, order_date, amount).\n\n```sql\n"29      - "Write a JavaScript function that debounces another function with a configurable delay.\n\n```javascript\n"30      - "Write a Rust function that counts word frequencies in a string and returns them sorted by count.\n\n```rust\n"31      - "class Matrix:\n    \"\"\"Minimal dense matrix with multiplication and transpose.\"\"\"\n    def __init__(self, rows):\n"32      - "Write a Python generator that yields sliding windows of size k over an iterable.\n\n```python\n"33    heldout:34      - "Write a C function that computes the dot product of two float arrays using NEON intrinsics.\n\n```c\n"35      - "Write a bash script that lists the ten largest files under a directory.\n\n```bash\n"36      - "Implement Dijkstra's shortest path in Python using a binary heap.\n\n```python\n"37      - "Write a Go function that reads lines from stdin and prints the longest one.\n\n```go\n"38  reasoning:39    fit:40      - "Q: If a train travels 60 km in 45 minutes, what is its average speed in km/h? Think step by step.\nA:"41      - "Q: A rectangle has a perimeter of 36 cm and a length twice its width. What is its area? Think step by step.\nA:"42      - "Q: Three friends split a bill of 84 dollars; one pays twice as much as each of the others. How much does each pay? Think step by step.\nA:"43      - "Q: A store sells pens at 3 for 2 dollars. How much do 18 pens cost? Think step by step.\nA:"44      - "Q: If today is Wednesday, what day of the week will it be in 100 days? Think step by step.\nA:"45      - "Q: A car uses 7 litres per 100 km. How many litres for a 350 km trip, and the cost at 1.60 per litre? Think step by step.\nA:"46      - "Q: The sum of two consecutive even numbers is 54. What are they? Think step by step.\nA:"47      - "Q: A recipe for 4 people needs 300 g of flour. How much for 10 people? Think step by step.\nA:"48      - "Q: A clock shows 3:15. What is the angle between the hour and minute hands? Think step by step.\nA:"49      - "Q: If 5 machines make 5 widgets in 5 minutes, how long do 100 machines take to make 100 widgets? Think step by step.\nA:"50    heldout:51      - "Q: A tank fills in 6 hours with pipe A and 9 hours with pipe B. How long with both pipes? Think step by step.\nA:"52      - "Q: What is the smallest positive integer divisible by 2, 3, 4, 5 and 6? Think step by step.\nA:"53      - "Q: A shirt costs 40 dollars after a 20 percent discount. What was the original price? Think step by step.\nA:"54      - "Q: Two dice are rolled. What is the probability that the sum is 7? Think step by step.\nA:"55  multilingual:56    fit:57      - "Les modèles à mélange d'experts activent seulement une fraction de leurs paramètres parce que"58      - "Explique en français pourquoi la mémoire unifiée des puces Apple est utile pour l'inférence des grands modèles de langage."59      - "Rédige un court paragraphe sur l'histoire de la ville de Québec."60      - "Quels sont les avantages du transport en commun dans une ville de taille moyenne ? Réponds en français."61      - "Erkläre in drei Sätzen, warum Fahrräder in Städten nützlich sind."62      - "Describe en español cómo se prepara un buen café con una cafetera italiana."63      - "Explique en français la différence entre un prêt hypothécaire à taux fixe et à taux variable."64      - "Scrivi un breve paragrafo sulla cucina tradizionale della Toscana."65    heldout:66      - "Décris en quelques phrases le fonctionnement d'un cache LRU."67      - "¿Cuáles son las principales causas del cambio climático? Responde brevemente en español."68      - "Beschreibe kurz, wie ein Mietvertrag in Deutschland funktioniert."69  longctx:70    fit:71      - "You are an assistant helping an economics professor. Context: the course covers hedonic pricing, the sales comparison approach, the cost approach and the income approach to real estate valuation. Students have access to a database of 500,000 Quebec transactions from 2021 to 2026 with attributes such as living area, lot size, year built, number of bedrooms and bathrooms, municipality and sale date. The professor wants a tutorial exercise. Task: write detailed instructions for a two-hour lab in which students estimate a hedonic regression, interpret its coefficients, and use it to value three sample properties, including common pitfalls and how to check residuals."72      - "Context: a small laboratory operates a cluster of twenty-nine Apple Silicon computers connected by gigabit Ethernet, with between 8 and 96 GB of unified memory each, used for scientific computing, web services and language-model inference. The laboratory wants a maintenance policy. Task: write a comprehensive maintenance checklist covering daily, weekly and monthly tasks, monitoring of temperature and disk usage, backup verification, software updates, security hygiene, and an incident response procedure for a power outage, with justification for each item."73      - "Context: a municipality in Quebec is revising its property assessment roll. Current assessments date from three years ago; prices have risen unevenly across neighbourhoods; some property types (condominiums, plexes, single-family homes) show different trends; the municipality must explain changes to citizens. Task: write a structured briefing note of at least eight paragraphs for the city council describing the methodology options, their fairness implications, communication strategy, and a timeline."74    heldout:75      - "Context: a graduate student is designing a benchmark to compare inference runtimes for mixture-of-experts language models on consumer hardware. The runtimes differ in quantization, in how they store experts (in memory or on disk), and in whether they can use several machines. The student has access to three machines with different amounts of memory and a gigabit network. Task: write a detailed experimental protocol with workloads, metrics, controls, repetition strategy, statistical analysis and reporting guidelines, explaining the rationale behind each choice."76  drift:77    fit:78      - "First, write a Python function that reverses a linked list.\n\n```python\n"79      - "Explain the rules of ice hockey in two paragraphs, then write a SQL query counting goals per player from a table goals(player, minute)."80      - "Résume en français l'intrigue d'un roman policier imaginaire, puis donne la solution de l'équation 3x + 7 = 22 étape par étape."81    heldout:82      - "Describe a sunset over the Ottawa River in one paragraph, then implement quicksort in Python.\n\n```python\n"83      - "Q: What is 17 times 23? Think step by step.\nA: Then write a haiku about autumn in Québec."84output_lengths: [64, 256]85
Files · 2d987b30cb427aa933cb485dd908495f7ea82b47
Menu

Theme