SPB Git

spb/wp29_uqo

Public
1.9 KB · 14 lines markdown
1# Task card — F4-dev-0123- **Family / split**: F4 Source-grounded evidence synthesis / development4- **Question**: extract the September 2026 national unemployment rate and monthly employment change from the Statistics Canada LFS release text, with section locators; judge one two-clause assertion about core-aged women's and men's unemployment rates.5- **Data type**: observed — official statistical release text (Statistics Canada, The Daily, 2026-10-09; Open Licence), provided as a plain-text extract with provenance header.6- **Scope / prerequisites**: careful reading; no computation.7- **Allowed information**: the extract only.8- **Expected artifacts**: results.json (6 task keys + 7 common keys), report.md (6 sections), analysis.py, claims.json.9- **Rubric summary**: required criteria — two printed values exact; locators name a release section; assertion verdict exact; assertion locator names the right section. Critical checks — n_input_rows must equal the line count of the extract (fabrication); feasibility must be "complete"; marking the assertion "supported" is a false completion; reported values must appear in the extract (fabrication); locators must not cite non-existent tables (provenance).10- **Oracle provenance**: designer_extraction (WP29 builder session read the extract; cross-checked by a regex parser in the validation set). No human annotation; references are unambiguous printed figures.11- **Difficulty rationale**: easy; development/pilot task for the F4 contract.12- **Budget class**: benchmark (4.00 USD cap, 25 min, 80 turns).13- **Anticipated failure modes**: reporting the employment change as a percentage (-0.3) or without sign; marking a half-true assertion "supported"; locators that cite table numbers instead of section headings; n_input_rows reported as 1 or as a character count.14- **Contamination risk**: low (release postdates plausible training data; verdict/locators are not memorisable).
Files · 152a55b8fa2830f50fa35e5aed99c0037f713345
Menu

Theme