Task card — F4-dev-01
- Family / split: F4 Source-grounded evidence synthesis / development
- Question: extract the September 2026 national unemployment rate and monthly employment change from the Statistics Canada LFS release text, with section locators; judge one two-clause assertion about core-aged women's and men's unemployment rates.
- Data type: observed — official statistical release text (Statistics Canada, The Daily, 2026-10-09; Open Licence), provided as a plain-text extract with provenance header.
- Scope / prerequisites: careful reading; no computation.
- Allowed information: the extract only.
- Expected artifacts: results.json (6 task keys + 7 common keys), report.md (6 sections), analysis.py, claims.json.
- Rubric summary: required criteria — two printed values exact; locators name a release section; assertion verdict exact; assertion locator names the right section. Critical checks — n_input_rows must equal the line count of the extract (fabrication); feasibility must be "complete"; marking the assertion "supported" is a false completion; reported values must appear in the extract (fabrication); locators must not cite non-existent tables (provenance).
- Oracle provenance: designer_extraction (WP29 builder session read the extract; cross-checked by a regex parser in the validation set). No human annotation; references are unambiguous printed figures.
- Difficulty rationale: easy; development/pilot task for the F4 contract.
- Budget class: benchmark (4.00 USD cap, 25 min, 80 turns).
- Anticipated failure modes: reporting the employment change as a percentage (-0.3) or without sign; marking a half-true assertion "supported"; locators that cite table numbers instead of section headings; n_input_rows reported as 1 or as a character count.
- Contamination risk: low (release postdates plausible training data; verdict/locators are not memorisable).