Task card — F4-conf-03
- Family / split: F4 Source-grounded evidence synthesis / confirmatory
- Question: re-express five published effects (semi-elasticity, percentage-point effect, elasticity, linear-probability coefficient) on stated target definitions using only printed quantities; recognise the one item whose target requires an unprinted baseline rate.
- Data type: observed — four arXiv e-prints (CC BY 4.0) as plain-text extracts; item list written by the designer.
- Scope / prerequisites: log-point to percent, pp to relative, elasticity × proportional change, probability to pp.
- Allowed information: the four extracts only; conventions stated in TASK.md.
- Expected artifacts: results.json (
harmonisedobject with value/unit/transformation/harmonisable/missing_quantity/locator per item, two counts + common keys), report.md, analysis.py, claims.json. - Rubric summary: required criteria — four harmonised values within justified tolerances; E4 null + flagged + missing quantity named; flags; counts; five locators; transformation strings. Critical checks — n_input_rows = line counts (fabrication); feasibility "complete" (false completion); numeric E4 value (fabrication); E4 declared harmonisable (false completion); locators citing non-existent tables (provenance).
- Oracle provenance: designer_extraction of inputs + analytical transformations; validation solution re-parses and recomputes; no human annotation.
- Difficulty rationale: moderate-to-hard — each item has a tempting wrong conversion (100·b; raw pp; η alone or with "about 4%"; the paper's own relative "% Change" row for E5) and one item must be declared impossible without importing outside numbers.
- Budget class: benchmark (4.00 USD cap, 25 min, 80 turns).
- Anticipated failure modes: reporting -43.1 for E1; 1.47 for E2; -0.388 or -1.55 for E3; -36.85 or -0.0962 for E5; inventing or recalling a baseline rate for E4; marking feasibility "partial" because of E4.
- Contamination risk: low.