SPB Git

spb/firc0001_uqo

Public

N-batches: validation report note on the transient DuckDB spill directory during N13

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Simon-Pierre Boucher committed (Nov 5, 2026) parent 433461a Browse files

1 changed file +1 −1

Unified Split
modified reproducibility/validation_report_N.md +1 −1
@@ -21,7 +21,7 @@ Executor: node batch (Agent "N"), 2026-11-05, 14:08–15:05 local. Worktree `UQO
21 | N12 | `a12_env_lock.sh` | M3U96b | 2 s | venv metadata | `requirements.lock`, `.python-version`, `environment.md`, `results/env/` | 21 | N12 | `a12_env_lock.sh` | M3U96b | 2 s | venv metadata | `requirements.lock`, `.python-version`, `environment.md`, `results/env/` |
22 | N13 | `a13_export_stats_check.sh` + L1's `code/export_stats.py` | M3U96b | 44 s | both DuckDB files | `results/export_check/`, `data/stats.json` + 4 new CSV | 22 | N13 | `a13_export_stats_check.sh` + L1's `code/export_stats.py` | M3U96b | 44 s | both DuckDB files | `results/export_check/`, `data/stats.json` + 4 new CSV |
23 23
24−Settings everywhere: `duckdb.connect(read_only=True)`, `SET threads=4`, `SET memory_limit='24GB'` (16 GB inside `export_stats.py`), `SET temp_directory='~/firc0001_review/tmp'`, `nice -n 10`, `OMP_NUM_THREADS=4`, Python 3.12.15 / duckdb 2.0.0 (`environment.md`), seed 20261105. Zero LLM/API calls; no network beyond ssh. Logs: `reproducibility/FIRC-0001/logs/node/`. Integrity of the inputs: `spid.duckdb` 3,155,701,760 B mtime 2026-10-28 12:21:11 and `edgar_research.duckdb` 73,500,995,584 B mtime 2026-10-27 21:34:46 before and after (every `manifest.json`); `~/UQO_RESEARCH_DB` git `d700868`, 0 changed paths. **One incident:** the first schema probe (before `temp_directory` was set) ran out of memory on a text semi-join and DuckDB created then removed its default spill directory `spid.duckdb.tmp` next to the database (parent-directory mtime 14:09); the database file is unchanged (size, mtime) and no data was written. 24+Settings everywhere: `duckdb.connect(read_only=True)`, `SET threads=4`, `SET memory_limit='24GB'` (16 GB inside `export_stats.py`), `SET temp_directory='~/firc0001_review/tmp'`, `nice -n 10`, `OMP_NUM_THREADS=4`, Python 3.12.15 / duckdb 2.0.0 (`environment.md`), seed 20261105. Zero LLM/API calls; no network beyond ssh. Logs: `reproducibility/FIRC-0001/logs/node/`. Integrity of the inputs: `spid.duckdb` 3,155,701,760 B mtime 2026-10-28 12:21:11 and `edgar_research.duckdb` 73,500,995,584 B mtime 2026-10-27 21:34:46 before and after (every `manifest.json`); `~/UQO_RESEARCH_DB` git `d700868`, 0 changed paths. **One incident:** the first schema probe (before `temp_directory` was set) ran out of memory on a text semi-join and DuckDB created then removed its default spill directory `spid.duckdb.tmp` next to the database (parent-directory mtime 14:09); the database file is unchanged (size, mtime) and no data was written. The same transient spill directory was created and removed by L1's `export_stats.py` during N13 (its connections set no `temp_directory`; parent-directory mtime 14:43), again with the database file byte-unchanged.
25 25
26 ## 2. What reconciles (BEFORE = paper / committed data; AFTER = measured) 26 ## 2. What reconciles (BEFORE = paper / committed data; AFTER = measured)
27 27
28 28
Menu

Theme