SPB Git
spboucher.ai

spb/findata

Public
page 1

  1. Mon, Nov 2, 2026 13

    1. planner: symbol filter in SQL; views skip emptied layouts
      …
      Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
      Simon-Pierre Boucher · 2 files +10 −5
    2. SQL views: hive-partitioned directory globs, lazy + cached; coverage limited to primary datasets; 4 bulk workers
      …
      Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
      Simon-Pierre Boucher · 4 files +52 −111
    3. scheduler: daily dedupe keys fire once (quality/gc were re-enqueued every tick); backup scope documented
      …
      Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
      Simon-Pierre Boucher · 3 files +27 −23
    4. publish: chained O(delta) snapshot id; backfill batches 20 symbols per version; heartbeat-based stale requeue; symbol index
      …
      Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
      Simon-Pierre Boucher · 5 files +59 −18
    5. options parser: ragged lines tolerated, malformed files skipped
      Simon-Pierre Boucher · 2 files +4 −3
    6. parser: tolerate ragged vendor lines; skip unparseable files instead of failing the archive
      …
      Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
      Simon-Pierre Boucher · 4 files +22 −5
    7. archive: 7z fallback for Deflate64 zips (option chains ≥ 2023)
      …
      Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
      Simon-Pierre Boucher · 2 files +61 −1
    8. 8 bulk workers (page cache was misread as pressure; swap is the signal)
      Simon-Pierre Boucher · 1 file +48
    9. fundamentals: remember 404 listings in the checkpoint so resumes do not retry them
      Simon-Pierre Boucher · 1 file +3 −1
    10. 6 bulk workers (memory ceiling)
      Simon-Pierre Boucher · 1 file −48
    11. health: background refresher thread (request path never blocks); wrapper escalates TERM→KILL
      …
      Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
      Simon-Pierre Boucher · 2 files +38 −15
    12. docs: bulk-load incidents and rules
      Simon-Pierre Boucher · 2 files +9
    13. health: catalog-based lake usage and 60 s cached evaluation (probes were timing out → mld heal restart loop)
      …
      Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
      Simon-Pierre Boucher · 5 files +46 −7

  2. Sun, Nov 1, 2026 24

    1. manifests: compact per-version deltas (full lists reconstructed from lake_files); restore drill verifies against the restored DB
      …
      Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
      Simon-Pierre Boucher · 3 files +42 −16
    2. sshd wrapper: forward stop to the remote process and wait (no orphan workers), kill leftovers on start
      …
      Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
      Simon-Pierre Boucher · 1 file +30 −5
    3. memory: release Arrow buffers between symbols, smaller DuckDB limit, faster stale requeue
      …
      Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
      Simon-Pierre Boucher · 4 files +21 −7
    4. gc: remove stale .part downloads
      Simon-Pierre Boucher · 1 file +3
    5. 8 bulk workers
      Simon-Pierre Boucher · 1 file +96
    6. docs: TCC/external SSD operating note
      Simon-Pierre Boucher · 2 files +4
    7. macOS TCC workaround: run PM2 processes through sshd (Full Disk Access) for the external SSD; SIGHUP graceful stop; EIO-safe logging
      …
      Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
      Simon-Pierre Boucher · 4 files +66 −14
    8. lake/client: EINTR-safe mkdir on the external volume; cap per-symbol anomaly rows in backfills
      …
      Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
      Simon-Pierre Boucher · 3 files +22 −5
    9. docs: cold root, bulk workers, full download plan
      Simon-Pierre Boucher · 2 files +10 −1
    10. cli: worker --role, plan-all, backfill-all, options, fundamentals --all-active
      …
      Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
      Simon-Pierre Boucher · 1 file +51 −3
    11. full FirstRate catalog: cold lake root (external SSD), 57 new datasets, index/contracts/options parsers, options task, bulk workers, complete download plan (798 jobs), extended scheduler
      …
      Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
      Simon-Pierre Boucher · 24 files +945 −99
    12. docs: STATUS final checks, acceptance tests, next steps
      …
      Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
      Simon-Pierre Boucher · 1 file +34 −1
    13. restore drill: credentials via environment, redacted errors
      …
      Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
      Simon-Pierre Boucher · 1 file +15 −5
    14. compaction: single read of deltas, in-memory slicing; gc of orphan curated files
      …
      Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
      Simon-Pierre Boucher · 4 files +77 −28
    15. derive: base layout per symbol/year for backfill-driven 5m aggregation
      …
      Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
      Simon-Pierre Boucher · 1 file +33 −1
    16. web: bars deep-link auto-load, curated GB precision
      …
      Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
      Simon-Pierre Boucher · 2 files +18 −2
    17. api: source guard on the transport peer, X-Forwarded-For trusted only from the tunnel gateway
      …
      Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
      Simon-Pierre Boucher · 4 files +20 −8
    18. api: listen on all interfaces behind a source-network guard (tunnel reachability); cli closes the pool
      …
      Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
      Simon-Pierre Boucher · 4 files +26 −3
    19. web console (Next.js 15 static export, 16 routes, CSP-safe externalized scripts)
      …
      Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
      Simon-Pierre Boucher · 4 files +12 −4
    20. docs: API quick start, STATUS skeleton
      …
      Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
      Simon-Pierre Boucher · 3 files +168
    21. sandbox: accept EXPLAIN; assistant test green (37 tests)
      …
      Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
      Simon-Pierre Boucher · 1 file +2 −1
    22. AI assistant (config-gated, validated SQL only), EXPLAIN in sandbox
      …
      Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
      Simon-Pierre Boucher · 18 files +1,239 −12
    23. lint config, infra (mld manifest, alerts, bootstrap), docs (architecture, dictionary, operations, security)
      …
      Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
      Simon-Pierre Boucher · 51 files +204 −143
    24. FinData OS: phase 0–4 foundation (discovery, lakehouse, ingest, API, SDK, tests)
      …
      Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
      Simon-Pierre Boucher · 135 files +17,015
Menu

Theme
↑↓ navigate ↵ open esc close / or ⌘K anywhere