SPB Git
spboucher.ai

spb/findata

Public
page 1

  1. Mon, Nov 2, 2026 21

    1. docs: public landing page
      Simon-Pierre Boucher · 1 file +4
    2. public landing: anonymous overview metrics (/api/v1/public/overview) and docs; data pages stay behind sign-in
      …
      Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
      Simon-Pierre Boucher · 6 files +283 −8
    3. fdq: fix datasets/jobs formatting
      Simon-Pierre Boucher · 1 file +3 −2
    4. fdq shell helper + Claude Code API usage guide
      Simon-Pierre Boucher · 2 files +115
    5. docs: full-load completion report, query performance, SQL rules
      Simon-Pierre Boucher · 2 files +32 −1
    6. raise open-file limit for wide scans; date-only SQL scopes use the catalog too
      …
      Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
      Simon-Pierre Boucher · 2 files +11 −4
    7. SQL fast path: symbol-scoped statements resolve their file list from the catalog
      …
      Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
      Simon-Pierre Boucher · 3 files +94 −6
    8. SQL views: base (hive) UNION ALL BY NAME delta (derived symbol/year); options hive
      …
      Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
      Simon-Pierre Boucher · 2 files +20 −9
    9. planner: symbol filter in SQL; views skip emptied layouts
      …
      Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
      Simon-Pierre Boucher · 2 files +10 −5
    10. SQL views: hive-partitioned directory globs, lazy + cached; coverage limited to primary datasets; 4 bulk workers
      …
      Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
      Simon-Pierre Boucher · 4 files +52 −111
    11. scheduler: daily dedupe keys fire once (quality/gc were re-enqueued every tick); backup scope documented
      …
      Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
      Simon-Pierre Boucher · 3 files +27 −23
    12. publish: chained O(delta) snapshot id; backfill batches 20 symbols per version; heartbeat-based stale requeue; symbol index
      …
      Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
      Simon-Pierre Boucher · 5 files +59 −18
    13. options parser: ragged lines tolerated, malformed files skipped
      Simon-Pierre Boucher · 2 files +4 −3
    14. parser: tolerate ragged vendor lines; skip unparseable files instead of failing the archive
      …
      Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
      Simon-Pierre Boucher · 4 files +22 −5
    15. archive: 7z fallback for Deflate64 zips (option chains ≥ 2023)
      …
      Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
      Simon-Pierre Boucher · 2 files +61 −1
    16. 8 bulk workers (page cache was misread as pressure; swap is the signal)
      Simon-Pierre Boucher · 1 file +48
    17. fundamentals: remember 404 listings in the checkpoint so resumes do not retry them
      Simon-Pierre Boucher · 1 file +3 −1
    18. 6 bulk workers (memory ceiling)
      Simon-Pierre Boucher · 1 file −48
    19. health: background refresher thread (request path never blocks); wrapper escalates TERM→KILL
      …
      Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
      Simon-Pierre Boucher · 2 files +38 −15
    20. docs: bulk-load incidents and rules
      Simon-Pierre Boucher · 2 files +9
    21. health: catalog-based lake usage and 60 s cached evaluation (probes were timing out → mld heal restart loop)
      …
      Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
      Simon-Pierre Boucher · 5 files +46 −7

  2. Sun, Nov 1, 2026 19

    1. manifests: compact per-version deltas (full lists reconstructed from lake_files); restore drill verifies against the restored DB
      …
      Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
      Simon-Pierre Boucher · 3 files +42 −16
    2. sshd wrapper: forward stop to the remote process and wait (no orphan workers), kill leftovers on start
      …
      Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
      Simon-Pierre Boucher · 1 file +30 −5
    3. memory: release Arrow buffers between symbols, smaller DuckDB limit, faster stale requeue
      …
      Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
      Simon-Pierre Boucher · 4 files +21 −7
    4. gc: remove stale .part downloads
      Simon-Pierre Boucher · 1 file +3
    5. 8 bulk workers
      Simon-Pierre Boucher · 1 file +96
    6. docs: TCC/external SSD operating note
      Simon-Pierre Boucher · 2 files +4
    7. macOS TCC workaround: run PM2 processes through sshd (Full Disk Access) for the external SSD; SIGHUP graceful stop; EIO-safe logging
      …
      Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
      Simon-Pierre Boucher · 4 files +66 −14
    8. lake/client: EINTR-safe mkdir on the external volume; cap per-symbol anomaly rows in backfills
      …
      Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
      Simon-Pierre Boucher · 3 files +22 −5
    9. docs: cold root, bulk workers, full download plan
      Simon-Pierre Boucher · 2 files +10 −1
    10. cli: worker --role, plan-all, backfill-all, options, fundamentals --all-active
      …
      Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
      Simon-Pierre Boucher · 1 file +51 −3
    11. full FirstRate catalog: cold lake root (external SSD), 57 new datasets, index/contracts/options parsers, options task, bulk workers, complete download plan (798 jobs), extended scheduler
      …
      Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
      Simon-Pierre Boucher · 24 files +945 −99
    12. docs: STATUS final checks, acceptance tests, next steps
      …
      Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
      Simon-Pierre Boucher · 1 file +34 −1
    13. restore drill: credentials via environment, redacted errors
      …
      Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
      Simon-Pierre Boucher · 1 file +15 −5
    14. compaction: single read of deltas, in-memory slicing; gc of orphan curated files
      …
      Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
      Simon-Pierre Boucher · 4 files +77 −28
    15. derive: base layout per symbol/year for backfill-driven 5m aggregation
      …
      Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
      Simon-Pierre Boucher · 1 file +33 −1
    16. web: bars deep-link auto-load, curated GB precision
      …
      Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
      Simon-Pierre Boucher · 2 files +18 −2
    17. api: source guard on the transport peer, X-Forwarded-For trusted only from the tunnel gateway
      …
      Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
      Simon-Pierre Boucher · 4 files +20 −8
    18. api: listen on all interfaces behind a source-network guard (tunnel reachability); cli closes the pool
      …
      Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
      Simon-Pierre Boucher · 4 files +26 −3
    19. web console (Next.js 15 static export, 16 routes, CSP-safe externalized scripts)
      …
      Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
      Simon-Pierre Boucher · 4 files +12 −4
Menu

Theme
↑↓ navigate ↵ open esc close / or ⌘K anywhere