spb/findata

Public

46commits
1branches
0releases
2.8 MBon disk
maindefault branch
yesterdaylast push

Mon, Nov 2, 2026 5
1. SQL views: hive-partitioned directory globs, lazy + cached; coverage limited to primary datasets; 4 bulk workers
  …
  Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
  Simon-Pierre Boucher yesterday · 1 file +6
2. publish: chained O(delta) snapshot id; backfill batches 20 symbols per version; heartbeat-based stale requeue; symbol index
  …
  Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
  Simon-Pierre Boucher yesterday · 1 file +33 −9
3. options parser: ragged lines tolerated, malformed files skipped
  
  Simon-Pierre Boucher yesterday · 1 file +1 −1
4. parser: tolerate ragged vendor lines; skip unparseable files instead of failing the archive
  …
  Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
  Simon-Pierre Boucher yesterday · 1 file +5 −1
5. fundamentals: remember 404 listings in the checkpoint so resumes do not retry them
  
  Simon-Pierre Boucher yesterday · 1 file +3 −1
Sun, Nov 1, 2026 9
1. manifests: compact per-version deltas (full lists reconstructed from lake_files); restore drill verifies against the restored DB
  …
  Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
  Simon-Pierre Boucher yesterday · 1 file +10 −13
2. memory: release Arrow buffers between symbols, smaller DuckDB limit, faster stale requeue
  …
  Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
  Simon-Pierre Boucher yesterday · 2 files +19 −5
3. lake/client: EINTR-safe mkdir on the external volume; cap per-symbol anomaly rows in backfills
  …
  Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
  Simon-Pierre Boucher yesterday · 1 file +1 −1
4. full FirstRate catalog: cold lake root (external SSD), 57 new datasets, index/contracts/options parsers, options task, bulk workers, complete download plan (798 jobs), extended scheduler
  …
  Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
  Simon-Pierre Boucher yesterday · 7 files +171 −25
5. restore drill: credentials via environment, redacted errors
  …
  Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
  Simon-Pierre Boucher yesterday · 1 file +15 −5
6. compaction: single read of deltas, in-memory slicing; gc of orphan curated files
  …
  Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
  Simon-Pierre Boucher yesterday · 2 files +27 −26
7. derive: base layout per symbol/year for backfill-driven 5m aggregation
  …
  Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
  Simon-Pierre Boucher yesterday · 1 file +33 −1
8. lint config, infra (mld manifest, alerts, bootstrap), docs (architecture, dictionary, operations, security)
  …
  Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
  Simon-Pierre Boucher yesterday · 10 files +45 −24
9. FinData OS: phase 0–4 foundation (discovery, lakehouse, ingest, API, SDK, tests)
  …
  Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
  Simon-Pierre Boucher yesterday · 10 files +680

Mon, Nov 2, 2026 5

Sun, Nov 1, 2026 9