spb/social-runtime-crawler

Fri, Sep 11, 2026 1

1. Social Runtime Crawler v0.1 — browser-native self-learning social crawler PoC

   …

   Monorepo (pnpm, strict TS via tsx, vitest): persistent Chromium sessions with human login,
   network observer + SchemaProfiler + generic JSON entity miner, DOM mutation observer + in-page
   semantic snapshot, page classifier, network/DOM surface merge with provenance, video detection
   and frame sampling, world model, information-gain heuristic planner (+ optional Anthropic/local
   LLM planner), loop detection, platform-model learning and connector compilation, PostgreSQL +
   JSONL replay storage, research dashboard, YouTube and Reddit adapters.
   
   Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>

   Simon-Pierre Boucher committed 12 days ago · 1 file +12
   40fba6b