spb/social-runtime-crawler

Fri, Sep 11, 2026 1

1. Bounded network collection (streaming/long-poll bodies), observe timeout, recently_failed penalty, .mldignore

   …

   - NetworkObserver: 8 s body timeout, 6 s step collection cap, skip streaming/presence URLs and event-streams, fewer WS frames
   - engine: observation bounded to 45 s; failed actions penalised for 8 steps (no blind retries)
   - .mldignore keeps data/ (browser profiles) out of mld stage; README notes
   
   Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>

   Simon-Pierre Boucher committed 12 days ago · 1 file +7,739
   d3b24f2