TypeScript 55.4%
Python 43.2%
SQL 1.2%
-
Sun, Sep 13, 2026 3
-
discovery: plain sitemaps enter shadow at tier C (news sitemaps stay B) — 168 shadow sitemaps at 15 min were the heaviest new load
…
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
-
factory: continuous worker pool (10 workers, one seed each) instead of lock-step batches; per-organization wall-clock deadline (120 s); test updated for canada.ca departments
…
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
-
WebSensor 0.3 — Source Factory & Global Observation Coverage Score
…
- Deep discovery (robots → sitemaps → feeds incl. official sub-domains → navigation-classified pages → status providers → GitHub org → EDGAR → Hugging Face → OpenAPI → posture), every candidate validated, wildcard DNS / anti-bot detection, content de-duplication, expected change frequency (median gap) - Factory: coverage universes → factory_seeds → scored candidates (explainable) → promotion caps → SHADOW sensors (polled, never published) → evidence-based acceptance/rejection; separate websensor-factory process with Redis heartbeat; CLI expand/factory seed|run|evaluate|stats|export|requeue; YAML export for graduation - Migration 0007 (sources.origin/sector, factory_seeds, candidate lifecycle columns, factory_daily); pipeline keeps SHADOW status and skips events for shadow sensors - Coverage: sector universes schema + validator (--dns), registrableDomain(), GET /api/v1/coverage[/:sector], pages /coverage and /coverage/[sector], homepage rail, stats exclude shadow sensors - Admin API /api/v1/admin/factory* + /ops Source Factory panel (funnel, sectors, candidates, accept/reject) - Docs: COVERAGE.md, CLAUDE.md, deploy README, ARCHITECTURE, README; manifest gains websensor-factory + factory seed hook; version 0.3.0 Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
-