SPB Git
spboucher.ai

spb/websensor

Public
History of config Clear filter
page 1

  1. Sun, Sep 13, 2026 7

    1. registry: 56-ai-model-watch (654 validated sensors / 272 orgs: HF author lists, provider model catalogues & pricing & deprecations, leaderboards, runtime releases) and 58-status-pages-wave3 (530 JSON status pages); probe scripts/gen-status-probe3.py; AUTHORING table
      …
      Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
      Simon-Pierre Boucher · 2 files +7,802
    2. coverage: AI (417 labs, hubs, AI clouds, hardware, research/policy, applications; 92 Hugging Face authors, 58 status pages, 270 GitHub hints) and cloud/infrastructure (467 clouds, CDN/DNS/CAs, data infra, observability/DevOps, comms/identity; 170 JSON status pages, 384 GitHub hints) universes — every hint verified
      …
      Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
      Simon-Pierre Boucher · 2 files +969
    3. coverage: listed companies Europe · Asia-Pacific · Latin America · Middle East/Africa — 1 981 constituents across 44 indices (EURO STOXX 50, FTSE 100/250, DAX/MDAX, CAC/SBF, IBEX, MIB, AEX, SMI, Nordics, Nikkei 225, Hang Seng, ASX 200, Nifty, KOSPI, STI, TAIEX, SSE 50/CSI 300, SET, KLCI, PSEi, NZX, Ibovespa, IPC, Merval, IPSA, COLCAP, TA-35, Tadawul, ADX/DFM, JSE, BIST, EGX), Wikidata P856/P5531
      …
      Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
      Simon-Pierre Boucher · 1 file +2,173
    4. coverage: cybersecurity universe — 793 organizations (142 national agencies/CERTs in 99 countries, 45 vulnerability databases & standards, 487 vendor PSIRTs, 105 research/threat-intel, 14 disclosure platforms), 153 verified advisory-feed hints, 36 status pages
      …
      Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
      Simon-Pierre Boucher · 1 file +865
    5. coverage: science/healthcare final revisions (THE 2026 top 400, Wikidata QIDs, verified press/pipeline hints); core: academic multi-label suffixes (edu.mo, ac.ir, edu.qa…)
      …
      Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
      Simon-Pierre Boucher · 2 files +193 −193
    6. coverage: open-source universe (1 124 projects/foundations with github_repos hints); registry: 57-packages-top — 3 135 validated package sensors (PyPI 1 200 · npm 1 200 · crates 297 · RubyGems 98 · NuGet 99 · Docker Hub 91 · Go 150), generator scripts/gen-packages-top.py
      …
      Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
      Simon-Pierre Boucher · 2 files +4,399
    7. coverage: universes wave 1 — listed companies North America (S&P 500 · Nasdaq-100 · S&P 400 · TSX composite, CIK hints), science & universities, healthcare & pharma, energy, transport, telecom, logistics, markets (every central bank, regulators, exchanges, payments), commerce — 5 012 organizations with verified domains and provenance
      …
      Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
      Simon-Pierre Boucher · 9 files +5,504

  2. Fri, Sep 11, 2026 2

    1. registry: wave 2 breadth fragments 47–55 — open-source long tail, SaaS status pages & changelogs, EDGAR issuers, Federal Register agencies, cities/regions/public bodies, world governments & regulators, corporate pricing/legal/careers, sports clubs/entertainment/education, media long tail & think tanks (5 669 orgs / 10 969 validated sensors); generators, cross-fragment extends, polygon.io OpenAPI reattributed, YAML boolean country fix, docs
      …
      Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
      Simon-Pierre Boucher · 11 files +34,518 −5
    2. WebSensor 0.2 — signal intelligence upgrade
      …
      Registry: 7 depth fragments (40–46: AI frontier, cloud infrastructure, cybersecurity,
finance & markets, governments, science & health, transport/telecom/sports/news) →
3 167 organizations / 6 320 validated sensors (was 2 681 / 4 052); seeds carry
country, language and first_party; sync infers country/language by TLD and a
0–3 scheduling priority.

Core: semantic diff (noise classes vs pricing/policy/product/personnel, field-level
before → after with % deltas), WebSensor Signal Score with explainable reasons,
impact / velocity / anomaly scores, breaking state, entity rank, ~40 new event
classes (zero_day, active_exploitation, supply_chain_attack, guidance, buyback,
sanction, legislation, outbreak, grounding, service_shutdown…), search syntax
(entity: type: after:7d silent: importance:>70 country:), shared registry schema.

Engine: noise never becomes an event, routine firehose batches damped, fingerprint
idempotency, ambiguous-alias rule for entity resolution (+ relink-entities CLI),
silent-change bar (first-party · eligible type · importance ≥ 45), clusters with
propagation timeline, first-party/external counts, velocity, lead time and
breaking/developing/confirmed states, server-side alerts with HMAC-signed
webhooks, raw-body retention with reference counting, priority-aware scheduler
with per-domain circuit breaker and Redis heartbeat, UTF-16 BOM transcoding.

API: new filters (signal_min, group, first_party, confirmed, country, language,
change_class, q syntax, order=signal), /breaking /pulse /radar /clusters/:slug
/entities/rank /countries /categories/:channel /sensors/:id/snapshots, owner
routes (bookmarks, saved views, notifications, custom URL monitors with SSRF
checks), admin routes behind WS_ADMIN_TOKEN (ops, sensor/source actions,
connector test, YAML/JSON bulk import), TTL cache, WebSocket protocol 2 with
stream ids and replay.

Web: terminal-style design system (badges, density modes, skeletons, sparklines,
heatmaps), live system strip, ⌘K command palette, intelligence drawer, live feed
v2 (URL-synced filters, pause, "↑ N new events", replay), pages /live /pulse
/radar /entity/[id] /cluster/[slug] /country /bookmarks /monitors /ops, redesigned
breaking / silent / explore / event / source / sensor / search / alerts /
watchlists / health / api docs, OG image per event, sitemap, loading skeletons.

Migrations 0005 (additive schema) and 0006 (backfills). Docs updated.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
      Simon-Pierre Boucher · 8 files +10,617

  3. Tue, Sep 8, 2026 4

    1. registry: 22 site-class fragments (2 681 organizations, 4 052 validated sensors) + 10 new connector families
      …
      - config/sources.d/*.yaml merged on top of the founding file by apps/engine/src/seeds.ts (`extend: true`
  adds sensors to an existing source); classes: open source, central banks & finance, energy/climate/weather,
  telecom & internet infra, retail/consumer/travel, gaming & entertainment, universities & research,
  international orgs/NGOs/standards, sports, crypto, transport/aviation/space, consumer safety/food/agri,
  housing/labour/open data, enterprise SaaS, health systems & medtech, politics/elections/courts, SEC EDGAR
  (254 issuers), package registries, web posture, OpenAPI, status JSON, documents & data
- connectors: package (10 registries), edgar, statusjson (Instatus/incident.io/Status.io), openapi, csv, pdf
  (unpdf), dns, tls, headers, rdap (IANA bootstrap); fetcher keepAllHeaders
- heuristics: connector-class priors + event types api_change, dns_change, domain_registration_change,
  crawler_policy_change; 8-K items → earnings/leadership_change/breach/acquisition
- registry validator without DB (apps/engine/src/validate.ts, --probe), generators gen-edgar.py,
  gen-web-posture.py, prune-fragment.py; docs/registry/AUTHORING.md + docs/connectors/*.md (16)
- SSRF: NAT64 addresses judged by the embedded IPv4 (IPv6-only hotspots)

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
      Simon-Pierre Boucher · 23 files +28,486 −1
    2. registry: +26 governments/public institutions, +45 news media (validated live); News feed channel; per-source llm switch (news = heuristics only)
      …
      Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
      Simon-Pierre Boucher · 1 file +782
    3. discovery: page candidates must be real, distinct, non-thin documents (catch-all 200 / CAPTCHA pages rejected); SEDAR+ sensor removed
      …
      Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
      Simon-Pierre Boucher · 1 file +2 −3
    4. WebSensor v0.1.0 — real-time web intelligence platform
      …
      Core (taxonomy, SSRF policy, canonical extraction, diff engines, heuristics, scoring, adaptive schedule),
db (SQL migrations + Drizzle), content-addressed zstd blob store, connectors (http, rss/atom, sitemap,
statuspage, github, jsonlist, discovery, scrapfly fallback), engine (scheduler, pipeline, Claude
interpretation, entities, novelty/clustering, silent changes, metrics), Fastify gateway (REST + WebSocket +
proxy), Next.js 16 frontend, 200-source registry, tests, docs, mld manifest.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
      Simon-Pierre Boucher · 1 file +2,088
Menu

Theme
↑↓ navigate ↵ open esc close / or ⌘K anywhere