SPB Git
spboucher.ai

spb/websensor

Public
History of config Clear filter
page 1

  1. Sun, Sep 13, 2026 8

    1. coverage: governments & public institutions of the world — 3 313 members in 18 institutional roles (head of government, portal, parliament, central bank, finance, foreign affairs, statistics, health, energy, transport, competition, financial regulator, cybersecurity agency, gazette, open data, election authority, supreme court, international bodies) across 195 jurisdictions, 2 395 Wikidata QIDs; core: bund.de suffix
      …
      Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
      Simon-Pierre Boucher · 1 file +3,396
    2. registry: 56-ai-model-watch (654 validated sensors / 272 orgs: HF author lists, provider model catalogues & pricing & deprecations, leaderboards, runtime releases) and 58-status-pages-wave3 (530 JSON status pages); probe scripts/gen-status-probe3.py; AUTHORING table
      …
      Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
      Simon-Pierre Boucher · 2 files +7,802
    3. coverage: AI (417 labs, hubs, AI clouds, hardware, research/policy, applications; 92 Hugging Face authors, 58 status pages, 270 GitHub hints) and cloud/infrastructure (467 clouds, CDN/DNS/CAs, data infra, observability/DevOps, comms/identity; 170 JSON status pages, 384 GitHub hints) universes — every hint verified
      …
      Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
      Simon-Pierre Boucher · 2 files +969
    4. coverage: listed companies Europe · Asia-Pacific · Latin America · Middle East/Africa — 1 981 constituents across 44 indices (EURO STOXX 50, FTSE 100/250, DAX/MDAX, CAC/SBF, IBEX, MIB, AEX, SMI, Nordics, Nikkei 225, Hang Seng, ASX 200, Nifty, KOSPI, STI, TAIEX, SSE 50/CSI 300, SET, KLCI, PSEi, NZX, Ibovespa, IPC, Merval, IPSA, COLCAP, TA-35, Tadawul, ADX/DFM, JSE, BIST, EGX), Wikidata P856/P5531
      …
      Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
      Simon-Pierre Boucher · 1 file +2,173
    5. coverage: cybersecurity universe — 793 organizations (142 national agencies/CERTs in 99 countries, 45 vulnerability databases & standards, 487 vendor PSIRTs, 105 research/threat-intel, 14 disclosure platforms), 153 verified advisory-feed hints, 36 status pages
      …
      Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
      Simon-Pierre Boucher · 1 file +865
    6. coverage: science/healthcare final revisions (THE 2026 top 400, Wikidata QIDs, verified press/pipeline hints); core: academic multi-label suffixes (edu.mo, ac.ir, edu.qa…)
      …
      Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
      Simon-Pierre Boucher · 2 files +193 −193
    7. coverage: open-source universe (1 124 projects/foundations with github_repos hints); registry: 57-packages-top — 3 135 validated package sensors (PyPI 1 200 · npm 1 200 · crates 297 · RubyGems 98 · NuGet 99 · Docker Hub 91 · Go 150), generator scripts/gen-packages-top.py
      …
      Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
      Simon-Pierre Boucher · 2 files +4,399
    8. coverage: universes wave 1 — listed companies North America (S&P 500 · Nasdaq-100 · S&P 400 · TSX composite, CIK hints), science & universities, healthcare & pharma, energy, transport, telecom, logistics, markets (every central bank, regulators, exchanges, payments), commerce — 5 012 organizations with verified domains and provenance
      …
      Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
      Simon-Pierre Boucher · 9 files +5,504

  2. Fri, Sep 11, 2026 2

    1. registry: wave 2 breadth fragments 47–55 — open-source long tail, SaaS status pages & changelogs, EDGAR issuers, Federal Register agencies, cities/regions/public bodies, world governments & regulators, corporate pricing/legal/careers, sports clubs/entertainment/education, media long tail & think tanks (5 669 orgs / 10 969 validated sensors); generators, cross-fragment extends, polygon.io OpenAPI reattributed, YAML boolean country fix, docs
      …
      Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
      Simon-Pierre Boucher · 11 files +34,518 −5
    2. WebSensor 0.2 — signal intelligence upgrade
      …
      Registry: 7 depth fragments (40–46: AI frontier, cloud infrastructure, cybersecurity,
finance & markets, governments, science & health, transport/telecom/sports/news) →
3 167 organizations / 6 320 validated sensors (was 2 681 / 4 052); seeds carry
country, language and first_party; sync infers country/language by TLD and a
0–3 scheduling priority.

Core: semantic diff (noise classes vs pricing/policy/product/personnel, field-level
before → after with % deltas), WebSensor Signal Score with explainable reasons,
impact / velocity / anomaly scores, breaking state, entity rank, ~40 new event
classes (zero_day, active_exploitation, supply_chain_attack, guidance, buyback,
sanction, legislation, outbreak, grounding, service_shutdown…), search syntax
(entity: type: after:7d silent: importance:>70 country:), shared registry schema.

Engine: noise never becomes an event, routine firehose batches damped, fingerprint
idempotency, ambiguous-alias rule for entity resolution (+ relink-entities CLI),
silent-change bar (first-party · eligible type · importance ≥ 45), clusters with
propagation timeline, first-party/external counts, velocity, lead time and
breaking/developing/confirmed states, server-side alerts with HMAC-signed
webhooks, raw-body retention with reference counting, priority-aware scheduler
with per-domain circuit breaker and Redis heartbeat, UTF-16 BOM transcoding.

API: new filters (signal_min, group, first_party, confirmed, country, language,
change_class, q syntax, order=signal), /breaking /pulse /radar /clusters/:slug
/entities/rank /countries /categories/:channel /sensors/:id/snapshots, owner
routes (bookmarks, saved views, notifications, custom URL monitors with SSRF
checks), admin routes behind WS_ADMIN_TOKEN (ops, sensor/source actions,
connector test, YAML/JSON bulk import), TTL cache, WebSocket protocol 2 with
stream ids and replay.

Web: terminal-style design system (badges, density modes, skeletons, sparklines,
heatmaps), live system strip, ⌘K command palette, intelligence drawer, live feed
v2 (URL-synced filters, pause, "↑ N new events", replay), pages /live /pulse
/radar /entity/[id] /cluster/[slug] /country /bookmarks /monitors /ops, redesigned
breaking / silent / explore / event / source / sensor / search / alerts /
watchlists / health / api docs, OG image per event, sitemap, loading skeletons.

Migrations 0005 (additive schema) and 0006 (backfills). Docs updated.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
      Simon-Pierre Boucher · 8 files +10,617

  3. Tue, Sep 8, 2026 4

    1. registry: 22 site-class fragments (2 681 organizations, 4 052 validated sensors) + 10 new connector families
      …
      - config/sources.d/*.yaml merged on top of the founding file by apps/engine/src/seeds.ts (`extend: true`
  adds sensors to an existing source); classes: open source, central banks & finance, energy/climate/weather,
  telecom & internet infra, retail/consumer/travel, gaming & entertainment, universities & research,
  international orgs/NGOs/standards, sports, crypto, transport/aviation/space, consumer safety/food/agri,
  housing/labour/open data, enterprise SaaS, health systems & medtech, politics/elections/courts, SEC EDGAR
  (254 issuers), package registries, web posture, OpenAPI, status JSON, documents & data
- connectors: package (10 registries), edgar, statusjson (Instatus/incident.io/Status.io), openapi, csv, pdf
  (unpdf), dns, tls, headers, rdap (IANA bootstrap); fetcher keepAllHeaders
- heuristics: connector-class priors + event types api_change, dns_change, domain_registration_change,
  crawler_policy_change; 8-K items → earnings/leadership_change/breach/acquisition
- registry validator without DB (apps/engine/src/validate.ts, --probe), generators gen-edgar.py,
  gen-web-posture.py, prune-fragment.py; docs/registry/AUTHORING.md + docs/connectors/*.md (16)
- SSRF: NAT64 addresses judged by the embedded IPv4 (IPv6-only hotspots)

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
      Simon-Pierre Boucher · 23 files +28,486 −1
    2. registry: +26 governments/public institutions, +45 news media (validated live); News feed channel; per-source llm switch (news = heuristics only)
      …
      Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
      Simon-Pierre Boucher · 1 file +782
    3. discovery: page candidates must be real, distinct, non-thin documents (catch-all 200 / CAPTCHA pages rejected); SEDAR+ sensor removed
      …
      Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
      Simon-Pierre Boucher · 1 file +2 −3
    4. WebSensor v0.1.0 — real-time web intelligence platform
      …
      Core (taxonomy, SSRF policy, canonical extraction, diff engines, heuristics, scoring, adaptive schedule),
db (SQL migrations + Drizzle), content-addressed zstd blob store, connectors (http, rss/atom, sitemap,
statuspage, github, jsonlist, discovery, scrapfly fallback), engine (scheduler, pipeline, Claude
interpretation, entities, novelty/clustering, silent changes, metrics), Fastify gateway (REST + WebSocket +
proxy), Next.js 16 frontend, 200-source registry, tests, docs, mld manifest.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
      Simon-Pierre Boucher · 1 file +2,088
Menu

Theme
↑↓ navigate ↵ open esc close / or ⌘K anywhere