SPB Git

spb/tendril

Public

Tendril — web ingestion platform (scrape/crawl/map/search) on macOS Apple Silicon: WebKit fidelity, authenticated pages, deterministic testable extraction. A self-hosted Firecrawl alternative.

History of test Clear filter
page 1
  1. Mon, Aug 10, 2026 1

    1. feat: scaffold Tendril monorepo with Phase 1 foundations
      …
      Web ingestion platform (scrape/crawl/map/search) for macOS Apple Silicon,
      following CLAUDE.md. Phase 1 (§24) delivered and fully tested (74 tests):
      
      - shared: Result<T,E>, §15 error taxonomy (single source), types, Pino
        logger with redaction, URL normalization (§10.1)
      - router: pure shouldEscalate escalation decision (§3.4)
      - egress: SSRF validation with resolve-then-validate + IP pinning (§16.5)
      - fetcher-http: Tier 0 undici client, Safari header order, manual redirects
        with per-hop SSRF re-validation, meta-refresh, gzip/br (§3)
      - extract: deterministic pipeline (§8) — JSON-LD/OG/Twitter harvest,
        Readability + density fallback, Turndown rules (GFM tables, fenced code,
        figures, dl), link extraction
      - api: Fastify POST /v1/scrape + /healthz, errors.ts HTTP mapping (§15)
      
      TypeScript strict (noUncheckedIndexedAccess, exactOptionalPropertyTypes),
      fetchers/extractors return Result, author header on every code file.
      
      Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
      Simon-Pierre Boucher · 1 file +49
Menu

Theme