spb/tendril Public
Tendril — web ingestion platform (scrape/crawl/map/search) on macOS Apple Silicon: WebKit fidelity, authenticated pages, deterministic testable extraction. A self-hosted Firecrawl alternative.
JavaScript 82.6%
TypeScript 11.8%
HTML 5.3%
-
feat: scaffold Tendril monorepo with Phase 1 foundations
…
Web ingestion platform (scrape/crawl/map/search) for macOS Apple Silicon, following CLAUDE.md. Phase 1 (§24) delivered and fully tested (74 tests): - shared: Result<T,E>, §15 error taxonomy (single source), types, Pino logger with redaction, URL normalization (§10.1) - router: pure shouldEscalate escalation decision (§3.4) - egress: SSRF validation with resolve-then-validate + IP pinning (§16.5) - fetcher-http: Tier 0 undici client, Safari header order, manual redirects with per-hop SSRF re-validation, meta-refresh, gzip/br (§3) - extract: deterministic pipeline (§8) — JSON-LD/OG/Twitter harvest, Readability + density fallback, Turndown rules (GFM tables, fenced code, figures, dl), link extraction - api: Fastify POST /v1/scrape + /healthz, errors.ts HTTP mapping (§15) TypeScript strict (noUncheckedIndexedAccess, exactOptionalPropertyTypes), fetchers/extractors return Result, author header on every code file. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>