spb/tendril Public

Tendril — web ingestion platform (scrape/crawl/map/search) on macOS Apple Silicon: WebKit fidelity, authenticated pages, deterministic testable extraction. A self-hosted Firecrawl alternative.

web-scraping crawler webkit macos typescript firecrawl swift fastify

JavaScript 82.6% TypeScript 11.8% HTML 5.3%

367 B · 6 lines typescript

Raw Blame History

1// author: simon-pierre boucher <contact@spboucher.ai>2export { parseRobots, isAllowed, crawlDelay, type Robots } from "./robots.js";3export { parseSitemap, type ParsedSitemap, type SitemapUrl } from "./sitemap.js";4export { getRobots, clearRobotsCache } from "./robots-cache.js";5export { mapSite, type MapOptions, type MappedLink, type MapSource } from "./map.js";6