SPB Git

spb/tendril Public

Tendril — web ingestion platform (scrape/crawl/map/search) on macOS Apple Silicon: WebKit fidelity, authenticated pages, deterministic testable extraction. A self-hosted Firecrawl alternative.

JavaScript 82.6% TypeScript 11.8% HTML 5.3%
992 B · 32 lines yaml
Raw Blame History
1# author: simon-pierre boucher <contact@spboucher.ai>2# Reference ngrok configuration (§16.2). In production Tendril is launched via3# PM2 (deploy/ecosystem.config.cjs) with `ngrok http --url=www.ten-dril.com <port>`,4# matching the other cluster apps. This file documents the richer Traffic Policy5# setup for when Caddy/edge rate-limiting is introduced.6version: "3"7agent:8  authtoken: ${NGROK_AUTHTOKEN}9  log: /usr/local/var/log/ngrok.log10  log_level: info11  connect_timeout: 10s12endpoints:13  - name: tendril-api14    url: https://www.ten-dril.com15    upstream:16      url: 809217    traffic_policy:18      inbound:19        - actions:20            - type: rate-limit21              config:22                name: global23                algorithm: sliding_window24                capacity: 60025                rate: 60s26        - expressions:27            - "req.url.path.startsWith('/internal')"28          actions:29            - type: deny30              config:31                status_code: 40432