SPB Git forge

spb/rareindex

Public
54commits 1branches 0releases
7.1 MBsize
maindefault branch
10 days agolast push
TypeScript 61.9% HTML 37.2% SQL 0.7%
1.4 KB · 33 lines json
Raw Blame History
1{2  "id": "subdial",3  "displayName": "Subdial (UK pre-owned watch listings)",4  "sourceId": "subdial",5  "sourceName": "Subdial",6  "sourceType": "marketplace",7  "sourceUrl": "https://subdial.com",8  "module": "api/subdial",9  "enginePriority": ["api", "firecrawl"],10  "categories": ["watches", "rolex", "patek_philippe", "audemars_piguet", "omega", "other_watches"],11  "regions": ["GB"],12  "languages": ["en"],13  "currency": ["GBP"],14  "supportsListings": true,15  "supportsSold": false,16  "supportsAuctions": false,17  "supportsImages": true,18  "supportsCatalog": false,19  "supportsPopulation": false,20  "supportsLookup": true,21  "refreshFrequencyMinutes": 720,22  "priority": "medium",23  "trustScore": 0.8,24  "attributionRequired": true,25  "termsUrl": "https://subdial.com/terms",26  "accessNotes": "Listing URLs come from the public sitemap (subdial.com/sitemap-listing.xml); each listing page embeds a schema.org Product (brand, mpn = reference, sku = Subdial id, GBP price, availability) plus a specification table (reference, year, condition, box, papers). robots.txt allows / for generic agents (it blocks a list of named AI crawlers, which we are not). Plain HTTPS with the RareIndex user agent, 1.5 s between pages, capped per run; the crawl budget skips URLs already fetched recently.",27  "enabled": true,28  "schemaVersion": "1.0",29  "config": {30    "maxListingsPerRun": 25031  }32}33