SPB Git forge

spb/rareindex

Public
54commits 1branches 0releases
7.1 MBsize
maindefault branch
10 days agolast push
TypeScript 61.9% HTML 37.2% SQL 0.7%
2.3 KB · 36 lines json
Raw Blame History
1{2  "id": "noonans",3  "displayName": "Noonans Mayfair (ex Dix Noonan Webb) — hammer prices since 1991",4  "sourceId": "noonans",5  "sourceName": "Noonans Mayfair",6  "sourceType": "auction_house",7  "sourceUrl": "https://www.noonans.co.uk",8  "module": "firecrawl/noonans",9  "enginePriority": ["firecrawl", "scrapfly"],10  "categories": ["coins", "banknotes", "medals"],11  "regions": ["GB"],12  "languages": ["en"],13  "currency": ["GBP"],14  "supportsListings": false,15  "supportsSold": true,16  "supportsAuctions": false,17  "supportsImages": true,18  "supportsCatalog": false,19  "supportsPopulation": false,20  "supportsLookup": false,21  "refreshFrequencyMinutes": 1440,22  "priority": "high",23  "trustScore": 0.92,24  "attributionRequired": true,25  "termsUrl": "https://www.noonans.co.uk/help-and-information/#TermsAndConditions_UK",26  "accessNotes": "Firecrawl rendering (1 credit per page) because Cloudflare answers plain HTTPS with a 403 'Just a moment' challenge; the pages read are the public archive any visitor sees (no login — 'Your Cabinet', bidding and account pages are never touched). robots.txt: User-agent * Allow: / with Crawl-delay 2 (we wait 2.5 s, concurrency 1). Pages read: /archive/past-catalogues/ (≈ 700 catalogues back to 1991 with title and sale date; only coin / banknote / medal / token sales are crawled — jewellery, watches, silver and objects of vertu belong to other connectors) and /archive/past-catalogues/<id>/catalogue/?layout=list&offset=N (40 lots per page: lot number, full description ending with the printed estimate, 'Hammer Price: £X' or 'Unsold', lot id, thumbnail). Prices are hammer prices in GBP (buyer_premium_included=false; Noonans' premium is stated in the terms and is not part of the published figure); unsold lots are skipped. Sale date = the catalogue date (first day of two-day sales). Lot pages (/catalogue/<lotId>/) are used only as sourceUrl. Images are copyright Noonans (personal use only) — only the thumbnail URL is stored, never the file. Backfill iterates the catalogue list newest → oldest with per-catalogue progress.",27  "enabled": true,28  "schemaVersion": "1.0",29  "historicalDepth": "decades",30  "acquisitionMethod": "Firecrawl rendered HTML (archive catalogue list pages)",31  "config": {32    "auctionsPerRun": 1,33    "pagesPerRun": 2034  }35}36