SPB Git forge

spb/rareindex

Public
54commits 1branches 0releases
7.1 MBsize
maindefault branch
10 days agolast push
TypeScript 61.9% HTML 37.2% SQL 0.7%
2.4 KB · 56 lines json
Raw Blame History
1{2  "id": "spink",3  "displayName": "Spink & Son — sold lots since 2002 (coins, banknotes, stamps, medals)",4  "sourceId": "spink",5  "sourceName": "Spink & Son",6  "sourceType": "auction_house",7  "sourceUrl": "https://www.spink.com",8  "module": "api/spink",9  "enginePriority": [10    "api",11    "firecrawl"12  ],13  "categories": [14    "coins",15    "banknotes",16    "stamps",17    "medals"18  ],19  "regions": [20    "GB",21    "HK",22    "US",23    "SG"24  ],25  "languages": [26    "en"27  ],28  "currency": [29    "GBP",30    "HKD",31    "USD",32    "SGD",33    "EUR"34  ],35  "supportsListings": false,36  "supportsSold": true,37  "supportsAuctions": false,38  "supportsImages": true,39  "supportsCatalog": false,40  "supportsPopulation": false,41  "supportsLookup": true,42  "refreshFrequencyMinutes": 1440,43  "priority": "medium",44  "trustScore": 0.9,45  "attributionRequired": true,46  "termsUrl": "https://www.spink.com/terms-and-conditions",47  "accessNotes": "Plain HTTPS with the RareIndex user agent, 0 credits, no login; robots.txt is 'User-agent: * Disallow:' (everything allowed); Cloudflare in front but no challenge for the bot UA (HTTP 200). Pages read: /auctions/prices (the auction <select> lists 1 500+ sales since 11 Dec 2002 with date, sale number and title — the only place the sale date is printed), /auction/<code>?page=1 (category accordions with links to every lot of the sale; no prices) and /lot/<code><lot> (full description, 'Sold for £X', 'Starting price', CloudFront images). One request per lot, 1.5 s apart, ≤ 80 lots per run → a whole sale takes a few runs; the cursor keeps the lot list and index. Only coin / banknote / stamp / medal sales are crawled (wine, jewellery, handbags, autographs, bonds & shares are left to other connectors). 'Sold for' is stored with buyer_premium_included=null because Spink does not say on the page whether the premium is included; currency from the printed symbol (GBP; HK$/US$/S$ for the Hong Kong, New York and Singapore rooms). Sale date = the first day printed in the dropdown. Sales whose list page still redirects (302) to live.spink.com (results not yet published on the main site) are skipped and retried on later runs; live.spink.com itself is never crawled. Not fetched: archive keyword search, PDF catalogues, bidding/account pages.",48  "enabled": true,49  "schemaVersion": "1.0",50  "historicalDepth": "decades",51  "acquisitionMethod": "Static HTML lot pages (sale index → lot list → lot page)",52  "config": {53    "lotsPerRun": 8054  }55}56