SPB Git forge

spb/rareindex

Public
54commits 1branches 0releases
7.1 MBsize
maindefault branch
10 days agolast push
TypeScript 61.9% HTML 37.2% SQL 0.7%
2.6 KB · 38 lines json
Raw Blame History
1{2  "id": "comiclink",3  "displayName": "ComicLink (auction results archive)",4  "sourceId": "comiclink",5  "sourceName": "ComicLink",6  "sourceType": "auction_house",7  "sourceUrl": "https://www.comiclink.com",8  "module": "scrapfly/comiclink",9  "enginePriority": ["scrapfly"],10  "categories": ["comics", "marvel_comics", "dc_comics", "independent_comics", "art"],11  "regions": ["US"],12  "languages": ["en"],13  "currency": ["USD"],14  "supportsListings": false,15  "supportsSold": true,16  "supportsAuctions": true,17  "supportsImages": true,18  "supportsCatalog": false,19  "supportsPopulation": false,20  "supportsLookup": false,21  "refreshFrequencyMinutes": 10080,22  "priority": "high",23  "trustScore": 0.85,24  "attributionRequired": true,25  "termsUrl": "https://www.comiclink.com/TermsConditionsBuying.asp",26  "accessNotes": "Reads two kinds of public pages only: the auction schedule (/auctions/auctionschedule.asp, 'Record-Setting Auction Results' section listing every past session since 2015 with its month range, e.g. 'Spring Featured: Comics (5-6/26)') and the per-session results pages (/results/generate_highlights.asp?output=<code>, ~300 sold books each as 'TITLE #N / SOLD in CGC 9.4 NM / $1,365' with a cover image and a link to the item page). robots.txt (Cloudflare managed): `User-agent: *` Allow: / with Content-Signal search=yes, ai-train=no — we store sale facts and link back. Every page (even robots-allowed ones) is served behind a Cloudflare managed JavaScript challenge to plain HTTP clients, so pages are fetched through Scrapfly without JS rendering (~1 credit per page, 3 s politeness, concurrency 1). Item pages (/auctions/item.asp?id=N) show the end date but hide the price behind a login ('Current Bid: Sign-In') and are therefore NOT fetched; the exchange, bidder histories, ComicTrack and account areas are never touched. Dates: the results pages carry no per-lot date, so saleDate = first day of the session's closing month from the schedule label (metadata.sale_date_precision='month', confidence 0.7); sessions whose label has no month are skipped. ComicLink does not state on these pages whether a buyer's premium applies → buyerPremiumIncluded=null. Art-only sessions are skipped unless config.includeArtSessions=true; original-art items inside mixed 'Premium Comics and Art' sessions are categorised as art and flagged metadata.comic_art.",27  "enabled": true,28  "schemaVersion": "1.0",29  "acquisitionMethod": "Scrapfly (no JS) — public results pages",30  "historicalDepth": "decades",31  "requires": ["SCRAPFLY_API_KEY"],32  "config": {33    "sessionsPerRun": 2,34    "backfillSessionsPerRun": 30,35    "includeArtSessions": false36  }37}38