Source catalog (SPEC §4)
Generated from data/sources/sources.json by scripts/build-sources.ts on 2026-09-08. Edit the JSON, not this file.
443 sources researched · implemented: 201 · partial: 2 · gated: 10 · planned: 11 · researching: 3 · blocked: 108 · rejected: 108
Status legend: implemented connector in production · partial connector exists but incomplete (see reason) · gated needs an API key/partner access we do not hold · planned researched, connector to build · researching facts not yet verified · blocked login/anti-bot/robots prevents lawful public access · rejected not worth building (see reason).
By country
| Country | Sources | Implemented |
|---|---|---|
| AT | 1 | 0 |
| AU | 13 | 7 |
| BE | 1 | 1 |
| CA | 32 | 17 |
| CH | 4 | 2 |
| CN | 1 | 0 |
| DE | 24 | 8 |
| DK | 1 | 0 |
| ES | 5 | 1 |
| EU | 1 | 1 |
| FI | 1 | 0 |
| FR | 19 | 7 |
| GB | 58 | 28 |
| HK | 6 | 2 |
| IL | 1 | 0 |
| IT | 4 | 1 |
| JP | 27 | 10 |
| KR | 2 | 1 |
| LT | 1 | 0 |
| NL | 7 | 2 |
| NZ | 7 | 3 |
| PL | 1 | 0 |
| SE | 4 | 1 |
| SG | 6 | 2 |
| TW | 2 | 1 |
| US | 210 | 104 |
| global | 4 | 4 |
By category
action_figures (22)
| Source | Domain | Country | Type | Status | Connectors | API | Live | Sold | Auction | Hist. | Pop. | Cert | GTIN | JS | Anti-bot | Pagination | Engine | Currency | Priority | Difficulty | Notes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| AmiAmi | amiami.com | JP | marketplace | implemented | amiami | · | ✓ | · | · | none | · | · | · | ✓ | high (CF) | page_number | scrapfly | JPY | wave2 | hard | entry synthesized from connector meta.json |
| Big in Japan | biginjap.com | JP | dealer | rejected | — | · | ✓ | · | · | none | · | · | · | · | none | unknown | none | EUR | later | medium | Custom (PrestaShop-like) storefront; no product JSON. |
| BigBadToyStore | bigbadtoystore.com | US | dealer | implemented | bbts | · | ✓ | · | · | none | · | · | · | ✓ | low | page_number | firecrawl | USD | wave3 | medium | entry synthesized from connector meta.json |
| Entertainment Earth | entertainmentearth.com | US | dealer | implemented | entertainment-earth | · | ✓ | · | · | none | · | · | · | · | high (CF) | page_number | scrapfly | USD | wave2 | medium | 60 tiles/page; action figures ≈ 73 pages. Manufacturer (data-company) and franchise (data-theme) are structured. Statues/model kits exist but the taxonomy has no slug for statues. |
| Figuya | figuya.com | DE | dealer | rejected | — | · | ✓ | · | · | none | · | · | · | · | none | unknown | firecrawl | EUR | later | medium | Custom storefront (no Shopify/Woo JSON); German anime-figure retailer. Candidate for a later JSON-LD connector. |
| Hobby Japan HK | hobbyjapan.hk | HK | dealer | rejected | — | · | ✓ | · | · | none | · | · | · | · | none | unknown | none | HKD | later | medium | Host unreachable at probe time. |
| Japan Figure Store | japanfigurestore.com | JP | dealer | rejected | — | · | ✓ | · | · | none | · | · | · | · | none | unknown | none | USD | later | medium | Host unreachable at probe time. |
| Kapow Toys | kapowtoys.co.uk | GB | dealer | implemented | kapowtoys | · | ✓ | · | · | none | · | · | · | · | none | page_number | woocommerce | GBP | wave3 | easy | UK action-figure specialist (WooCommerce): Hot Toys, NECA, Mezco One:12, Marvel Legends, Star Wars Black Series, Masters of the Universe, TMNT, G.I. Joe, McFarlane, Medicom MAFEX, Transformers Masterpiece and 3rd-party Transformers, Gunpla and busts/statues. Prices come from the Store API in minor units with an explicit currency_code (GBP, currency_minor_unit 2); the adapter uses that code when present. |
| Kotobukiya Shop | kotobukiya.com | JP | dealer | rejected | — | · | ✓ | · | · | none | · | · | · | · | none | unknown | none | JPY | later | medium | Host unreachable at probe time (manufacturer shop). |
| Mandarake | mandarake.co.jp | JP | dealer | blocked | — | · | · | · | · | none | · | · | · | · | blocking | unknown | none | JPY | later | medium | Bot protection returns challenge pages to all engines. |
| Meccha Japan | meccha-japan.com | FR | dealer | rejected | — | · | ✓ | · | · | none | · | · | · | · | none | unknown | none | EUR | later | medium | PrestaShop storefront; no public product JSON. |
| MyFigureCollection | myfigurecollection.net | FR | collector_database | blocked | — | · | · | · | · | none | · | · | · | · | high | unknown | none | JPY | later | medium | Anti-bot challenge; API requires account approval. |
| Nin-Nin Game | nin-nin-game.com | FR | dealer | rejected | — | · | ✓ | · | · | none | · | · | · | · | none | unknown | none | EUR | later | medium | PrestaShop storefront; no public product JSON. |
| Ninoma | ninoma.com | JP | dealer | implemented | ninoma | · | ✓ | · | · | none | · | · | ✓ | · | none | page_number | shopify | JPY | wave3 | easy | Fukuoka-based Japanese hobby exporter ("Nihon no Market", 50k SKUs): scale figures, Nendoroid, figma, S.H.Figuarts, MAFEX, prize figures, Gunpla/model kits, Pokémon/Weiß Schwarz/One Piece/MTG Japanese TCG products, plush and Moncolle. SKUs are JAN-13 barcodes. Prices are the base currency JPY as integers (e.g. "9265"; Shopify.currency active JPY rate 1.0, /meta.json currency JPY, country JP) — tax-free export prices. JAN codes are in the sku field (identifiers.sku). |
| Sideshow Collectibles | sideshow.com | US | dealer | planned | — | · | ✓ | · | · | none | · | · | ✓ | ✓ | medium | infinite_scroll | firecrawl | USD | wave3 | hard | Not implemented this wave: the sitemap index has no product sitemap and listing pages are Livewire-rendered (product grid loaded client-side); needs Firecrawl rendering of /collectibles?… + JSON-LD product pages. Queue-it waiting room adds flakiness. |
| Simply Toys | simplytoys.com.sg | SG | dealer | rejected | — | · | ✓ | · | · | none | · | · | · | · | none | unknown | none | SGD | later | medium | PrestaShop storefront; no product JSON. |
| Solaris Japan | solarisjapan.com | US | dealer | implemented | solarisjapan | · | ✓ | · | · | none | · | · | · | · | none | page_number | shopify | USD | wave3 | easy | Anime figure and Japanese retro-game store (US-registered, ships from Japan): 70k figures (Nendoroid, figma, Pop Up Parade, prize figures, Revoltech), pre-owned and brand-new variants with separate prices, Japanese retro games (Famicom/Super Famicom, PS1, Mega Drive, DS/3DS/Switch) and Japanese One Piece/Pokémon TCG products. Adult (nsfw-tagged) figures are excluded. Prices are the base currency USD (/meta.json currency USD, country US, Shopify.currency rate 1.0). Variants "Brand New" / "Pre-Owned" / "Retro Game" price each condition separately; a 0.00 price marks an unavailable condition and is dropped (no listing without a price). |
| Super7 | super7.com | US | dealer | implemented | super7 | · | ✓ | · | · | none | · | · | · | · | none | page_number | shopify | USD | wave3 | easy | Super7 brand store (ReAction, Ultimates!, Kandy Kaiju soft vinyl, G.I. Joe, Godzilla, TMNT, music figures). Shopify storefront; product_type Figures vs Apparel. ~3.6k products; 2k movie/TV figures, 400 music figures, ReAction/Ultimates!/soft vinyl. Verified live 2026-09-08: robots.txt, /products.json?limit=1 (200 JSON), /collections.json, /meta.json currency=USD. |
| TFSource | tfsource.com | US | dealer | blocked | — | · | ✓ | · | · | none | · | · | · | · | high (CF) | unknown | none | USD | later | very_hard | robots.txt: User-agent: * Disallow: / (verified through Scrapfly on 2026-09-08 — the site also serves a Cloudflare challenge). |
| Tokyo Hunter | tokyo-hunter.com | JP | dealer | rejected | — | · | ✓ | · | · | none | · | · | · | · | none | unknown | none | JPY | later | medium | Domain parked/for sale (redirects to Dynadot). |
| Tokyo Otaku Mode | otakumode.com | JP | dealer | rejected | — | · | ✓ | · | · | none | · | · | · | · | none | unknown | none | USD | later | medium | Custom platform (CSRF-protected app); no public product JSON. AmiAmi/HobbySearch/Ninoma/Solaris cover figures. |
| Toyzone | toyzone.co.uk | GB | dealer | rejected | — | · | ✓ | · | · | none | · | · | · | · | none | unknown | none | GBP | later | medium | Host unreachable at probe time. |
advertising (1)
| Source | Domain | Country | Type | Status | Connectors | API | Live | Sold | Auction | Hist. | Pop. | Cert | GTIN | JS | Anti-bot | Pagination | Engine | Currency | Priority | Difficulty | Notes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Miller & Miller Auctions | live.millerandmillerauctions.com | CA | auction_house | implemented | miller-miller | · | · | ✓ | ✓ | years | · | · | · | · | none | page_number | api | CAD | wave2 | easy | 143 auctions in the sitemap (2020→). 36 lots per page, 'sold'/'expired' status, estimates, CAD. Live probe 2026-09-08: closed watches sale → 35 sales/page; open sports-card sale → 36 auction lots/page. |
antiques (10)
| Source | Domain | Country | Type | Status | Connectors | API | Live | Sold | Auction | Hist. | Pop. | Cert | GTIN | JS | Anti-bot | Pagination | Engine | Currency | Priority | Difficulty | Notes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Auctionet | auctionet.com | SE | marketplace | implemented | auctionet | ✓ (none) | ✓ | ✓ | ✓ | years | · | · | · | · | none | page_number | api | SEK/EUR/DKK/GBP | wave1 | easy | 3.9 M closed lots since 2011 across ~100 Nordic/European houses (Stockholms Auktionsverk, Crafoord, Uppsala Auktionskammare, Bruun Rasmussen online…). Titles in the consigning house's language. |
| AuctionZip | auctionzip.com | US | marketplace | rejected | — | · | · | · | · | none | · | · | · | · | medium | unknown | none | USD | later | hard | Bot UA denied at the edge and, more importantly, the site is a calendar of upcoming sales without realised prices — no sale data to gain. |
| Barnebys | barnebys.com | SE | marketplace | blocked | — | · | ✓ | ✓ | ✓ | decades | · | · | · | ✓ | medium | page_number | none | EUR/USD/GBP/SEK | later | very_hard | robots.txt disallows everything for User-agent: * and states crawling is prohibited without written permission; aggregator anyway (sources covered directly). |
| BidSpotter | bidspotter.com | US | marketplace | rejected | — | · | · | · | ✓ | months | · | · | · | · | low | unknown | none | USD/GBP | later | hard | robots disallow /archivelot (prices realised) and the inventory is industrial equipment, not collectibles. |
| Dunbar Sloane | auctions.dunbarsloane.co.nz | NZ | auction_house | implemented | dunbar-sloane | · | · | ✓ | ✓ | years | · | · | · | · | none | page_number | api | NZD | wave2 | medium | 69 past auctions listed. |
| Invaluable | invaluable.com | US | marketplace | blocked | — | · | ✓ | ✓ | ✓ | decades | · | · | · | ✓ | high | page_number | none | USD/GBP/EUR | later | very_hard | Confirmed 2026-09-08 (one curl): robots.txt prohibits automated access; the sold-lot search is a JS app whose realised prices require an account. Do not retry. |
| Lawsons | lawsons.com.au | AU | auction_house | blocked | — | · | · | ✓ | ✓ | years | · | · | · | · | blocking | unknown | none | AUD | later | very_hard | CloudFront 403 'Access Denied' for the honest UA on robots.txt and the home page. |
| Lot-tissimo (ATG) | lot-tissimo.com | DE | marketplace | blocked | — | · | ✓ | ✓ | ✓ | years | · | · | · | ✓ | high | page_number | none | EUR | later | very_hard | Same ATG platform and WAF as the-saleroom; robots.txt disallows the archived-lot pages. Underlying German houses are approached directly (Lempertz, Ketterer, Grisebach). |
| Tennants Auctioneers | tennants.co.uk | GB | auction_house | blocked | — | · | · | ✓ | ✓ | years | · | · | · | ✓ | blocking (CF) | unknown | none | GBP | later | very_hard | All results URLs redirect to auctions.tennants.co.uk, which returns a 403 Cloudflare 'Just a moment…' challenge. |
| the-saleroom (ATG) | the-saleroom.com | GB | marketplace | blocked | — | · | ✓ | ✓ | ✓ | years | · | · | · | ✓ | high | page_number | none | GBP/EUR | later | very_hard | AWS WAF JavaScript challenge on every page (challenge.js), robots.txt disallows the archived-lot (prices realised) pages, and the price-results URL redirects to an error page. Aggregator platform — the underlying houses are covered directly instead (Sworders, Chiswick, Dominic Winter…). |
art (33)
| Source | Domain | Country | Type | Status | Connectors | API | Live | Sold | Auction | Hist. | Pop. | Cert | GTIN | JS | Anti-bot | Pagination | Engine | Currency | Priority | Difficulty | Notes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Ader | ader-paris.fr | FR | auction_house | implemented | ader | · | · | ✓ | ✓ | decades | · | · | · | · | none | offset | api | EUR | wave1 | medium | Years 2004→today; sales without an online catalogue (cataPasDispo) are skipped. |
| Aguttes | aguttes.com | FR | auction_house | implemented | aguttes | · | · | ✓ | ✓ | years | · | · | · | · | none | page_number | api | EUR | wave1 | easy | hammer_price explicit; premium tiers in auction JSON. |
| Artcurial | artcurial.com | FR | auction_house | implemented | artcurial | · | · | ✓ | ✓ | none | · | · | · | ✓ | low | page_number | firecrawl | EUR | wave2 | medium | entry synthesized from connector meta.json |
| Artnet Price Database | artnet.com | US | pricing_guide | rejected | — | · | · | ✓ | ✓ | decades | · | · | · | ✓ | high | none | none | USD | later | very_hard | Paid, subscription-only price database (per brief). |
| Artsy | artsy.net | US | marketplace | rejected | — | ✓ (api_key) | ✓ | ✓ | ✓ | decades | · | · | · | ✓ | blocking (CF) | cursor | none | USD | later | very_hard | API licensed for non-commercial use only (no prices anyway); website Cloudflare-challenged and price database login-gated. Saatchi Art connector already covers online art listings. |
| Bernaerts Auctioneers | live.bernaerts.eu | BE | auction_house | implemented | bernaerts | · | · | ✓ | ✓ | years | · | · | · | · | none | page_number | api | EUR | wave2 | easy | 319 past auctions. |
| Bukowskis | bukowskis.com | SE | auction_house | blocked | — | · | ✓ | · | · | none | · | · | · | · | none | sitemap | none | SEK/EUR | wave2 | hard | Realised prices are not shown publicly: archived lot pages (archived_lots*.xml.gz sitemaps, e.g. lot 1569873 ended 2024-07-17) show 'Auction ended' and a 'contact us for a valuation' box instead of the result; live lot lists only show 'Current bid'. Only login-gated result access → not crawled. |
| Cambi Casa d'Aste | cambiaste.com | IT | auction_house | blocked | — | · | · | ✓ | ✓ | years | · | · | · | ✓ | blocking (CF) | unknown | none | EUR | later | very_hard | Cloudflare 'Just a moment…' JS challenge (403) on / and /it/risultati.asp for the honest UA. |
| Cowley Abbott | cowleyabbott.ca | CA | auction_house | blocked | — | · | · | ✓ | ✓ | years | · | · | · | ✓ | high (CF) | unknown | none | CAD | later | very_hard | Cloudflare JS challenge on every page. Not fought. |
| Drouot | drouot.com | FR | auction_house | blocked | — | · | · | · | ✓ | decades | · | · | · | · | blocking | unknown | none | EUR | later | medium | Results require a paid subscription (Drouot Digital); bot protection. |
| Durán Arte y Subastas | duran-subastas.com | ES | auction_house | blocked | — | · | · | · | ✓ | years | · | · | · | ✓ | none | infinite_scroll | none | EUR | later | hard | Lot grid is an empty div filled by a CSRF-protected POST (infinite scroll) and realised prices require an account. |
| Est-Ouest Auctions | est-ouest.co.jp | JP | auction_house | rejected | — | · | · | ✓ | ✓ | years | · | · | · | · | none | bulk_file | api | JPY | later | medium | Result PDFs list lot number + price (incl. buyer's premium) only — no titles — so prices cannot be attributed to assets. |
| Freeman's | Hindman | hindmanauctions.com | US | auction_house | blocked | — | · | · | ✓ | ✓ | years | · | · | · | ✓ | high | unknown | none | USD | later | very_hard | freemansauction.com serves a Vercel Security Checkpoint (429) to every request. Not fought. |
| Grisebach | grisebach.com | DE | auction_house | planned | — | · | · | ✓ | ✓ | decades | · | · | · | ✓ | none | infinite_scroll | api | EUR | wave3 | medium | Archive listing needs Livewire POST; result PDFs (lot/sale/price only) parse cleanly but lack titles → PDF + object-page connector planned for a later wave. |
| Heffel Fine Art Auction House | heffel.com | CA | auction_house | implemented | heffel | · | · | ✓ | · | none | · | · | · | · | none | page_number | api | CAD | wave2 | easy | entry synthesized from connector meta.json |
| Il Ponte Casa d'Aste | ponteonline.com | IT | auction_house | planned | — | · | · | ✓ | ✓ | years | · | · | · | · | none | page_number | api | EUR | wave3 | medium | Feasible server-rendered pages but robots Crawl-delay of 120 s makes throughput ~30 pages/hour; deferred to a later wave. |
| Ketterer Kunst | kettererkunst.de | DE | auction_house | planned | — | · | · | ✓ | ✓ | decades | · | · | · | · | none | offset | api | EUR | wave2 | medium | Feasible (server-rendered detail pages with € 5.500.000 'inklusive Aufgeld'); per-auction result listing URL not confirmed within budget → next wave. |
| Koller Auktionen | kollerauktionen.ch | CH | auction_house | blocked | — | · | · | ✓ | ✓ | years | · | · | · | ✓ | blocking | unknown | none | CHF | later | very_hard | Every URL (robots.txt, home, Auktionsergebnisse) returns a 2.4 KB JavaScript 'leastFactor' anti-bot challenge for both bot and browser UAs; solving challenges is out of policy. |
| Kunsthaus Lempertz | lempertz.com | DE | auction_house | implemented | lempertz | ✓ (none) | · | ✓ | ✓ | decades | · | · | · | · | none | none | api | EUR | wave1 | easy | ~300 auctions back to the 2000s; ~30k lot pages in sitemaps (not fetched individually). |
| LiveAuctioneers | liveauctioneers.com | US | marketplace | blocked | — | · | · | ✓ | ✓ | decades | · | · | · | ✓ | high | unknown | none | USD | later | very_hard | Prices realized behind login; robots disallow pagination parameters and APIs. Re-verified quickly on 2026-09-08 (homepage 200, robots as described); not fought. |
| Lyon & Turnbull | lyonandturnbull.com | GB | auction_house | implemented | lyon-turnbull | ✓ (none) | · | ✓ | ✓ | none | · | · | · | · | none | page_number | api | GBP | wave2 | easy | entry synthesized from connector meta.json |
| Mallet Japan | mallet.co.jp | JP | auction_house | rejected | — | · | · | ✓ | ✓ | decades | · | · | · | · | none | bulk_file | api | JPY | later | medium | Results are PDFs listing only lot number and 落札価格 (no titles, no images) since 2005 — prices cannot be tied to an asset without the catalogue. |
| MutualArt | mutualart.com | US | pricing_guide | rejected | — | · | · | ✓ | ✓ | decades | · | · | · | ✓ | high | none | none | USD | later | very_hard | Paid membership data (per brief). |
| Phillips | phillips.com | US | auction_house | implemented | phillips-art, phillips-watches | · | · | ✓ | ✓ | none | · | · | · | ✓ | low | page_number | firecrawl | USD/GBP/HKD/CHF/EUR | wave2 | medium | entry synthesized from connector meta.json |
| Poly Auction Hong Kong | polyauction.com.hk | HK | auction_house | gated | — | ✓ (api_key) | · | ✓ | ✓ | years | · | · | · | ✓ | none | unknown | none | HKD | wave3 | hard | Public API requires a client secret key injected at runtime by the Angular app (not in the bundle); pages are an empty SPA shell. Would need browser rendering (Scrapfly JS) — deferred. |
| Saatchi Art | saatchiart.com | US | marketplace | implemented | saatchi-art | · | ✓ | · | · | none | · | · | · | · | none | page_number | api | USD | wave2 | easy | entry synthesized from connector meta.json |
| Shinwa Auction | shinwa-auction.com | JP | auction_house | planned | — | · | · | ✓ | ✓ | years | · | · | · | · | none | bulk_file | api | JPY | wave3 | medium | Feasible via extractPdfPages (artist + title + hammer + incl.-fees JPY columns) but no lot URLs/images; planned for a PDF-connector wave. |
| Tajan | tajan.com | FR | auction_house | blocked | — | · | · | ✓ | ✓ | years | · | · | · | · | blocking | unknown | none | EUR | later | very_hard | WAF returns 403 'Access Denied — request blocked by our security policies' for the honest bot UA on every URL including robots.txt. |
| Tokyo Chuo Auction (tcabid.com) | tcabid.com | HK | auction_house | implemented | tokyo-chuo | ✓ (none) | ✓ | ✓ | ✓ | years | · | · | · | · | none | page_number | api | HKD/JPY/TWD | wave1 | easy | Currency per auction category (jpy/hkd/twd). |
| Van Ham Kunstauktionen | van-ham.com | DE | auction_house | researching | — | · | · | ✓ | ✓ | years | · | · | · | · | none | unknown | api | EUR | wave3 | medium | Origin timed out (25 s, twice) on / and /de/sitemap.xml during research while robots.txt answered; retry later. |
| Venduehuis der Notarissen | venduehuis.com | NL | auction_house | rejected | — | · | · | ✓ | ✓ | years | · | · | · | ✓ | none | unknown | none | EUR | later | hard | Hash-routed Artisio SPA with no server-rendered lots; the Artisio web API needs an undocumented client id/shape → would require browser rendering for low volume. Not worth it now. |
| Waddington's | waddingtons.ca | CA | auction_house | blocked | — | · | · | ✓ | ✓ | years | · | · | · | · | medium (CF) | unknown | none | CAD | later | hard | bid.waddingtons.ca (catalogue/results platform) serves 'Access Denied' to the bot UA — a UA-based WAF rule we do not evade; wine.waddingtons.ca robots disallow all current galleries; www.waddingtons.ca only has narrative results posts (top lots). No complete public prices-realized archive reachable within policy. |
| Webb's | webbs.co.nz | NZ | auction_house | blocked | — | · | · | ✓ | ✓ | years | · | · | · | ✓ | blocking | unknown | none | NZD | later | very_hard | Catalogue host auctions.webbs.co.nz returns CloudFront 403 'Request blocked'; the www site has no prices. |
audio_equipment (1)
| Source | Domain | Country | Type | Status | Connectors | API | Live | Sold | Auction | Hist. | Pop. | Cert | GTIN | JS | Anti-bot | Pagination | Engine | Currency | Priority | Difficulty | Notes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| HiFiShark | hifishark.com | EU | analytics_provider | implemented | hifishark | ✓ (none) | ✓ | · | · | none | · | · | · | · | none | page_number | api | EUR/USD/GBP/JPY/CHF/SEK/DKK/NOK/PLN/CAD/AUD | wave3 | easy | entry synthesized from connector meta.json |
autographs (2)
| Source | Domain | Country | Type | Status | Connectors | API | Live | Sold | Auction | Hist. | Pop. | Cert | GTIN | JS | Anti-bot | Pagination | Engine | Currency | Priority | Difficulty | Notes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Nate D. Sanders Auctions | natedsanders.com | US | auction_house | blocked | — | · | · | ✓ | ✓ | years | · | · | · | · | none | unknown | none | USD | later | medium | The only public results page is disallowed by robots.txt (Disallow: /AuctionResults.aspx; Google agents whitelisted only). Respected; nothing else exposes prices. |
| Swann Auction Galleries | swanngalleries.com | US | auction_house | implemented | swann | · | · | ✓ | · | none | · | · | · | · | none | page_number | api | USD | wave2 | easy | entry synthesized from connector meta.json |
automobiles (12)
| Source | Domain | Country | Type | Status | Connectors | API | Live | Sold | Auction | Hist. | Pop. | Cert | GTIN | JS | Anti-bot | Pagination | Engine | Currency | Priority | Difficulty | Notes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Barrett-Jackson | barrett-jackson.com | US | auction_house | blocked | — | · | · | · | · | none | · | · | · | · | blocking | unknown | none | USD | later | medium | Anti-bot blocks results pages. |
| Bring a Trailer | bringatrailer.com | US | auction_house | implemented | bring-a-trailer | ✓ (none) | · | ✓ | · | none | · | · | · | · | none | page_number | api | USD/CAD/GBP/EUR | wave1 | easy | entry synthesized from connector meta.json |
| Cars & Bids | carsandbids.com | US | auction_house | implemented | cars-and-bids | · | · | ✓ | · | none | · | · | · | ✓ | low (CF) | page_number | firecrawl | USD/CAD | wave1 | medium | entry synthesized from connector meta.json |
| Collecting Cars | collectingcars.com | GB | auction_house | implemented | collecting-cars | · | · | ✓ | · | none | · | · | · | ✓ | low (CF) | page_number | firecrawl | GBP/EUR/AUD/USD/AED | wave3 | medium | entry synthesized from connector meta.json |
| Gooding & Company | goodingco.com | US | auction_house | implemented | gooding | ✓ (none) | · | ✓ | · | none | · | · | · | · | none | page_number | api | USD/GBP/EUR | wave2 | easy | entry synthesized from connector meta.json |
| Hagerty Valuation Tools | hagerty.com | US | pricing_guide | blocked | — | · | · | · | · | none | · | · | · | · | high | unknown | none | USD | later | medium | Valuation tool is a member product; terms forbid extraction. |
| Historics Auctioneers | historics.co.uk | GB | auction_house | implemented | historics | · | · | ✓ | · | none | · | · | · | · | none | page_number | api | GBP | wave3 | easy | entry synthesized from connector meta.json |
| Lloyds Auctions | lloydsonline.com.au | AU | auction_house | rejected | — | · | ✓ | · | · | none | · | · | · | ✓ | none | infinite_scroll | none | AUD | later | hard | No public realised-price pages: closed auctions show no lots, lot pages only show a live 'current bid'; lot lists need __doPostBack JS. |
| Mecum Auctions | mecum.com | US | auction_house | implemented | mecum | · | · | ✓ | · | none | · | · | · | ✓ | low | page_number | firecrawl | USD | wave1 | medium | entry synthesized from connector meta.json |
| PCARMARKET | pcarmarket.com | US | auction_house | implemented | pcarmarket | ✓ (none) | · | ✓ | · | none | · | · | · | · | none | page_number | api | USD | wave1 | easy | entry synthesized from connector meta.json |
| RM Sotheby's | rmsothebys.com | US | auction_house | implemented | rm-sothebys | · | · | ✓ | · | none | · | · | · | ✓ | low | page_number | firecrawl | USD/EUR/GBP/CHF/AED | wave2 | medium | entry synthesized from connector meta.json |
| The Market by Bonhams | themarket.co.uk | GB | auction_house | implemented | the-market-bonhams | · | · | ✓ | · | none | · | · | · | · | none | page_number | api | GBP/EUR/AUD/USD | wave2 | easy | entry synthesized from connector meta.json |
banknotes (3)
| Source | Domain | Country | Type | Status | Connectors | API | Live | Sold | Auction | Hist. | Pop. | Cert | GTIN | JS | Anti-bot | Pagination | Engine | Currency | Priority | Difficulty | Notes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Banknote World | banknoteworld.com | US | dealer | planned | — | · | ✓ | · | · | none | · | · | · | · | high (CF) | page_number | firecrawl | USD | wave3 | medium | Reachable through Firecrawl (home page rendered, X-Cart category pages) but dealer asks for banknotes rank below the auction-result sources; deferred. |
| Lyn Knight Auctions | lynknight.com | US | auction_house | rejected | — | · | · | · | ✓ | months | · | · | · | ✓ | none | page_number | api | USD | later | medium | No public realised-price archive (login); public catalogues (~1 year, ids 1624+) show only 'Current Price/Current Bid' without a sale date or hammer/premium label → cannot be recorded honestly as sales. |
| PMG (Paper Money Guaranty) | pmgnotes.com | US | grading_company | implemented | pmg-cert | · | · | · | · | none | ✓ | ✓ | · | ✓ | high (CF) | none | firecrawl | USD | wave2 | medium | Same grade-in-URL limitation as NGC. |
baseball_cards (7)
| Source | Domain | Country | Type | Status | Connectors | API | Live | Sold | Auction | Hist. | Pop. | Cert | GTIN | JS | Anti-bot | Pagination | Engine | Currency | Priority | Difficulty | Notes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Clean Sweep Auctions | cleansweepauctions.com | US | auction_house | implemented | clean-sweep | · | · | ✓ | ✓ | decades | · | · | · | · | none | page_number | api | USD | wave3 | easy | 203 monthly past auctions (January 2006 → December 2025), 50 lots per list page, one request per lot page ('Winning bid: $70.00'). Live probe 2026-09-08: December 2025 page → 3 lots → 3 sales. |
| Fanatics Collect | fanaticscollect.com | US | marketplace | implemented | fanatics-collect | · | ✓ | ✓ | ✓ | years | · | · | · | · | low (CF) | sitemap | api | USD | wave1 | medium | Sales since January 2022 (Weekly Auction #1). 55 weekly-auction sales-history sitemaps (~2.7 M URLs) and 7 fixed-price sitemaps; fixed-price pages may carry collectSales: [] (no sale) and are skipped. Live probe 2026-09-08: newest child → 3 item pages → 3 sales (PSA/CGC graded). |
| Huggins & Scott Auctions | hugginsandscott.com | US | auction_house | rejected | — | · | · | · | · | none | · | · | · | ✓ | low (CF) | unknown | none | USD | later | very_hard | No public prices-realized archive: /lots?lots_range=past is an empty SPA shell (0 lot summaries server-side, no sitemap); the platform API requires a client token. Same vendor as REA. |
| Love of the Game Auctions | loveofthegameauctions.com | US | auction_house | blocked | — | · | · | ✓ | ✓ | years | · | · | · | · | blocking (CF) | unknown | none | USD | later | very_hard | Cloudflare WAF 403 block page for every request. Not fought. |
| Memory Lane Inc | memorylaneinc.com | US | auction_house | blocked | — | · | · | ✓ | ✓ | years | · | · | · | · | blocking (CF) | unknown | none | USD | later | very_hard | Cloudflare 'Attention Required / Sorry, you have been blocked' on the homepage for the honest bot UA and for a browser UA — a WAF rule, not a JS challenge. Not fought (SPEC §36). |
| Mile High Card Company | milehighcardco.com | US | auction_house | blocked | — | · | · | ✓ | ✓ | years | · | · | · | · | blocking | unknown | none | USD | later | very_hard | Akamai 'Access Denied' for every request incl. robots.txt. Not fought. |
| Robert Edward Auctions (REA) | collectrea.com | US | auction_house | rejected | — | · | · | · | · | none | · | · | · | ✓ | low (CF) | unknown | none | USD | later | very_hard | robertedwardauctions.com redirects to collectrea.com; the public /lots?lots_range=past page (plain HTTP and a Firecrawl render) shows no lots and no prices — the archive is behind the bidding app (401 JSON API needing a client token). No sitemap. Nothing public to read; do not retry until REA publishes a results archive. |
board_games (7)
| Source | Domain | Country | Type | Status | Connectors | API | Live | Sold | Auction | Hist. | Pop. | Cert | GTIN | JS | Anti-bot | Pagination | Engine | Currency | Priority | Difficulty | Notes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Board Game Bliss | boardgamebliss.com | CA | dealer | rejected | — | · | · | · | · | none | · | · | · | · | none | unknown | none | CAD | later | hard | Shopify (verified) but a general new-board-game retailer: collections are player-count/mechanic buckets and clearance sales, no collectible focus (no Kickstarter-exclusive / out-of-print segmentation). Not worth a connector. |
| BoardGameGeek | boardgamegeek.com | US | collector_database | gated | — | ✓ (api_key) | ✓ | · | · | none | · | · | · | · | none | unknown | api | USD | later | medium | XML API2 needs an approved application token (BGG_API_TOKEN); marketplace listings are also behind it. |
| BoardGamePrices (meeple.dk) | boardgameprices.com | US | analytics_provider | rejected | — | · | ✓ | · | · | years | · | · | · | · | none | unknown | none | USD/GBP/DKK | later | medium | Aggregator of retailer asking prices (not a primary source) and robots.txt disallows /item/history and /item/search — the only pages with analytical value. Primary retailer (Miniature Market) implemented instead. |
| Miniature Market | miniaturemarket.com | US | dealer | implemented | miniature-market | · | ✓ | · | · | none | · | · | · | · | none | page_number | api | USD | wave3 | easy | 379 pages × 24 boxes of board games with retail list price vs. store price and SKU. Not Shopify, so implemented here rather than handed to g3. |
| Noble Knight Games | nobleknight.com | US | dealer | implemented | noble-knight | ✓ (none) | ✓ | · | · | none | · | · | · | · | none | page_number | api | USD | wave3 | easy | entry synthesized from connector meta.json |
| Rebel | rebel.pl | PL | dealer | rejected | — | · | ✓ | · | · | none | · | · | · | · | none | unknown | none | PLN | later | medium | Custom platform (products.json redirects to home); mostly board games. |
| The Game Steward | thegamesteward.com | US | dealer | implemented | the-game-steward | · | ✓ | · | · | none | · | · | · | · | none | page_number | shopify | USD | wave3 | easy | US retailer specialised in Kickstarter-exclusive / deluxe board-game editions (out-of-print collector market). Shopify storefront; product_type "Kickstarter Board Game (Expansion|Accessory)". ~2.8k Kickstarter board games, 1.5k Kickstarter-exclusive editions. Verified live 2026-09-08: robots.txt, /products.json?limit=1 (200 JSON), /collections.json, /meta.json currency=USD. |
books (6)
| Source | Domain | Country | Type | Status | Connectors | API | Live | Sold | Auction | Hist. | Pop. | Cert | GTIN | JS | Anti-bot | Pagination | Engine | Currency | Priority | Difficulty | Notes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| AbeBooks | abebooks.com | CA | marketplace | blocked | — | · | ✓ | · | · | none | · | · | · | · | blocking | unknown | none | USD | later | medium | Amazon-owned; bot protection; no public API. |
| Dominic Winter Auctioneers | dominicwinter.co.uk | GB | auction_house | implemented | dominic-winter | · | · | ✓ | ✓ | years | · | · | · | · | none | page_number | api | GBP | wave2 | medium | Also publishes per-sale PDF results (bidpath.cloud). |
| Doyle | doyle.com | US | auction_house | implemented | doyle | · | · | ✓ | ✓ | years | · | · | · | · | none | page_number | api | USD | wave2 | easy | /past-auctions/ lists 63 recent sales (Jan → Sep 2026, no pagination) with date and ?au= id; /auction/search/?au=ID&pp=96&pn=N&g=1 renders 96 cards per page ('Sold for $X', 'Estimated at $A - $B', lot link with lot id). Live probe 2026-09-08: books sale → 93 sales, coins/banknotes sale → 92 sales. |
| Forum Auctions | forumauctions.co.uk | GB | auction_house | blocked | — | · | · | ✓ | ✓ | years | · | · | · | ✓ | blocking | unknown | none | GBP | later | very_hard | AWS ELB bot challenge: every page (incl. robots.txt and home) answers HTTP 202 with an empty body for the honest UA. |
| Open Library (Internet Archive) | openlibrary.org | GB | catalog | implemented | openlibrary | ✓ (none) | · | · | · | none | · | · | · | · | none | page_number | api | USD | wave3 | easy | entry synthesized from connector meta.json |
| PBA Galleries | pbagalleries.com | US | auction_house | implemented | pba-galleries | · | · | ✓ | · | none | · | · | · | ✓ | low (CF) | page_number | firecrawl | USD | wave2 | medium | entry synthesized from connector meta.json |
cameras (6)
| Source | Domain | Country | Type | Status | Connectors | API | Live | Sold | Auction | Hist. | Pop. | Cert | GTIN | JS | Anti-bot | Pagination | Engine | Currency | Priority | Difficulty | Notes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Adorama Used | adorama.com | US | dealer | blocked | — | · | ✓ | · | · | none | · | · | ✓ | ✓ | blocking | page_number | none | USD | wave3 | very_hard | Bot management returns 403 to every non-browser session; terms prohibit scraping. Existing MPB/B&H Used connectors already cover used-camera dealer listings. |
| B&H Photo Video | bhphotovideo.com | US | dealer | implemented | bh-used | · | ✓ | · | · | none | · | · | · | ✓ | low | page_number | firecrawl | USD | wave3 | medium | entry synthesized from connector meta.json |
| Collectiblend (camera price guide) | collectiblend.com | US | pricing_guide | blocked | — | · | · | · | · | years | · | · | · | ✓ | blocking (CF) | page_number | none | USD | wave3 | very_hard | Cloudflare managed JS challenge on all paths incl. robots.txt; policy unverifiable, no public structured data. Not circumvented. |
| KEH Camera | keh.com | US | dealer | blocked | — | · | · | · | · | none | · | · | · | · | blocking | unknown | none | USD | later | medium | Bot protection blocks fetches. |
| Leica Store (official retail) | leica-camera.com | DE | manufacturer | rejected | — | · | ✓ | · | · | none | · | · | ✓ | ✓ | none | unknown | none | EUR/USD | later | medium | Official retail store of new-production cameras (MSRP), not a secondary market; MSRP catalogue would belong to a manufacturer-catalog group. Not probed. |
| MPB | mpb.com | US | dealer | implemented | mpb | · | ✓ | · | · | none | · | · | · | ✓ | low | page_number | firecrawl | USD/GBP/EUR | wave3 | medium | entry synthesized from connector meta.json |
coins (24)
| Source | Domain | Country | Type | Status | Connectors | API | Live | Sold | Auction | Hist. | Pop. | Cert | GTIN | JS | Anti-bot | Pagination | Engine | Currency | Priority | Difficulty | Notes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| APMEX | apmex.com | US | dealer | implemented | apmex | · | ✓ | · | · | none | · | · | · | ✓ | low | page_number | firecrawl | USD | wave3 | medium | entry synthesized from connector meta.json |
| Canadian Coin & Currency | cdncoin.com | CA | dealer | implemented | cdncoin | · | ✓ | · | · | none | · | · | · | · | none | page_number | shopify | CAD | wave3 | easy | Richmond Hill numismatic dealer: Canadian decimal, certified coins (ICCS/PCGS), PMG notes, world/US/ancient coins, medals & tokens. Shopify storefront with SKU per item. ~23k products; 4.7k certified (ICCS/PCGS/PMG), 4k Canadian paper money. Verified live 2026-09-08: robots.txt, /products.json?limit=1 (200 JSON), /collections.json, /meta.json currency=CAD. |
| CoinArchives | coinarchives.com | US | archive | blocked | — | · | · | ✓ | ✓ | decades | · | · | · | · | medium | page_number | none | USD/EUR/CHF/GBP | later | very_hard | Paywalled archive (subscription) — only a limited free window; the same lots are reachable through NumisBids for most houses. |
| Colonial Acres Coins | colonialacres.com | CA | dealer | implemented | colonial-acres | · | ✓ | · | · | none | · | · | · | · | none | page_number | shopify | CAD | wave3 | easy | Kitchener numismatic dealer (Canadian decimal coins, ICCS-certified coins, Bank of Canada / Dominion notes, tokens). Shopify storefront; product_type distinguishes coins, ICCS slabs and paper money. ~15k Canadian decimal coins by denomination, ~2.5k Bank of Canada notes. Verified live 2026-09-08: robots.txt, /products.json?limit=1 (200 JSON), /collections.json, /meta.json currency=CAD. |
| David Lawrence Rare Coins | davidlawrence.com | US | auction_house | implemented | dlrc | ✓ (none) | ✓ | ✓ | ✓ | years | · | ✓ | · | · | none | page_number | api | USD | wave1 | easy | 162 000 sold lots (weekly auctions since May 2023 + legacy 2016+ lots without auction id) with grading service, full grade, cert number, PCGS number, mintage. Fixed-price inventory (/consumer/inventory) not yet used → listings later. |
| Fritz Rudolf Künker | kuenker.de | DE | auction_house | implemented | kuenker | · | · | ✓ | ✓ | decades | · | ✓ | · | · | none | sitemap | api | EUR | wave2 | medium | ≈ 725 000 lot pages (29 sitemaps); each page prints estimate + 'Hammer price' (Zuschlag) in EUR, sale date and PCGS/NGC slab data in the Condition property. |
| GreatCollections | greatcollections.com | US | auction_house | blocked | — | · | · | · | ✓ | years | · | · | · | · | high | unknown | none | USD | later | medium | Archive search requires login; anti-bot on public pages. |
| HiBid | hibid.com | US | marketplace | implemented | hibid | · | · | ✓ | ✓ | months | · | · | · | · | low (CF) | page_number | api | USD/CAD | wave3 | medium | Past list = current month window (1 345 archived auctions on 2026-09-08, 25 per page); catalogs 100 lots per page with CategoryTree paths used to filter collectibles out of mostly non-collectible auctions. |
| JM Bullion | jmbullion.com | US | dealer | rejected | — | · | ✓ | · | · | none | · | · | · | ✓ | blocking (CF) | infinite_scroll | none | USD | later | very_hard | Terms prohibit scraping; sitemap index geo-blocked (403 'unavailable in your location'); every product page and leaf category answers 401 with a Webscale reCAPTCHA challenge. |
| Legend Rare Coin Auctions | legendauctions.com | US | auction_house | rejected | — | · | · | · | · | none | · | · | · | · | none | unknown | none | USD | later | very_hard | legendauctions.com now serves an unrelated Danish casino-affiliate site ('Casino uden ROFUS'); /auctions and /auction-archive/ are 404 and legendrarecoinauctions.com does not resolve. The coin auction archive is no longer online. |
| MA-Shops | ma-shops.com | DE | marketplace | implemented | ma-shops | · | ✓ | · | · | none | · | · | · | · | none | page_number | api | EUR/USD/CAD | wave3 | easy | entry synthesized from connector meta.json |
| NGC (Numismatic Guaranty Company) — price guide | ngccoin.com | US | grading_company | implemented | ngc-cert, ngc-priceguide | ✓ (none) | · | · | · | decades | ✓ | · | · | · | medium (CF) | none | api | USD | wave2 | easy | 198 US series pages, each server-rendered with NGC coin ids and one price cell per grade; rows carry their own 'Updated' date. The weekly price-history JSON (2005→) is documented but not crawled. |
| Noble Numismatics | noble.com.au | AU | auction_house | implemented | noble-numismatics | · | · | ✓ | ✓ | decades | · | ✓ | · | · | none | none | api | AUD | wave2 | trivial | Sales 44 (March 1994) → 142 (July 2026); one static prices-realised page per sale (2 000–3 500 rows). |
| Noonans Mayfair (ex Dix Noonan Webb) | noonans.co.uk | GB | auction_house | implemented | noonans | · | · | ✓ | ✓ | decades | · | ✓ | · | · | high (CF) | offset | firecrawl | GBP | wave1 | medium | 703 past catalogues back to June 1991; list layout shows the full description + estimate + hammer price, 40 lots per page. |
| NumisBids | numisbids.com | US | marketplace | implemented | numisbids | · | · | ✓ | ✓ | decades | · | ✓ | · | · | high (CF) | page_number | firecrawl | USD/EUR/GBP/CHF/AUD/CAD/SEK/NOK/DKK/PLN/CZK/HKD/JPY | wave1 | medium | Prices realized are hammer prices ('Buyer's premium is not included'). Sale ids are sequential (≈ 11 000 since 2013) → backfill walks ids downwards. 100 lots per category page, 1 Firecrawl credit per page. |
| Numista | numista.com | FR | catalog | gated | numista | ✓ (api_key) | · | ✓ | ✓ | years | · | · | · | · | low (CF) | page_number | api | EUR/USD | wave2 | easy | Needs NUMISTA_API_KEY (free registration). Connector implemented against the OpenAPI spec; fixtures from documentation examples. |
| PCGS (Professional Coin Grading Service) | pcgs.com | US | grading_company | implemented | pcgs-cert, pcgs-priceguide | ✓ (api_key) | · | · | · | none | ✓ | ✓ | · | ✓ | high (CF) | none | firecrawl | USD | wave1 | medium | Cert page table: Grade, PCGS # (→ identifiers.pcgs_number, links CoinFacts), Price Guide Value, Date/Mintmark, Denomination, Population (link to public /pop/pcgsnolookup?s=<pcgs#>&g=), Pop Higher, Region, Mintage, Holder Type. The /pop page itself is public (Svelte table per PCGS# × grade) — candidate for a later pcgs-pop connector. |
| Provident Metals | providentmetals.com | US | dealer | rejected | — | · | ✓ | · | · | none | · | · | · | · | blocking | sitemap | none | USD | later | very_hard | Product pages answer 401 with the Webscale reCAPTCHA challenge; category pages show sub-category tiles only; terms forbid automated retrieval. |
| Proxibid | proxibid.com | US | marketplace | blocked | — | · | · | ✓ | ✓ | months | · | · | · | ✓ | medium | unknown | none | USD | later | very_hard | robots.txt Disallow: /en-us/* covers all catalogue and lot pages. Respected. |
| SD Bullion | sdbullion.com | US | dealer | planned | — | · | ✓ | · | · | none | · | · | · | · | none | sitemap | api | USD | wave3 | easy | Technically open (static HTML, sitemap with 1 817 NGC/PCGS URLs) but bullion listings have low collectibles value; deferred behind the auction-result sources. |
| Sixbid | sixbid.com | DE | marketplace | blocked | — | ✓ (partner) | · | ✓ | ✓ | years | · | · | · | ✓ | high | page_number | none | EUR/USD/CHF/GBP | later | very_hard | SPA + JSON APIs reject non-browser UAs (HTTP 204); realised-price archive is a paid subscription product. Most Sixbid houses also publish on NumisBids, which is covered. |
| Spink & Son | spink.com | GB | auction_house | implemented | spink | · | · | ✓ | ✓ | decades | · | ✓ | · | · | low (CF) | page_number | api | GBP/HKD/USD/SGD/EUR | wave2 | medium | 1 543 sales since 11 Dec 2002 in the /auctions/prices dropdown; list pages carry no prices → one request per lot page (~641 lots per sale). |
| Stack's Bowers Galleries | stacksbowers.com | US | auction_house | blocked | — | · | · | · | ✓ | decades | · | · | · | · | high | unknown | none | USD | later | medium | Archive behind login/anti-bot. |
| Trade Me (API v1) | trademe.co.nz | NZ | marketplace | gated | trademe | ✓ (oauth) | ✓ | · | · | none | · | · | · | · | none | page_number | api | NZD | wave2 | medium | Connector implemented; needs TRADEME_CONSUMER_KEY + TRADEME_CONSUMER_SECRET (developer.trademe.co.nz). Category numbers verified live from the public /v1/Categories.json; fixture synthesised from the documented response fields. |
comics (18)
| Source | Domain | Country | Type | Status | Connectors | API | Live | Sold | Auction | Hist. | Pop. | Cert | GTIN | JS | Anti-bot | Pagination | Engine | Currency | Priority | Difficulty | Notes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Big B Comics | bigbcomics.com | CA | dealer | implemented | big-b-comics | · | ✓ | · | · | none | · | · | · | · | none | page_number | shopify | CAD | wave3 | easy | Ontario comic-shop chain. Shopify storefront; CGC slabs titled 'Series Year #issue - CGC 9.8 - $price'; vintage comics by character; toys and trading cards. ~12.7k products; 3.1k vintage comics, 300 CGC slabs, 400 trading cards. Verified live 2026-09-08: robots.txt, /products.json?limit=1 (200 JSON), /collections.json, /meta.json currency=CAD. |
| CBCS (Comic Book Certification Service) — grading notes lookup & population report | cbcscomics.com | US | grading_company | blocked | — | ✓ (login) | · | · | · | none | ✓ | ✓ | · | ✓ | medium (CF) | none | none | USD | wave3 | very_hard | Cert (grading notes) search requires reCAPTCHA and the backing API requires a bearer token; verified live 2026-09-08 (Firecrawl render shows the reCAPTCHA gate; api.cbcscomics.com → 401). |
| CGC Comics (Certified Guaranty Company) | cgccomics.com | US | grading_company | implemented | cgc-cert | · | · | · | · | none | ✓ | ✓ | · | ✓ | high (CF) | none | firecrawl | USD | wave1 | medium | Fields: title, issue, issue date/year, publisher, grade, page quality, grade date, label category, art/key comments, grader notes, 'Total Graded by CGC: In : n / In Higher Grades: m'. Short URL https://www.cgccomics.com// also indexed by search engines. |
| ComicConnect | comicconnect.com | US | auction_house | implemented | comicconnect | · | · | ✓ | ✓ | none | · | · | · | · | none | page_number | api | USD | wave1 | easy | entry synthesized from connector meta.json |
| ComicLink | comiclink.com | US | auction_house | implemented | comiclink | · | · | ✓ | ✓ | decades | · | · | · | · | high (CF) | none | scrapfly | USD | wave1 | medium | ~90 past sessions since 2015 (comics + comic art), 300–800 sold books each with title, CGC/CBCS grade and price. Cloudflare managed challenge for every non-browser client → Scrapfly without JS (1 credit/page). |
| ComicsPriceGuide.com | comicspriceguide.com | US | pricing_guide | blocked | — | · | · | · | · | none | · | · | · | · | high (CF) | unknown | none | USD | later | hard | Issue pages fetched through Scrapfly render only the navigation/catalogue shell; values require login. Catalogue duplicates GCD (implemented). |
| CovrPrice | covrprice.com | US | pricing_guide | blocked | — | · | · | ✓ | · | years | · | · | · | ✓ | medium | unknown | none | USD | later | very_hard | Sales history and FMV are only shown to logged-in subscribers. |
| Forbidden Planet | forbiddenplanet.com | GB | dealer | blocked | — | · | ✓ | · | · | none | · | · | · | · | blocking (CF) | unknown | none | GBP | later | medium | Cloudflare challenge page ("Cloudflare @ ForbiddenPlanet.com") for non-browser clients; custom Nuxt/Neto storefront. Not circumvented. |
| Grand Comics Database | comics.org | US | catalog | implemented | gcd | ✓ (none) | · | · | · | decades | · | · | ✓ | · | low (CF) | page_number | api | USD | wave1 | easy | 232,658 series; catalog_item per issue with comics_org_id (deterministic key), publisher family → taxonomy slug, cover price → originalMsrp when ISO currency is printed. |
| Impact Comics | impactcomics.com.au | AU | dealer | blocked | — | · | ✓ | · | · | none | · | · | · | · | blocking (CF) | unknown | none | AUD | later | medium | Cloudflare challenge on all paths. |
| Kings Comics | kingscomics.com | AU | dealer | implemented | kingscomics | · | ✓ | · | · | none | · | · | · | · | none | page_number | shopify | AUD | wave3 | easy | Sydney pop-culture store (since 1988): CGC/PSA graded comics and cards, new and back-issue comics (Marvel, DC, Image…), manga, trading-card singles (vintage NBA), action figures, statues, Perth Mint coins. Titles are upper-case; tags carry the publisher and REL-YYYYMMDD release dates. Prices are the base currency AUD (/meta.json currency AUD, Shopify.currency rate 1.0), GST included. CGC comic grades written as "(8.5)" after the title are not parsed by parseGradeFromTitle (grader is, grade stays null); PSA grades ("PSA 9.8") are parsed. |
| Millon | millon.com | FR | auction_house | implemented | millon | · | · | ✓ | ✓ | years | · | · | · | · | none | page_number | api | EUR | wave1 | medium | Sale page prints no year; the connector reads one lot page per sale for the date. |
| MyComicShop | mycomicshop.com | US | dealer | implemented | mycomicshop | · | ✓ | · | ✓ | none | · | ✓ | · | · | high | none | scrapfly | USD | wave1 | medium | Title pages expose schema.org/Product microdata per copy + 'Label #' for CGC/CBCS slabs, consignment 3% buyer's premium, Signature Series, paper quality. Seeds = title ids (homepage lists ~275 titles with stock counts). |
| OK Comics | okcomics.co.uk | GB | dealer | rejected | — | · | ✓ | · | · | none | · | · | · | · | none | unknown | shopify | GBP | later | medium | Shopify (GBP) works, but the stock is new graphic novels at cover price (ISBN books) rather than collectible back issues; Travelling Man covers the same segment with figures and manga. Revisit if key-issue/graded stock appears. |
| Overstreet Price Guide | gemstonepub.com | US | pricing_guide | rejected | — | · | · | · | · | decades | · | · | · | · | none | none | none | USD | later | very_hard | Paid, copyrighted guide with no public data. Key Collector Comics (mobile app, subscription) rejected for the same reason. |
| Reece's Rare Comics | reecescomics.com | US | dealer | blocked | — | · | ✓ | · | · | none | · | · | · | · | blocking (CF) | unknown | none | USD | later | very_hard | www.reecescomics.com: Cloudflare 'Attention Required' hard block for curl (bot and browser UA) and Scrapfly reports DNS_NAME_NOT_RESOLVED for the host on 2026-09-08 — site unreachable for automated access. |
| Shortboxed | shortboxed.com | US | marketplace | gated | — | ✓ (login) | ✓ | ✓ | ✓ | years | ✓ | ✓ | ✓ | ✓ | medium (CF) | cursor | api | USD | wave2 | hard | All GraphQL data queries (auctionSearch, historicalSalesByLabel, fmvByCertificationNumbers) return 401 without a Shortboxed user token; no public API key programme is documented. Re-evaluate if Shortboxed publishes a partner/API key. |
| The Comic Hunter | thecomichunter.ca | CA | dealer | rejected | — | · | · | · | · | none | · | · | · | · | none | unknown | none | CAD | later | hard | Host unreachable (connection failed on all probes on 2026-09-08). Skipped. |
design_furniture (8)
| Source | Domain | Country | Type | Status | Connectors | API | Live | Sold | Auction | Hist. | Pop. | Cert | GTIN | JS | Anti-bot | Pagination | Engine | Currency | Priority | Difficulty | Notes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 1stDibs | 1stdibs.com | US | marketplace | implemented | 1stdibs | · | ✓ | · | · | none | · | · | · | · | low | page_number | api | USD | wave1 | medium | ~3 MB per page; dealer asking prices only. Sold items appear only as isSold flags on live pages (no sold-price archive). |
| Chairish | chairish.com | US | marketplace | implemented | chairish | · | ✓ | · | · | none | · | · | · | · | none | page_number | api | USD | wave1 | easy | |
| Incollect | incollect.com | US | marketplace | rejected | — | · | ✓ | · | · | none | · | · | · | ✓ | none | page_number | api | USD | later | medium | No public prices (price on request only) → no market data to ingest; dealer/designer names only. |
| Los Angeles Modern Auctions (LAMA) | lamodern.com | US | auction_house | implemented | lama | · | · | ✓ | ✓ | decades | · | · | · | · | none | sitemap | api | USD | wave2 | easy | 215 session sitemaps back to 2007-06 in /sitemap-index.xml; e.g. /auctions/2026/08/murakami embeds 82 items with results (39 sales). Live probe 2026-09-08: 263 records over 2 sessions. |
| Pamono | pamono.com | DE | marketplace | implemented | pamono | · | ✓ | · | · | none | · | · | · | · | none | page_number | api | USD | wave2 | easy | |
| PIASA | piasa.fr | FR | auction_house | implemented | piasa | · | · | ✓ | ✓ | months | · | · | · | · | low (CF) | none | api | EUR | wave2 | medium | Older years only via the Livewire year filter (POST) → not used; historical depth = current year. |
| Sworders Fine Art Auctioneers | sworder.co.uk | GB | auction_house | implemented | sworders | · | · | ✓ | ✓ | years | · | · | · | · | none | page_number | api | GBP | wave2 | medium | Also exposes a cross-sale /lot-archive/. |
| Wright (Rago/Wright) | wright20.com | US | auction_house | implemented | wright | · | · | ✓ | ✓ | decades | · | · | · | · | none | sitemap | api | USD | wave2 | easy | 614 session sitemaps back to 2000-06 in /sitemap-index.xml (sitemaps/sessions/sitemap-auctions_YYYY_MM_slug.xml). Each session page (~1 MB) embeds SessionIndexItemResource items with estimate_low/high, result, bid_count, artist_name, lot_number; the /info page gives ended_at and show_results_with_premium (e.g. 45 000 hammer → 57 600 shown). Live probe 2026-09-08: closed Design sale → 174 sales; two upcoming sessions → 59 auction lots. |
designer_toys (9)
| Source | Domain | Country | Type | Status | Connectors | API | Live | Sold | Auction | Hist. | Pop. | Cert | GTIN | JS | Anti-bot | Pagination | Engine | Currency | Priority | Difficulty | Notes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Kidrobot | kidrobot.com | US | dealer | implemented | kidrobot | · | ✓ | · | · | none | · | · | · | · | none | page_number | shopify | USD | wave3 | easy | Designer-toy brand store (Dunny, Labbit, art toys, Hello Kitty and Disney collabs). Shopify storefront; product_type distinguishes Dunny/Plush/Apparel; SKUs 'KRxxxxx-01'. ~1.9k live products; Dunny 430, limited editions 690, blind boxes 230. Verified live 2026-09-08: robots.txt, /products.json?limit=1 (200 JSON), /collections.json, /meta.json currency=USD. |
| Martian Toys | martiantoys.com | US | dealer | implemented | martian-toys | · | ✓ | · | · | none | · | · | · | · | none | page_number | shopify | USD | wave3 | easy | Philadelphia designer-toy shop and producer (vinyl toys, artist customs, blind boxes, Pop Mart, Superplastic, tokidoki). Shopify storefront; product_type "vinyl toy". ~7k products; 720 designer toys, 350 customs, 150 blind boxes, Pop Mart/Superplastic/tokidoki. Verified live 2026-09-08: robots.txt, /products.json?limit=1 (200 JSON), /collections.json, /meta.json currency=USD. |
| Mighty Jaxx | mightyjaxx.com | SG | dealer | rejected | — | · | ✓ | · | · | none | · | · | · | · | none | unknown | firecrawl | USD | later | medium | Migrated from Shopify to a custom Next.js storefront (us.mightyjaxx.com); /products.json no longer served. Candidate for a later NEXT_DATA connector. |
| myplasticheart | myplasticheart.com | US | dealer | rejected | — | · | · | · | · | none | · | · | · | · | none | unknown | none | USD | later | hard | /products.json 404 — not Shopify/Woo. |
| POP MART | popmart.com | CN | dealer | rejected | — | · | ✓ | · | · | none | · | · | · | · | none | unknown | firecrawl | USD | later | medium | Custom Next.js storefront with regional redirects (/ca, /us…); no public product JSON; primary-market prices only. Labubu resale is captured through Kick Game / Crepslocker listings. |
| Rotofugi | rotofugi.com | US | dealer | implemented | rotofugi | · | ✓ | · | · | none | · | · | · | · | none | page_number | shopify | USD | wave3 | easy | Chicago designer-toy gallery/shop since 2004. Shopify storefront; brand collections (Kidrobot, Pop Mart, Medicom, Mighty Jaxx, Coarse, tokidoki, Konatsuya…). ~700 live designer toys (Kidrobot, Pop Mart, Medicom, tokidoki, kaiju/sofubi), 100 Super7 ReAction. Verified live 2026-09-08: robots.txt, /products.json?limit=1 (200 JSON), /collections.json, /meta.json currency=USD. |
| Strangecat Toys | strangecattoys.com | US | dealer | implemented | strangecat-toys | · | ✓ | · | · | none | · | · | · | · | none | page_number | shopify | USD | wave3 | easy | Pittsburgh designer-toy retailer/producer (Strangecat exclusives, artist customs, blind-box minis, plush). Shopify storefront; product_type Designer Toy(s). ~5.8k designer toys, 4.8k blind-box minis, 1.7k customs. Verified live 2026-09-08: robots.txt, /products.json?limit=1 (200 JSON), /collections.json, /meta.json currency=USD. |
| Tenacious Toys | tenacioustoys.com | US | dealer | blocked | — | · | ✓ | · | · | none | · | · | · | · | high | unknown | none | USD | later | hard | 403 to the honest bot UA on /products.json. Not circumvented. |
| TOYZEROPLUS | toyzeroplus.com | HK | dealer | implemented | toyzeroplus | · | ✓ | · | · | none | · | · | · | · | none | page_number | shopify | HKD | wave3 | easy | Hong Kong designer-toy label and publisher (Kowloon): own art toys and blind-box series (PP Baby/Lulu the Piggy by aaaz, Banggri, Dog Together, Esther Bunny, CiCi's Story, Mewky, Ultraman Kaiju Daruma) sold at primary-market prices; Single vs full Set variants. Prices are the base currency HKD (/meta.json currency HKD, country HK, Shopify.currency rate 1.0). A blind-box product has "Single"/"Set" variants (the Set price is the full case). |
digimon_tcg (1)
| Source | Domain | Country | Type | Status | Connectors | API | Live | Sold | Auction | Hist. | Pop. | Cert | GTIN | JS | Anti-bot | Pagination | Engine | Currency | Priority | Difficulty | Notes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| DigimonCard.io | digimoncard.io | US | catalog | implemented | digimoncard | ✓ (none) | · | · | · | none | · | · | · | · | none | page_number | api | wave3 | easy | entry synthesized from connector meta.json |
disney_lorcana (1)
| Source | Domain | Country | Type | Status | Connectors | API | Live | Sold | Auction | Hist. | Pop. | Cert | GTIN | JS | Anti-bot | Pagination | Engine | Currency | Priority | Difficulty | Notes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Lorcast | lorcast.com | US | catalog | implemented | lorcast | ✓ (none) | · | · | · | none | · | · | · | · | none | page_number | api | USD | wave2 | easy | entry synthesized from connector meta.json |
fashion_streetwear (4)
| Source | Domain | Country | Type | Status | Connectors | API | Live | Sold | Auction | Hist. | Pop. | Cert | GTIN | JS | Anti-bot | Pagination | Engine | Currency | Priority | Difficulty | Notes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Grailed | grailed.com | US | marketplace | blocked | — | · | · | · | · | none | · | · | · | · | blocking | unknown | none | USD | later | medium | DataDome blocks automated access. |
| JUICESTORE | juicestore.com | HK | dealer | rejected | — | · | ✓ | · | · | none | · | · | · | · | none | unknown | shopify | HKD | later | medium | Shopify (HKD) but a streetwear multi-brand store (CLOT); root products.json is empty and collections are apparel — low collectible relevance. |
| Round Two | roundtwovintage.com | US | dealer | rejected | — | · | · | · | · | none | · | · | · | · | none | unknown | none | USD | later | hard | Custom platform (DPS server, 301 redirects); /products.json 404. Not Shopify/Woo. |
| Vinted | vinted.com | LT | marketplace | blocked | — | · | · | · | · | none | · | · | · | · | blocking | unknown | none | EUR | later | medium | DataDome on all pages; API is app-only. |
fossils (1)
| Source | Domain | Country | Type | Status | Connectors | API | Live | Sold | Auction | Hist. | Pop. | Cert | GTIN | JS | Anti-bot | Pagination | Engine | Currency | Priority | Difficulty | Notes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| FossilEra | fossilera.com | US | dealer | implemented | fossilera | · | ✓ | · | · | none | · | · | · | · | none | page_number | api | USD | wave3 | easy | entry synthesized from connector meta.json |
funko (3)
| Source | Domain | Country | Type | Status | Connectors | API | Live | Sold | Auction | Hist. | Pop. | Cert | GTIN | JS | Anti-bot | Pagination | Engine | Currency | Priority | Difficulty | Notes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Funko (official shop) | funko.com | US | manufacturer | planned | — | · | ✓ | · | · | none | · | · | · | · | high | sitemap | scrapfly | USD | wave3 | hard | Not implemented this wave: product pages return 403 to the honest bot UA (WAF) → needs Scrapfly per product page (27k pages, ~1 credit each) driven by the product sitemap; official MSRP catalog for Funko Pop. |
| hobbyDB / Pop Price Guide | hobbydb.com | US | pricing_guide | blocked | — | · | · | · | · | none | · | · | · | · | high | unknown | none | USD | later | medium | Values behind login; catalog API undocumented and protected. |
| Toy Tokyo | toytokyo.com | US | dealer | implemented | toy-tokyo | · | ✓ | · | · | none | · | · | · | · | none | page_number | shopify | USD | wave3 | easy | NYC's Toy Tokyo: Funko exclusives, Medicom BE@RBRICK, KAWS, sofubi, Banpresto/Bandai/NECA/Mezco figures. Shopify storefront; product_type FUNKO / MEDICOM TOY / Action & Toy Figures. ~860 Funko Pop! (incl. Toy Tokyo exclusives), 455 Medicom / 160 BE@RBRICK, 390 Banpresto, KAWS, sofubi. Verified live 2026-09-08: robots.txt, /products.json?limit=1 (200 JSON), /collections.json, /meta.json currency=USD. |
gundam (3)
| Source | Domain | Country | Type | Status | Connectors | API | Live | Sold | Auction | Hist. | Pop. | Cert | GTIN | JS | Anti-bot | Pagination | Engine | Currency | Priority | Difficulty | Notes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Hobby Genki | hobbygenki.com | JP | dealer | rejected | — | · | ✓ | · | · | none | · | · | · | · | none | unknown | none | JPY | later | medium | PrestaShop storefront; no product JSON. |
| HobbySearch | 1999.co.jp | JP | dealer | implemented | hobbysearch | · | ✓ | · | · | none | · | · | · | ✓ | low | page_number | firecrawl | JPY | wave3 | medium | entry synthesized from connector meta.json |
| Plaza Japan | plazajapan.com | JP | dealer | rejected | — | · | ✓ | · | · | none | · | · | · | · | none | unknown | none | USD | later | medium | BigCommerce storefront (no public product JSON without API token). |
historical_documents (1)
| Source | Domain | Country | Type | Status | Connectors | API | Live | Sold | Auction | Hist. | Pop. | Cert | GTIN | JS | Anti-bot | Pagination | Engine | Currency | Priority | Difficulty | Notes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| University Archives | universityarchives.com | US | auction_house | blocked | — | · | · | ✓ | ✓ | years | · | · | · | · | medium | unknown | none | USD | later | hard | Serves 'Access Denied' to the honest bot UA (same WAF page as bid.waddingtons.ca). Switching to a browser UA to evade a deliberate bot denial is not done. |
hockey_cards (3)
| Source | Domain | Country | Type | Status | Connectors | API | Live | Sold | Auction | Hist. | Pop. | Cert | GTIN | JS | Anti-bot | Pagination | Engine | Currency | Priority | Difficulty | Notes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Cardboard Memories | cardboardmemories.ca | CA | dealer | implemented | cardboard-memories | · | ✓ | · | · | none | · | · | · | · | none | page_number | shopify | CAD | wave3 | easy | New Brunswick comic & sports-card shop. Shopify storefront; hockey/football/baseball boxes with UPC-like SKUs, Yu-Gi-Oh! singles, comics by publisher, Funko. ~26k comics, 1.1k hockey card products, Yu-Gi-Oh!/Pokémon singles, Funko. Verified live 2026-09-08: robots.txt, /products.json?limit=1 (200 JSON), /collections.json, /meta.json currency=CAD. |
| Classic Auctions | classicauctions.net | CA | auction_house | blocked | — | · | · | ✓ | ✓ | years | · | · | · | · | blocking | unknown | none | CAD/USD | later | very_hard | Akamai 'Access Denied' (Reference #18…edgesuite) on robots.txt and homepage for both UAs. Same hosting stack as Mile High and Iconic. Not fought. |
| CloutsnChara | cloutsnchara.com | CA | dealer | blocked | — | · | ✓ | · | · | none | · | · | · | · | blocking (CF) | unknown | none | CAD | later | hard | Cloudflare returns 403 to the honest RareIndexBot UA on every path (/, /products.json, /robots.txt). Bot access refused at the edge — not circumvented. |
jewelry (3)
| Source | Domain | Country | Type | Status | Connectors | API | Live | Sold | Auction | Hist. | Pop. | Cert | GTIN | JS | Anti-bot | Pagination | Engine | Currency | Priority | Difficulty | Notes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Ansorena | ansorena.com | ES | auction_house | blocked | — | · | · | · | ✓ | years | · | · | · | · | none | page_number | none | EUR | later | hard | Public pages show start price and a VENDIDO badge but the hammer price ('Remates subasta — Regístrese o inicie sesión') is login-gated. |
| Chiswick Auctions | chiswickauctions.co.uk | GB | auction_house | implemented | chiswick-auctions | · | · | ✓ | ✓ | years | · | · | · | · | none | page_number | api | GBP | wave2 | medium | |
| Leonard Joel | auctions.leonardjoel.com.au | AU | auction_house | implemented | leonard-joel | · | · | ✓ | ✓ | years | · | · | · | · | none | page_number | api | AUD | wave2 | medium | salelot parameter must keep literal '+' padding. |
lego (2)
| Source | Domain | Country | Type | Status | Connectors | API | Live | Sold | Auction | Hist. | Pop. | Cert | GTIN | JS | Anti-bot | Pagination | Engine | Currency | Priority | Difficulty | Notes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| BrickEconomy | brickeconomy.com | US | pricing_guide | implemented | brickeconomy | · | · | · | · | none | · | · | · | ✓ | low | page_number | firecrawl | USD | wave2 | medium | entry synthesized from connector meta.json |
| BrickLink | bricklink.com | US | marketplace | blocked | — | ✓ (oauth) | ✓ | ✓ | · | months | · | · | · | · | medium | unknown | none | USD | wave1 | hard | robots.txt disallows the catalog and price-guide paths; the API is seller-only. Respecting robots (SPEC §36). |
lego_minifigures (1)
| Source | Domain | Country | Type | Status | Connectors | API | Live | Sold | Auction | Hist. | Pop. | Cert | GTIN | JS | Anti-bot | Pagination | Engine | Currency | Priority | Difficulty | Notes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| The Minifigure Store | theminifigurestore.uk | GB | dealer | blocked | — | · | ✓ | · | · | none | · | · | · | · | blocking (CF) | unknown | none | GBP | later | medium | Cloudflare challenge on all paths. |
lego_sets (3)
| Source | Domain | Country | Type | Status | Connectors | API | Live | Sold | Auction | Hist. | Pop. | Cert | GTIN | JS | Anti-bot | Pagination | Engine | Currency | Priority | Difficulty | Notes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Brick Loot | brickloot.com | US | dealer | rejected | — | · | · | · | · | none | · | · | · | · | none | unknown | none | USD | later | hard | Shopify (verified) but sells third-party brick kits, light kits and subscription boxes — not LEGO sets or minifigures, so no fit with lego_sets/lego_minifigures. |
| Brickset | brickset.com | global | catalog | implemented | brickset | ✓ (none) | · | · | · | none | · | · | · | · | none | page_number | api | USD/GBP | wave2 | easy | entry synthesized from connector meta.json |
| LEGO Shop (official) | lego.com | US | manufacturer | implemented | lego-shop | · | ✓ | · | · | none | · | · | · | ✓ | low | page_number | firecrawl | USD | wave2 | medium | entry synthesized from connector meta.json |
luxury_handbags (3)
| Source | Domain | Country | Type | Status | Connectors | API | Live | Sold | Auction | Hist. | Pop. | Cert | GTIN | JS | Anti-bot | Pagination | Engine | Currency | Priority | Difficulty | Notes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| FASHIONPHILE | fashionphile.com | US | marketplace | implemented | fashionphile | ✓ (none) | ✓ | · | · | none | · | · | · | · | none | page_number | api | USD | wave2 | easy | entry synthesized from connector meta.json |
| Rebag | shop.rebag.com | US | marketplace | implemented | rebag | ✓ (none) | ✓ | · | · | none | · | ✓ | · | · | none | page_number | api | USD | wave2 | easy | entry synthesized from connector meta.json |
| Vestiaire Collective | vestiairecollective.com | FR | marketplace | blocked | — | · | · | · | · | none | · | · | · | · | blocking | unknown | none | EUR | later | medium | Anti-bot challenge on every page. |
magic_the_gathering (41)
| Source | Domain | Country | Type | Status | Connectors | API | Live | Sold | Auction | Hist. | Pop. | Cert | GTIN | JS | Anti-bot | Pagination | Engine | Currency | Priority | Difficulty | Notes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 401 Games | store.401games.ca | CA | dealer | implemented | 401-games | · | ✓ | · | · | none | · | · | · | · | none | page_number | shopify | CAD | wave3 | easy | Canada's largest TCG/board-game retailer (Toronto). Public Shopify storefront with one umbrella collection per game plus sports and non-sport cards. ~430k products; MTG 158k, Yu-Gi-Oh! 60k, Pokémon 54k. Verified live 2026-09-08: robots.txt, /products.json?limit=1 (200 JSON), /collections.json, /meta.json currency=CAD. |
| Advance Guard | advanceguard.com.au | AU | dealer | blocked | — | · | ✓ | · | · | none | · | · | · | · | high | unknown | none | AUD | later | medium | Every path (including robots.txt) returns a JavaScript "lander" redirect page to non-browser clients. |
| Alphaspel | alphaspel.se | SE | dealer | rejected | — | · | ✓ | · | · | none | · | · | · | · | none | unknown | none | SEK | later | medium | Custom platform; no product JSON. |
| Bazaar of Magic | bazaarofmagic.eu | NL | dealer | rejected | — | · | ✓ | · | · | none | · | · | · | · | none | unknown | none | EUR | later | medium | Custom storefront (locale redirect /en-WW, no products.json). Cardmarket covers EU MTG. |
| Bazar de Magic | bazardemagic.com | ES | dealer | rejected | — | · | ✓ | · | · | none | · | · | · | · | none | unknown | none | EUR | later | medium | Host unreachable at probe time. |
| Big Orbit Cards | bigorbitcards.co.uk | GB | dealer | blocked | — | · | ✓ | · | · | none | · | · | · | · | high | unknown | none | GBP | later | medium | Returns 403 to the RareIndexBot UA on all paths (bot block). Not retried with browser UA. |
| Card Kingdom | cardkingdom.com | US | dealer | implemented | cardkingdom | ✓ (none) | · | · | · | none | · | · | · | · | none | page_number | api | USD | wave2 | easy | entry synthesized from connector meta.json |
| Card Merchant NZ | cardmerchant.co.nz | NZ | dealer | implemented | cardmerchant-nz | · | ✓ | · | · | none | · | · | · | · | none | page_number | shopify | NZD | wave3 | easy | Auckland TCG store on BinderPOS: ~112k MTG singles (5k in stock), Yu-Gi-Oh!, Flesh and Blood, Riftbound and Grand Archive singles with "Name [Set]" titles and condition variants; sealed MTG, Yu-Gi-Oh!, One Piece, Lorcana, Digimon, Dragon Ball and Star Wars Unlimited. Prices are the base currency NZD (/meta.json currency NZD, Shopify.currency rate 1.0), GST included. |
| Cardmarket price guide & product catalog (bulk files) | downloads.s3.cardmarket.com | DE | pricing_guide | implemented | cardmarket-priceguide | ✓ (none) | · | · | · | none | · | · | · | · | none | bulk_file | api | EUR | wave1 | easy | Wave-1. idProduct = identifiers.cardmarket_id (same key MTGJSON emits for mcmId → entity resolution links). Foil rows → variant Foil (Reverse Holo for Pokémon). |
| Cardmarket storefront (cardmarket.com) | cardmarket.com | DE | marketplace | blocked | — | · | ✓ | · | · | none | · | · | · | ✓ | blocking (CF) | page_number | none | EUR | later | very_hard | Cloudflare challenge on every page (403 to bots); deliberately not crawled. Price/catalog needs are covered by the public bulk files (cardmarket-priceguide). |
| Cardrush (カードラッシュ) stores | cardrush-mtg.jp | JP | dealer | implemented | cardrush | · | ✓ | · | · | none | · | · | · | · | medium (CF) | page_number | api | JPY | wave2 | medium | cardrush-onepiece.jp / cardrush-yugioh.jp / cardrush-ws.jp do not resolve (DNS). |
| CardTrader | cardtrader.com | IT | marketplace | gated | cardtrader | ✓ (api_key) | ✓ | · | · | none | · | · | · | · | none (CF) | none | api | EUR/USD | wave2 | easy | Needs CARDTRADER_API_TOKEN (free with a CardTrader account); connector implemented against the documented shapes with fixtures from the docs' example responses. |
| Carta Magica | cartamagica.com | CA | dealer | rejected | — | · | · | · | · | none | · | · | · | · | none | unknown | none | CAD | later | hard | Not Shopify/WooCommerce: CrystalCommerce platform (nginx/Passenger; /products.json 404, no Store API). Out of scope for the storefront-adapter fleet; would need a CrystalCommerce HTML parser. |
| ChannelFireball | store.channelfireball.com | US | dealer | rejected | — | · | · | · | · | none | · | · | · | · | none | unknown | none | USD | later | hard | Custom Express app (301 to marketplace); /products.json returns non-JSON. Not Shopify/Woo. |
| CoolStuffInc | coolstuffinc.com | US | dealer | rejected | — | · | · | · | · | none | · | · | · | · | none | unknown | none | USD | later | hard | Custom platform (Apache): no Shopify/Woo endpoints (404). Out of scope for storefront adapters. |
| Everything Games | everythinggames.ca | CA | dealer | implemented | everything-games | · | ✓ | · | · | none | · | · | · | · | none | page_number | shopify | CAD | wave3 | easy | Winnipeg TCG/wargame store. Shopify storefront; singles titled 'Name [SET - number]' with condition/language/finish variants. ~20k MTG singles, 3k Pokémon, Grand Archive/FaB/Weiß singles. Verified live 2026-09-08: robots.txt, /products.json?limit=1 (200 JSON), /collections.json, /meta.json currency=CAD. |
| Face to Face Games | facetofacegames.com | CA | dealer | implemented | face-to-face-games | · | ✓ | · | · | none | · | · | · | · | none | page_number | shopify | CAD | wave3 | easy | Major Canadian MTG/Pokémon/Lorcana retailer (Toronto + Montréal). Shopify storefront with clean per-game singles/sealed/high-end collections; titles embed number and set code. ~290k singles; MTG 168k, Pokémon 40k, high-end/graded 15k. Verified live 2026-09-08: robots.txt, /products.json?limit=1 (200 JSON), /collections.json, /meta.json currency=CAD. |
| Fantasiapelit | fantasiapelit.com | FI | dealer | rejected | — | · | ✓ | · | · | none | · | · | · | · | none | unknown | none | EUR | later | medium | Custom platform; no structured product JSON. |
| Fusion Gaming | fusiongamingonline.com | CA | dealer | implemented | fusion-gaming | · | ✓ | · | · | none | · | · | · | · | none | page_number | shopify | CAD | wave3 | easy | Winnipeg TCG retailer. Shopify storefront; singles titles are 'Name [Set]' with condition variants. ~256k products; MTG singles 52k, Pokémon singles 9k+. Verified live 2026-09-08: robots.txt, /products.json?limit=1 (200 JSON), /collections.json, /meta.json currency=CAD. |
| Gameology | gameology.com.au | AU | dealer | implemented | gameology | · | ✓ | · | · | none | · | · | · | · | none | page_number | shopify | AUD | wave3 | easy | Melbourne online game store: 22k TCG singles (MTG, Pokémon English/Japanese, One Piece, Lorcana, Yu-Gi-Oh!), PSA-graded cards, Funko Pop!, statues & anime figures, Topps/Panini sports cards. Tags carry Number_/Printing_/Set_ attributes. Prices are the base currency AUD (/meta.json currency AUD, Shopify.currency rate 1.0), GST included. |
| Games Haven | gameshaven.com.sg | SG | dealer | rejected | — | · | ✓ | · | · | none | · | · | · | · | none | unknown | none | SGD | later | medium | Host unreachable at probe time. |
| Games Portal | gamesportal.com.au | AU | dealer | implemented | gamesportal | · | ✓ | · | · | none | · | · | · | · | none | page_number | shopify | AUD | wave3 | easy | Mitcham (Victoria) game store on BinderPOS: ~47k in-stock MTG singles plus One Piece, Lorcana, Digimon and Flesh and Blood singles with "Name [Set]" titles and Near Mint / Lightly Played / Moderately Played / Heavily Played (Foil) condition variants; sealed MTG, Lorcana, One Piece, Star Wars Unlimited, Gundam and hololive products. Prices are the base currency AUD (/meta.json currency AUD, Shopify.currency rate 1.0), GST included. SKUs follow BinderPOS "SET-number-lang-finish-condition" (e.g. WAR-94-EN-NF-1). |
| GameZilla | gamezilla.ca | CA | dealer | implemented | gamezilla | · | ✓ | · | · | none | · | · | · | · | none | page_number | shopify | CAD | wave3 | easy | New Brunswick TCG/anime shop chain. Shopify storefront with per-set MTG collections ('Name [Set]', store-location variants), Gunpla grades, anime figures/statues, Lorcana. ~10k MTG singles over per-set collections, 1.4k Gunpla, 600 anime statues. Verified live 2026-09-08: robots.txt, /products.json?limit=1 (200 JSON), /collections.json, /meta.json currency=CAD. |
| Gathering Games | gatheringgames.co.uk | GB | dealer | rejected | — | · | ✓ | · | · | none | · | · | · | · | none | unknown | shopify | GBP | later | medium | Shopify (GBP) but the singles collections (magic-the-gathering-single-cards, 2 668 products) return an empty products.json (collection not published to the online-store channel); the remaining stock is board games, paints and sealed product already covered by Total Cards / The Card Vault. |
| Goblin Games NZ | goblingames.co.nz | NZ | dealer | implemented | goblingames-nz | · | ✓ | · | · | none | · | · | · | · | none | page_number | shopify | NZD | wave3 | easy | New Zealand TCG specialist: ~190k MTG singles (incl. Alpha/Beta/Unlimited old-school and Secret Lair), 43k English + 38k Japanese Pokémon singles, Yu-Gi-Oh!, One Piece, Flesh and Blood, Star Wars Unlimited, Lorcana and Digimon singles with NM-Mint / Lightly Played / Moderately Played / Heavily Played variants; sealed MTG and Pokémon. Prices are the base currency NZD (Shopify.currency active NZD with rate 1.0; the shop /meta.json endpoint returns 500), GST included. Titles mix BinderPOS "Name [Set]" and "Name 088/111 - Set Printing" styles; only the bracket style yields set extraction. |
| Guf | guf.com.au | AU | dealer | rejected | — | · | ✓ | · | · | none | · | · | · | · | none | unknown | shopify | AUD | later | medium | Shopify (AUD) with 112k MTG / 30k Pokémon / 46k Yu-Gi-Oh! singles, but every product carries one variant per physical store (Ballarat/Bendigo/Geelong/Werribee) at the same price, which would quadruple listings without price information; sealed products use per-store SKUs with UUIDs. Deferred until the adapter can collapse location variants. |
| Hareruya (晴れる屋) | hareruyamtg.com | JP | dealer | implemented | hareruya | ✓ (none) | ✓ | · | · | none | · | · | · | ✓ | none | page_number | api | JPY | wave2 | medium | Condition is exposed only as a numeric code (card_condition 1/2/…) → kept in metadata, never mapped. weekly_sales per offer is a useful velocity signal (metadata). |
| Hobbiesville | hobbiesville.com | CA | dealer | implemented | hobbiesville | · | ✓ | · | · | none | · | · | · | · | none | page_number | shopify | CAD | wave3 | easy | Toronto TCG + toy retailer. Shopify storefront; MTG singles titles embed "(SET-number)"; also Funko, LEGO and Japanese Pokémon sealed. ~200k products; 21k singles, 8.4k MTG singles. Verified live 2026-09-08: robots.txt, /products.json?limit=1 (200 JSON), /collections.json, /meta.json currency=CAD. |
| Kelz0r | kelz0r.dk | DK | dealer | rejected | — | · | ✓ | · | · | none | · | · | · | · | none | unknown | none | DKK | later | medium | Custom platform (no robots.txt, no products.json / Store API). |
| Magic Madhouse | magicmadhouse.co.uk | GB | dealer | rejected | — | · | ✓ | · | · | none | · | · | · | · | none | unknown | firecrawl | GBP | later | medium | BigCommerce storefront (no public products.json / Store API equivalent without an API token); would need HTML parsing of paginated category pages. Deferred — Total Cards and The Card Vault already cover UK TCG retail. |
| Magic Stronghold | magicstronghold.com | CA | dealer | rejected | — | · | · | · | · | none | · | · | · | · | none | unknown | none | CAD | later | hard | /products.json 404 — not Shopify/Woo (custom TCG platform). |
| MTGGoldfish | mtggoldfish.com | US | pricing_guide | implemented | mtggoldfish | ✓ (none) | · | · | · | none | · | · | · | · | none | page_number | api | USD | wave2 | easy | entry synthesized from connector meta.json |
| MTGJSON | mtgjson.com | US | pricing_guide | implemented | mtgjson | ✓ (none) | · | · | · | none | · | · | · | · | none | page_number | api | USD/EUR | wave1 | easy | entry synthesized from connector meta.json |
| MTGStocks | mtgstocks.com | US | pricing_guide | rejected | — | · | · | · | · | years | · | · | · | ✓ | high | none | none | USD | later | hard | Private API blocks bots (403 CloudFront) and the data (TCGplayer/Cardmarket price relays) is redundant with mtgjson, tcgcsv and cardmarket-priceguide. |
| Play-in / Magic Bazar | play-in.com | FR | dealer | rejected | — | · | ✓ | · | · | none | · | · | · | · | none | unknown | none | EUR | later | medium | Custom platform (magicbazar.fr redirects here); locale-prefixed HTML only, no product JSON. Cardmarket bulk files (group g1) cover EU TCG pricing. |
| Scryfall | scryfall.com | US | catalog | implemented | scryfall | ✓ (none) | · | · | · | none | · | · | · | · | none | page_number | api | USD/EUR | wave1 | easy | entry synthesized from connector meta.json |
| Star City Games | starcitygames.com | US | dealer | rejected | — | · | · | · | · | none | · | · | · | · | low (CF) | unknown | none | USD | later | hard | BigCommerce storefront behind Cloudflare (__cf_bm cookie): no Shopify/Woo JSON. Would need a BigCommerce/GraphQL adapter — not built here. |
| Toy Snowman | toysnowman.ca | CA | dealer | implemented | toy-snowman | · | ✓ | · | · | none | · | · | · | · | none | page_number | shopify | CAD | wave3 | easy | Canadian collector-toy and TCG e-shop (Hot Toys, S.H.Figuarts, Marvel Legends, Black Series, NECA, Mythic Legions, Gunpla, Warhammer). Shopify storefront. ~9.5k products; 6k MTG singles, 700 Pokémon singles, ~2k collector figures. Verified live 2026-09-08: robots.txt, /products.json?limit=1 (200 JSON), /collections.json, /meta.json currency=CAD. |
| Trader Online | trader-online.de | DE | dealer | blocked | — | · | ✓ | · | · | none | · | · | · | · | blocking (CF) | unknown | none | EUR | later | medium | Cloudflare challenge on every request. |
| Troll and Toad | trollandtoad.com | US | dealer | blocked | — | · | ✓ | · | · | none | · | · | · | · | medium (CF) | unknown | none | USD | later | hard | Shopify shop (sets _shopify_essential) but the storefront JSON is disabled: /products.json answers 401 and / redirects. The merchant has opted out of the public JSON — respected, not worked around. |
| Wizard's Tower | kanatacg.com | CA | dealer | implemented | wizards-tower | · | ✓ | · | · | none | · | · | · | · | none | page_number | shopify | CAD | wave3 | easy | Ottawa MTG/Lorcana/board-game store. Shopify storefront with one singles collection per MTG set (title '(SET)' suffix, NM/SP/MP variants). ~30k MTG singles across per-set collections, 5.9k Lorcana. Verified live 2026-09-08: robots.txt, /products.json?limit=1 (200 JSON), /collections.json, /meta.json currency=CAD. |
manga (1)
| Source | Domain | Country | Type | Status | Connectors | API | Live | Sold | Auction | Hist. | Pop. | Cert | GTIN | JS | Anti-bot | Pagination | Engine | Currency | Priority | Difficulty | Notes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Travelling Man | travellingman.com | GB | dealer | implemented | travellingman | · | ✓ | · | · | none | · | · | ✓ | · | none | page_number | shopify | GBP | wave3 | easy | UK graphic-novel, manga and games chain (Leeds/York/Manchester/Newcastle, since 1991): manga (ISBN SKUs), graphic novels, S.H.Figuarts, trading figures, Funko, sealed Pokémon/MTG/Yu-Gi-Oh!/Lorcana/Digimon and Gunpla. Prices are the base currency GBP (/meta.json currency GBP). Manga/graphic-novel SKUs are ISBN-13s (kept as sku; ISBN identifiers are only derived from the barcode field). |
marvel_comics (1)
| Source | Domain | Country | Type | Status | Connectors | API | Live | Sold | Auction | Hist. | Pop. | Cert | GTIN | JS | Anti-bot | Pagination | Engine | Currency | Priority | Difficulty | Notes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| GoCollect | gocollect.com | US | analytics_provider | blocked | — | · | · | ✓ | · | years | · | · | · | · | high | unknown | none | USD | later | medium | Sales data is a paid membership product; terms forbid scraping. |
militaria (2)
| Source | Domain | Country | Type | Status | Connectors | API | Live | Sold | Auction | Hist. | Pop. | Cert | GTIN | JS | Anti-bot | Pagination | Engine | Currency | Priority | Difficulty | Notes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Hermann Historica | hermann-historica.de | DE | auction_house | blocked | — | · | · | ✓ | ✓ | years | · | · | · | · | none | unknown | none | EUR | later | hard | robots.txt disallows /en/auctions/, /en/live/ and /en/lotsearch/ — exactly the catalogue/result paths — so the site is not crawled. |
| Osenat | osenat.com | FR | auction_house | implemented | osenat | · | · | ✓ | ✓ | decades | · | · | · | · | none | offset | api | EUR | wave1 | medium |
minerals (1)
| Source | Domain | Country | Type | Status | Connectors | API | Live | Sold | Auction | Hist. | Pop. | Cert | GTIN | JS | Anti-bot | Pagination | Engine | Currency | Priority | Difficulty | Notes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| e-Rocks | e-rocks.com | GB | marketplace | implemented | e-rocks | · | · | · | ✓ | none | · | · | · | ✓ | low | page_number | firecrawl | EUR | wave3 | medium | entry synthesized from connector meta.json |
model_cars (1)
| Source | Domain | Country | Type | Status | Connectors | API | Live | Sold | Auction | Hist. | Pop. | Cert | GTIN | JS | Anti-bot | Pagination | Engine | Currency | Priority | Difficulty | Notes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Mattel Creations | creations.mattel.com | US | manufacturer | implemented | mattel-creations | ✓ (none) | ✓ | · | · | none | · | · | · | · | none | page_number | shopify | USD | wave2 | trivial | Hot Wheels Collectors (952 products), RLC, Elite 64, Car Culture, Matchbox Collectors, Barbie Signature (820), MOTU, WWE. Tags carry Brand:/Category:/Filter-AgeGrade:. Sold-out items kept as ended listings for MSRP history. |
model_trains (1)
| Source | Domain | Country | Type | Status | Connectors | API | Live | Sold | Auction | Hist. | Pop. | Cert | GTIN | JS | Anti-bot | Pagination | Engine | Currency | Priority | Difficulty | Notes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Trainz.com | trainz.com | US | dealer | implemented | trainz | ✓ (none) | ✓ | · | · | none | · | · | · | · | none | page_number | api | USD | wave3 | easy | entry synthesized from connector meta.json |
movie_memorabilia (2)
| Source | Domain | Country | Type | Status | Connectors | API | Live | Sold | Auction | Hist. | Pop. | Cert | GTIN | JS | Anti-bot | Pagination | Engine | Currency | Priority | Difficulty | Notes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Julien's Auctions | juliensauctions.com | US | auction_house | blocked | — | · | · | ✓ | ✓ | years | · | · | · | ✓ | high (CF) | unknown | none | USD | later | very_hard | Cloudflare JS challenge on every page. Not fought. |
| Propstore | propstore.com | US | auction_house | blocked | — | · | · | ✓ | ✓ | years | · | · | · | · | blocking | page_number | none | USD/GBP | later | very_hard | propstoreauction.com catalog pages: CloudFront 403 'Request blocked' (bot UA) / 202 challenge (browser UA). Not fought. |
music (15)
| Source | Domain | Country | Type | Status | Connectors | API | Live | Sold | Auction | Hist. | Pop. | Cert | GTIN | JS | Anti-bot | Pagination | Engine | Currency | Priority | Difficulty | Notes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Discogs | discogs.com | global | collector_database | implemented | discogs | ✓ (none) | · | · | · | none | · | · | · | · | none | page_number | api | USD | wave2 | easy | entry synthesized from connector meta.json |
| HHV | hhv.de | DE | dealer | rejected | — | · | ✓ | · | · | none | · | · | · | · | none | unknown | none | EUR | later | medium | Custom storefront without product JSON; Discogs covers vinyl pricing. |
| jpc.de | jpc.de | DE | dealer | rejected | — | · | ✓ | · | · | none | · | · | · | · | none | unknown | none | EUR | later | medium | Custom storefront (openresty), no product JSON; new-release retail only. |
| Mondo | mondoshop.com | US | dealer | implemented | mondo | · | ✓ | · | · | none | · | · | · | · | none | page_number | shopify | USD | wave3 | easy | Mondo (Austin): vinyl soundtracks, 1/6 & 1/12 scale figures, soft vinyl, screen-printed movie posters. Shopify storefront; product_type Vinyl / 1/6 Scale / 1/12 Scale / Soft Vinyl / Posters. ~1.8k vinyl soundtracks, 460 collectibles (1/6 & 1/12 figures, soft vinyl), 75 posters. Verified live 2026-09-08: robots.txt, /products.json?limit=1 (200 JSON), /collections.json, /meta.json currency=USD. |
| Newbury Comics | newburycomics.com | US | dealer | implemented | newbury-comics | · | ✓ | · | · | none | · | · | · | · | none | page_number | shopify | USD | wave3 | easy | Boston chain famous for exclusive colored-vinyl variants and signed editions. Shopify storefront; product_type Vinyl/CD/Cassette; catalog numbers in tags. ~1k exclusive colored vinyl, 200 box sets, 485 singles, 1.7k autographed items. Verified live 2026-09-08: robots.txt, /products.json?limit=1 (200 JSON), /collections.json, /meta.json currency=USD. |
| Phonica Records | phonicarecords.com | GB | dealer | rejected | — | · | ✓ | · | · | none | · | · | · | · | none | unknown | none | GBP | later | medium | Custom platform; no product JSON. |
| Piccadilly Records | piccadillyrecords.com | GB | dealer | rejected | — | · | ✓ | · | · | none | · | · | · | · | none | unknown | none | GBP | later | medium | Custom platform without structured product JSON; vinyl retail prices add little beyond Discogs (already implemented). |
| Popsike | popsike.com | US | pricing_guide | rejected | — | · | · | ✓ | · | decades | · | · | · | · | none | unknown | api | USD | later | medium | Paid subscription; terms prohibit extraction. Discogs marketplace covers vinyl. |
| Resident Music | resident-music.com | GB | dealer | blocked | — | · | ✓ | · | · | none | · | · | · | · | medium | unknown | shopify | GBP | later | medium | Shopify-hosted but /products.json answers 403 (storefront JSON disabled). |
| Rough Trade | roughtrade.com | US | dealer | blocked | — | · | ✓ | · | · | none | · | · | · | · | high | unknown | none | USD | later | hard | 403 to the honest bot UA on /products.json. Not circumvented. |
| Rough Trade | roughtrade.com | GB | dealer | blocked | — | · | ✓ | · | · | none | · | · | · | · | high | unknown | none | GBP | later | medium | 403 to the bot UA on catalogue paths; custom (non-Shopify) platform. |
| The Drift Record Shop | driftrecords.com | GB | dealer | rejected | — | · | ✓ | · | · | none | · | · | · | · | none | unknown | shopify | GBP | later | medium | Shopify (GBP) but the online catalogue holds only ~17 products (merch and a handful of Drift releases) — no pricing signal. |
| Turntable Lab | turntablelab.com | US | dealer | implemented | turntable-lab | · | ✓ | · | · | none | · | · | · | · | none | page_number | shopify | USD | wave3 | easy | NYC record & hi-fi shop. Only the vinyl collections are read (colored/deluxe/180g/7"/12"/genre essentials); audio hardware and accessories are skipped. ~800 colored-vinyl editions, 415 deluxe editions, 340 180g pressings + genre collections. Verified live 2026-09-08: robots.txt, /products.json?limit=1 (200 JSON), /collections.json, /meta.json currency=USD. |
| Vinyl Me, Please | vinylmeplease.com | US | dealer | rejected | — | · | · | · | · | none | · | · | · | · | none | unknown | none | USD | later | hard | Site is a Cargo (cargo.site) page, not a storefront; no products.json. Nothing to crawl. |
| Waxwork Records | waxworkrecords.com | US | dealer | implemented | waxwork-records | · | ✓ | · | · | none | · | · | · | · | none | page_number | shopify | USD | wave3 | easy | New Orleans horror/cult soundtrack label (limited colored vinyl). Shopify storefront; Vinyl/CD/Cassette variants on one product. ~250 vinyl soundtracks, 30 CDs, cassettes. Verified live 2026-09-08: robots.txt, /products.json?limit=1 (200 JSON), /collections.json, /meta.json currency=USD. |
musical_instruments (1)
| Source | Domain | Country | Type | Status | Connectors | API | Live | Sold | Auction | Hist. | Pop. | Cert | GTIN | JS | Anti-bot | Pagination | Engine | Currency | Priority | Difficulty | Notes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Reverb | reverb.com | US | marketplace | implemented | reverb | ✓ (none) | ✓ | · | · | none | · | · | · | · | none | page_number | api | USD | wave2 | easy | entry synthesized from connector meta.json |
nintendo_games (7)
| Source | Domain | Country | Type | Status | Connectors | API | Live | Sold | Auction | Hist. | Pop. | Cert | GTIN | JS | Anti-bot | Pagination | Engine | Currency | Priority | Difficulty | Notes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| DKOldies | dkoldies.com | US | dealer | rejected | — | · | · | · | · | none | · | · | · | · | low (CF) | unknown | none | USD | later | hard | BigCommerce storefront behind Cloudflare (__cf_bm), /products.json 404. Not Shopify/Woo — candidate for a future BigCommerce adapter. |
| EB Games Canada | ebgames.ca | CA | dealer | blocked | — | · | ✓ | · | · | none | · | · | · | · | high | unknown | none | CAD | later | hard | 403 to the honest bot UA. Not circumvented. |
| Lukie Games | lukiegames.com | US | dealer | implemented | lukie-games | ✓ (none) | ✓ | · | · | none | · | · | · | · | none | page_number | api | USD | wave3 | easy | entry synthesized from connector meta.json |
| Pink Gorilla Games | pinkgorillagames.com | US | dealer | rejected | — | · | · | · | · | none | · | · | · | · | none | unknown | none | USD | later | hard | Shopify (verified) but the storefront JSON only exposes plush/merch/books (product_type Plushies 187/250, Books, Apparel, Pins); the retro-game inventory is not sold online. Nothing collectible to index. |
| Retro Game Trader | retrogametrader.com | US | dealer | rejected | — | · | · | · | · | none | · | · | · | · | none | unknown | none | USD | later | hard | Host unreachable on 2026-09-08. |
| Video Game Trader | videogametrader.com | US | dealer | implemented | videogametrader | ✓ (none) | ✓ | · | · | none | · | · | ✓ | · | none | page_number | shopify | USD | wave2 | trivial | Titles carry platform + condition ('Used (Complete)', 'Used (Loose)', 'New'), tags Platform:/Condition:/Genre:; SKUs of CIB items embed the UPC. TCG singles/boosters sold on the same store are excluded (other groups cover TCG). |
| Video Games New York | videogamesnewyork.com | US | dealer | rejected | — | · | · | · | · | none | · | · | · | · | none | unknown | none | USD | later | hard | /products.json 404 — not Shopify/Woo. |
one_piece_card_game (1)
| Source | Domain | Country | Type | Status | Connectors | API | Live | Sold | Auction | Hist. | Pop. | Cert | GTIN | JS | Anti-bot | Pagination | Engine | Currency | Priority | Difficulty | Notes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| OPTCG API | optcgapi.com | US | catalog | implemented | optcg | ✓ (none) | · | · | · | none | · | · | · | · | none | page_number | api | USD | wave2 | easy | entry synthesized from connector meta.json |
other_tcg (6)
| Source | Domain | Country | Type | Status | Connectors | API | Live | Sold | Auction | Hist. | Pop. | Cert | GTIN | JS | Anti-bot | Pagination | Engine | Currency | Priority | Difficulty | Notes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Chimera Hobby Shop | chimerahobby.com | CA | dealer | rejected | — | · | · | · | · | none | · | · | · | · | none | unknown | none | CAD | later | hard | Host unreachable on 2026-09-08. |
| Dolly's | dollys.ca | CA | dealer | rejected | — | · | · | · | · | none | · | · | · | · | none | unknown | none | CAD | later | hard | Custom platform (nginx) answering HTTP 500 on / and 404 on /products.json; no Shopify or Woo endpoints. Unverifiable — skipped. |
| Dragon's Lair | dragonslair.ca | CA | dealer | rejected | — | · | · | · | · | none | · | · | · | · | none | unknown | none | USD | later | hard | Shopify (verified) but only 5 collections and the shop declares USD despite a .ca domain (meta.json currency=USD, country=CA) — too small and ambiguous to map safely. |
| Games Republic | gamesrepublic.ca | CA | dealer | rejected | — | · | · | · | · | none | · | · | · | · | none | unknown | none | CAD | later | hard | Host unreachable on 2026-09-08. |
| Grand Archive TCG Index | index.gatcg.com | US | manufacturer | implemented | grand-archive | ✓ (none) | · | · | · | none | ✓ | · | · | · | none | page_number | api | wave3 | easy | entry synthesized from connector meta.json | |
| Sorcery TCG (Erik's Curiosa) | sorcerytcg.com | US | manufacturer | implemented | sorcery-tcg | ✓ (none) | · | · | · | none | · | · | · | · | none | page_number | api | wave3 | easy | entry synthesized from connector meta.json |
pens (3)
| Source | Domain | Country | Type | Status | Connectors | API | Live | Sold | Auction | Hist. | Pop. | Cert | GTIN | JS | Anti-bot | Pagination | Engine | Currency | Priority | Difficulty | Notes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Chatterley Luxuries | chatterleyluxuries.com | US | dealer | implemented | chatterley-luxuries | ✓ (none) | ✓ | · | · | none | · | · | · | · | low | page_number | woocommerce | USD | wave2 | trivial | 6,900-item 'sold-out editions' archive (historical asking prices) deliberately skipped. |
| Fountain Pen Hospital | fountainpenhospital.com | US | dealer | planned | — | ✓ (none) | ✓ | · | · | none | · | · | ✓ | · | none | page_number | shopify | USD | wave2 | trivial | Shopify shop → handed to the Shopify connector group (ShopifyStoreConnector, config-only). Mostly new luxury pens (Montblanc, Pelikan, Sailor, Namiki LEs) — collectible limited editions. |
| Peyton Street Pens | peytonstreetpens.com | US | dealer | implemented | peyton-street-pens | · | ✓ | · | · | none | · | · | · | · | none | page_number | api | USD | wave2 | easy | Not Shopify (BigCommerce) — implemented here rather than deferred to the Shopify group. |
perfume (2)
| Source | Domain | Country | Type | Status | Connectors | API | Live | Sold | Auction | Hist. | Pop. | Cert | GTIN | JS | Anti-bot | Pagination | Engine | Currency | Priority | Difficulty | Notes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Fragrantica | fragrantica.com | US | catalog | blocked | — | · | · | · | · | none | · | · | · | ✓ | blocking (CF) | page_number | none | USD | later | very_hard | Cloudflare challenge + terms forbid automated access; catalogue only (no market prices). |
| Parfumo | parfumo.com | DE | community | rejected | — | · | · | · | · | none | · | · | · | · | low | page_number | api | EUR | later | medium | Catalogue only — no market prices; the only trading surface (souk) is disallowed by robots. Low value for a pricing platform. |
playing_cards (1)
| Source | Domain | Country | Type | Status | Connectors | API | Live | Sold | Auction | Hist. | Pop. | Cert | GTIN | JS | Anti-bot | Pagination | Engine | Currency | Priority | Difficulty | Notes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Potter & Potter Auctions | auction.potterauctions.com | US | auction_house | implemented | potter-auctions | · | · | ✓ | · | none | · | · | · | · | none | page_number | api | USD | wave2 | easy | entry synthesized from connector meta.json |
pokemon (39)
| Source | Domain | Country | Type | Status | Connectors | API | Live | Sold | Auction | Hist. | Pop. | Cert | GTIN | JS | Anti-bot | Pagination | Engine | Currency | Priority | Difficulty | Notes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Ace Grading — population report & cert lookup | acegrading.com | GB | grading_company | rejected | — | · | · | · | · | none | ✓ | ✓ | · | ✓ | high (CF) | infinite_scroll | none | GBP | wave3 | very_hard | No URL-addressable population or cert pages (Livewire-only, Cloudflare challenge). Verified live 2026-09-08 with Firecrawl (5 s wait): filters rendered, zero rows/cert results. Revisit if Ace publishes an API or static pop pages. |
| aucfree — オークフリー | aucfree.com | JP | analytics_provider | implemented | aucfree | · | · | ✓ | ✓ | none | · | · | · | ✓ | low | page_number | firecrawl | JPY | wave2 | medium | entry synthesized from connector meta.json |
| Bunjang (번개장터) | bunjang.co.kr | KR | marketplace | implemented | bunjang | ✓ (none) | ✓ | · | · | none | · | · | · | · | none | page_number | api | KRW | wave2 | easy | 3 079 results for '포켓몬카드 PSA10'; rows carry KRW price, status, category id, tags, region label, favourites. |
| Card Merchant UK | cardmerchant.co.uk | GB | dealer | rejected | — | · | ✓ | · | · | none | · | · | · | · | none | unknown | none | GBP | later | medium | Host unreachable at probe time (not related to Card Merchant NZ). |
| Card Universe | carduniverse.nl | NL | dealer | rejected | — | · | ✓ | · | · | none | · | · | · | · | none | unknown | none | EUR | later | medium | Host unreachable at probe time. |
| Cardcorner | cardcorner.de | DE | dealer | rejected | — | · | ✓ | · | · | none | · | · | · | · | none | unknown | none | EUR | later | medium | Host unreachable at probe time. |
| Cards & Collections | cardsandcollections.de | DE | dealer | rejected | — | · | ✓ | · | · | none | · | · | · | · | none | unknown | none | EUR | later | medium | Host unreachable at probe time (DNS/timeout). |
| Catawiki | catawiki.com | NL | auction_house | implemented | catawiki | · | · | ✓ | ✓ | none | · | · | · | ✓ | high | page_number | scrapfly | EUR | wave1 | hard | entry synthesized from connector meta.json |
| CGC Cards | cgccards.com | US | grading_company | implemented | cgc-cards-cert | · | · | · | · | none | ✓ | ✓ | · | ✓ | high (CF) | none | firecrawl | USD | wave2 | medium | Population counts currently read 'Coming Soon!' on many cards → population_report emitted only when a number is shown. |
| Chaos Cards | chaoscards.co.uk | GB | dealer | blocked | — | · | ✓ | · | · | none | · | · | · | · | blocking (CF) | unknown | none | GBP | later | medium | Cloudflare "Just a moment…" challenge on every request (robots.txt 200 but all content paths challenged). No circumvention (SPEC §36). |
| Cherry Collectables | cherrycollectables.com.au | AU | dealer | implemented | cherrycollectables | · | ✓ | · | · | none | · | · | · | · | none | page_number | shopify | AUD | wave3 | easy | Australia's largest card shop (Melbourne; official Panini NBA distributor): ~390k singles across NBA/NFL/soccer/MLB/NHL/AFL/UFC/F1 sports cards, Pokémon (incl. PSA/CGC/BGS graded slabs), Yu-Gi-Oh!, MTG, One Piece, Digimon, Flesh and Blood, plus sealed boxes. Group breaks are excluded. Prices are the base currency AUD (/meta.json currency AUD, Shopify.currency rate 1.0), GST included. Graded slabs carry the grader and grade in the title (parsed by parseGradeFromTitle) and in tags (Grader_PSA, grade 10). |
| eBay (Browse API) | ebay.com | US | marketplace | gated | ebay-browse | ✓ (oauth) | ✓ | · | · | none | · | · | ✓ | · | none | offset | api | USD/CAD/GBP/EUR/AUD | wave1 | medium | Connector fully implemented against the official OpenAPI contract; needs EBAY_CLIENT_ID + EBAY_CLIENT_SECRET (developer.ebay.com). Fixtures synthesised from the contract until a key exists. |
| Flagship Games | flagshipgames.sg | SG | dealer | implemented | flagshipgames | · | ✓ | · | · | none | · | · | · | · | none | page_number | shopify | SGD | wave3 | easy | Singapore MTG specialist on BinderPOS: singles for most Magic sets back to Ice Age/Fourth Edition, Mystery Booster playtest cards, Final Fantasy and Marvel Universes Beyond, plus English and Japanese Pokémon singles, sealed MTG, One Piece and Lorcana. Prices are the base currency SGD (/meta.json currency SGD, country SG, Shopify.currency rate 1.0), GST included. Variants are condition + finish (Near Mint Foil…); a 0.00 price marks an unstocked condition and is dropped. |
| Goldin | goldin.co | US | auction_house | implemented | goldin | · | · | ✓ | · | none | · | ✓ | · | ✓ | high | page_number | scrapfly | USD | wave1 | hard | entry synthesized from connector meta.json |
| Good Games | goodgames.com.au | AU | dealer | implemented | goodgames | · | ✓ | · | · | none | · | · | ✓ | · | none | page_number | shopify | AUD | wave3 | easy | Australian games retailer chain (Sydney): sealed Pokémon, MTG, Yu-Gi-Oh!, One Piece, Digimon, Flesh and Blood, Lorcana, Star Wars Unlimited; Panini sports boxes; anime figures, action figures, Funko, blind boxes, Gunpla and plush. EAN barcodes appear in SKUs. Prices are the base currency AUD (/meta.json currency AUD, Shopify.currency rate 1.0), GST included. |
| Hills Cards | hillscards.co.uk | GB | dealer | rejected | — | · | ✓ | · | · | none | · | · | · | · | none | unknown | none | GBP | later | medium | Visualsoft platform, no structured storefront JSON. |
| KanZen Games | kanzengames.com | CA | dealer | implemented | kanzen-games | · | ✓ | · | · | none | · | · | · | · | none | page_number | shopify | CAD | wave3 | easy | Toronto TCG shop with a dedicated PSA "slabs" collection (Japanese Pokémon heavy), Lorcana/Gundam/Digimon singles and sealed product. ~63k products; 53k TCG singles, 750 PSA slabs. Verified live 2026-09-08: robots.txt, /products.json?limit=1 (200 JSON), /collections.json, /meta.json currency=CAD. |
| Limitless TCG card database | limitlesstcg.com | DE | collector_database | implemented | limitless-tcg | · | · | · | · | years | · | · | · | · | none | none | api | USD/EUR | wave2 | easy | Sister databases onepiece.limitlesstcg.com (HTTP 500), lorcana./riftbound.limitlesstcg.com (DNS failure) were unreachable at research time. |
| magi (magi.camp) | magi.camp | JP | marketplace | implemented | magi | · | ✓ | ✓ | · | none | · | · | · | · | none | page_number | api | JPY | wave2 | medium | Series ids: 31 Pokémon, 34 Yu-Gi-Oh!, 32 Magic, 20 Duel Masters, 100148 One Piece (+ sealed sub-series 1005xx). |
| Mercari (US) | mercari.com | US | marketplace | blocked | — | · | ✓ | ✓ | · | months | · | · | · | ✓ | blocking (CF) | cursor | none | USD | wave2 | very_hard | Cloudflare challenge + session-bound search API (401 without SPA-minted auth); no NEXT_DATA reachable. Not circumvented. |
| Mercari Japan (メルカリ) | jp.mercari.com | JP | marketplace | blocked | — | · | ✓ | ✓ | · | months | · | · | · | ✓ | high | cursor | none | JPY | wave1 | very_hard | Search HTML is a JS shell with zero item data (verified: 0 titles server-side); the JSON API needs DPoP-signed headers generated by the app (robots also disallows /v1/, /v2/). Sold prices are therefore not lawfully reachable without circumvention. |
| Pokellector | pokellector.com | US | collector_database | blocked | — | · | · | · | · | none | · | · | · | · | none | none | none | USD | later | easy | Terms of Use explicitly prohibit automated retrieval of their data (prices, images) without written permission → not crawled (SPEC §36). Their prices are TCGplayer relays anyway (covered by tcgcsv/limitless-tcg). |
| Pokémon TCG API | pokemontcg.io | US | catalog | implemented | pokemontcg | ✓ (none) | · | · | · | none | · | · | · | · | none | page_number | api | USD/EUR | wave1 | easy | entry synthesized from connector meta.json |
| PokemonPrice.com | pokemonprice.com | US | pricing_guide | implemented | pokemonprice | ✓ (none) | · | · | · | none | · | · | · | · | none | page_number | api | USD | wave2 | easy | entry synthesized from connector meta.json |
| PSA (Professional Sports Authenticator) | psacard.com | US | grading_company | implemented | psa-cert | · | · | · | · | none | ✓ | ✓ | · | ✓ | high (CF) | none | firecrawl | USD | wave1 | medium | Public cert verification implemented (psa-cert). APR & population report remain blocked (Collectors login) — recorded by group g0. |
| Rakuma (ラクマ, Rakuten flea market) | fril.jp | JP | marketplace | rejected | — | · | ✓ | ✓ | · | none | · | · | · | · | medium | page_number | none | JPY | later | hard | robots.txt forbids every search/browse path with parameters, leaving no compliant discovery route to listings. |
| Rakuten Ichiba (楽天市場) — Item Search API | openapi.rakuten.co.jp | JP | marketplace | gated | rakuten-ichiba | ✓ (api_key) | ✓ | · | · | none | · | · | · | · | none | page_number | api | JPY | wave2 | easy | Needs RAKUTEN_APP_ID (+ RAKUTEN_ACCESS_KEY for new apps). Connector implemented against the documented response shape; fixture built from the documentation. |
| Ruten (露天拍賣) | ruten.com.tw | TW | marketplace | implemented | ruten | ✓ (none) | ✓ | · | · | none | · | · | · | · | none | offset | api | TWD | wave2 | easy | 75 130 results for '寶可夢 PSA10'; item JSON carries TWD price, stock, post/update time, storefront name, images. |
| Suruga-ya | suruga-ya.jp | JP | marketplace | implemented | surugaya | · | ✓ | · | · | none | · | · | · | ✓ | low | page_number | firecrawl | JPY | wave2 | medium | entry synthesized from connector meta.json |
| TAG Grading | my.taggrading.com | US | grading_company | implemented | tag-cert, tag-pop | · | · | · | · | none | ✓ | ✓ | · | ✓ | none | sitemap | firecrawl | USD | wave2 | medium | tag-cert reads /card/ (name, set line, TAG Score, grade + label, population 'n graded / total graded' as of date, rank, chronology, front/back images); tag-pop reads set-level pop tables. |
| TCGdex | tcgdex.dev | global | catalog | implemented | tcgdex | ✓ (none) | · | · | · | none | · | · | · | · | none | page_number | api | USD/EUR | wave1 | easy | entry synthesized from connector meta.json |
| TCGplayer | tcgplayer.com | US | marketplace | partial | tcgcsv | ✓ (partner) | ✓ | ✓ | · | years | · | · | · | · | blocking | unknown | none | USD | wave1 | hard | Storefront is bot-protected and the API is closed; market prices are ingested through the public tcgcsv.com mirror (connector tcgcsv) and MTGGoldfish/Card Kingdom for MTG. Sold listings are not available. |
| The Card Vault | thecardvault.co.uk | GB | dealer | implemented | thecardvault | · | ✓ | · | · | none | · | · | · | · | none | page_number | shopify | GBP | wave3 | easy | Glasgow hobby store: TCG singles (BinderPOS-style "Name (number)" titles with Foil / condition variants), sealed Pokémon/MTG/Yu-Gi-Oh!/One Piece/Lorcana, Panini & Topps sports boxes, Funko, Youtooz, Iron Studios statues, Nendoroids and Gunpla. Prices are the base currency GBP (/meta.json currency GBP, Shopify.currency rate 1.0). |
| Total Cards | totalcards.net | GB | dealer | implemented | totalcards | · | ✓ | · | · | none | · | · | · | · | none | page_number | shopify | GBP | wave3 | easy | Large UK trading-card retailer (Newton Aycliffe, since 2012): Pokémon (English + Japanese) and Magic singles, sealed TCG products, Funko, figures and comics. Prices in products.json are the shop base currency GBP (Shopify.currency rate 1.0, /meta.json currency GBP); UK VAT included. |
| UltraJeux | ultrajeux.com | FR | dealer | rejected | — | · | ✓ | · | · | none | · | · | · | · | none | unknown | none | EUR | later | medium | Site answers 410 Gone on catalogue paths (shop closed/moved). |
| Whatnot | whatnot.com | US | marketplace | blocked | — | · | ✓ | ✓ | ✓ | months | · | · | · | ✓ | blocking (CF) | infinite_scroll | none | USD | wave2 | very_hard | Cloudflare managed challenge on every path (including robots.txt) for plain clients; no public API; sold data only inside the authenticated app. Not crawled (SPEC §36). |
| Yahoo! Auctions Japan (ヤフオク!) | auctions.yahoo.co.jp | JP | marketplace | implemented | yahoo-auctions-jp | · | ✓ | ✓ | ✓ | months | · | · | · | · | low | offset | api | JPY | wave1 | medium | Plain HTTPS with the bot UA returned full pages (200, ~0.9 MB) for search, closed search and item pages. 6 711 live / 83 670 closed lots for 'ポケモンカード PSA10'. Closed pages beyond the site window: see aucfree. |
| Yahoo! Shopping Japan — itemSearch V3 API | shopping.yahooapis.jp | JP | marketplace | gated | yahoo-shopping-jp | ✓ (api_key) | ✓ | · | · | none | · | · | ✓ | · | none | offset | api | JPY | wave2 | easy | Needs YAHOO_JP_APP_ID. Connector implemented against the documented response; fixture is the documentation's sample response. |
| Yuyu-tei (遊々亭) | yuyu-tei.jp | JP | dealer | implemented | yuyu-tei | · | ✓ | · | · | none | · | · | · | · | none | none | api | JPY | wave2 | easy | Games: poc opc ygo ws digi dm ua vg bs gcg (also yrd, wsr, chaos, pm, re, hocg, zx, wx, lo, fe, sev, xs, gab, ei available). |
rolex (6)
| Source | Domain | Country | Type | Status | Connectors | API | Live | Sold | Auction | Hist. | Pop. | Cert | GTIN | JS | Anti-bot | Pagination | Engine | Currency | Priority | Difficulty | Notes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Analog:Shift | analogshift.com | US | dealer | implemented | analog-shift | ✓ (none) | ✓ | · | · | none | · | · | · | · | none | page_number | api | USD | wave3 | easy | entry synthesized from connector meta.json |
| Bob's Watches | bobswatches.com | US | dealer | implemented | bobs-watches | ✓ (none) | ✓ | · | · | none | · | · | · | · | none | page_number | api | USD | wave2 | easy | entry synthesized from connector meta.json |
| Bonhams | bonhams.com | GB | auction_house | implemented | bonhams | · | · | ✓ | ✓ | none | · | · | · | · | none | page_number | api | GBP/USD/HKD/EUR/AUD/CHF | wave1 | easy | entry synthesized from connector meta.json |
| Christie's | christies.com | US | auction_house | implemented | christies | ✓ (none) | · | ✓ | · | none | · | · | · | · | none | page_number | api | USD/GBP/HKD/EUR/CHF | wave1 | easy | entry synthesized from connector meta.json |
| HODINKEE Shop | shop.hodinkee.com | US | dealer | implemented | hodinkee-shop | · | ✓ | · | · | none | · | · | · | · | none | page_number | shopify | USD | wave3 | easy | HODINKEE's authorised-retail and pre-owned/vintage watch shop (New York): pre-owned Rolex, Cartier, Omega, Grand Seiko, vintage chronographs (Universal Genève, Zenith, Heuer, Patek, AP) and limited editions for HODINKEE. Rich structured tags (approximate_age, case_size, materials, box/papers). Straps, accessories, books and Apple Watch are excluded. Prices are the base currency USD (/meta.json currency USD, Shopify.currency rate 1.0). Sold vintage/pre-owned pieces stay published as out-of-stock products, so most watch listings arrive as availability "ended" with their last asking price — useful price history, but never treated as a realised sale. Only products whose product_type is "Watches : …" or "… : New Watch" are mapped; everything else in a watch collection (straps, pouches, books) is skipped. |
| Sotheby's | sothebys.com | US | auction_house | implemented | sothebys | ✓ (none) | · | ✓ | ✓ | none | · | · | · | · | none | page_number | api | USD/GBP/HKD/EUR/CHF | wave1 | easy | entry synthesized from connector meta.json |
silver (1)
| Source | Domain | Country | Type | Status | Connectors | API | Live | Sold | Auction | Hist. | Pop. | Cert | GTIN | JS | Anti-bot | Pagination | Engine | Currency | Priority | Difficulty | Notes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Woolley & Wallis | woolleyandwallis.co.uk | GB | auction_house | implemented | woolley-wallis | ✓ (none) | · | ✓ | ✓ | years | · | · | · | · | none | page_number | api | GBP | wave1 | medium | Sale id read from the public lot page attribute sale-id="…". |
sneakers (29)
| Source | Domain | Country | Type | Status | Connectors | API | Live | Sold | Auction | Hist. | Pop. | Cert | GTIN | JS | Anti-bot | Pagination | Engine | Currency | Priority | Difficulty | Notes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Capsule Toronto | capsuletoronto.com | CA | dealer | implemented | capsule-toronto | · | ✓ | · | · | none | · | · | · | · | none | page_number | shopify | CAD | wave3 | easy | Toronto sneaker/streetwear boutique (Nike, Jordan, New Balance, adidas, ASICS, Converse). Shopify storefront; titles end with the manufacturer style code (e.g. IX3529-010). ~9k footwear SKUs; Nike 2.4k, Jordan 1k, New Balance 900. Verified live 2026-09-08: robots.txt, /products.json?limit=1 (200 JSON), /collections.json, /meta.json currency=CAD. |
| Cool Kicks | coolkicks.com | US | dealer | rejected | — | · | · | · | · | none | · | · | · | · | none | unknown | none | USD | later | hard | /products.json returns 200 but not a Shopify products payload (HTML). Not a usable Shopify storefront. |
| Crepslocker | crepslocker.com | GB | dealer | implemented | crepslocker | · | ✓ | · | · | none | · | · | · | · | none | page_number | shopify | GBP | wave3 | easy | Blackburn (UK) luxury sneaker and streetwear reseller: Air Jordan, Nike Dunk, Yeezy, designer trainers (Dior, Balenciaga, Hermès), a "Preloved" pre-owned range with condition tags, Swatch × AP watches, Pokémon sealed and Pop Mart Labubu. Prices are the base currency GBP (/meta.json currency GBP, Shopify.currency rate 1.0). "Preloved -" titles are pre-owned pairs; their condition tag (e.g. "Condition: Very good") is kept in metadata.tags. |
| Finesse (solefiness.com) | finessestore.com | AU | dealer | rejected | — | · | ✓ | · | · | none | · | · | · | · | none | unknown | shopify | AUD | later | medium | Shopify (AUD) boutique of current-season women's sneakers at retail; no resale/collectible signal. |
| Flight Club | flightclub.com | US | marketplace | implemented | flight-club | · | ✓ | · | · | none | · | · | · | ✓ | low | page_number | firecrawl | USD | wave2 | medium | entry synthesized from connector meta.json |
| FOOTDISTRICT | footdistrict.com | ES | dealer | implemented | footdistrict | · | ✓ | · | · | none | · | · | · | · | none | page_number | shopify | EUR | wave3 | easy | Spanish authorised sneaker & streetwear retailer (Almería): Nike/Jordan/adidas/ASICS/New Balance releases with EU sizes and style-code SKUs (e.g. IQ6573-100), plus Medicom Be@rbrick art toys. Spanish-language product types ("Calzado"). Prices are the base currency EUR (/meta.json currency EUR, Shopify.currency rate 1.0), Spanish VAT included. |
| GOAT | goat.com | US | marketplace | blocked | — | · | ✓ | · | · | none | · | · | · | ✓ | blocking | unknown | none | USD | wave1 | very_hard | Anti-bot (DataDome/PerimeterX) blocks all automated access; no public API. |
| Hanon Shop | hanon-shop.com | GB | dealer | rejected | — | · | ✓ | · | · | none | · | · | · | · | none | unknown | none | GBP | later | medium | Host unreachable at probe time. |
| Hypeboost | hypeboost.com | NL | marketplace | implemented | hypeboost | · | ✓ | · | · | none | · | · | · | ✓ | low | page_number | firecrawl | EUR | wave3 | medium | entry synthesized from connector meta.json |
| Index PDX | indexpdx.com | US | dealer | blocked | — | · | ✓ | · | · | none | · | · | · | · | medium | unknown | none | USD | later | hard | Shopify shop locked (HTTP 423 Locked on /products.json). Not accessible. |
| Kick Game | kickgame.co.uk | GB | dealer | implemented | kickgame | · | ✓ | · | · | none | · | · | · | · | none | page_number | shopify | GBP | wave3 | easy | London premium sneaker retailer/reseller (since 2013): Air Jordan, Nike Dunk/SB, Yeezy, New Balance, plus Bearbrick, KAWS and Labubu collectibles and Swatch × Omega/Blancpain watches. Size-level variants carry the style code in the SKU (e.g. DM7866-200.3UK). Prices are the base currency GBP: the storefront shows visitors a geo-converted presentment currency (Shopify.currency active USD, rate 1.38 from a North-American IP) but products.json and /meta.json (currency GBP, primary domain www.kickgame.co.uk) are GBP. The .com host redirects to .co.uk. |
| KicksCrew | kickscrew.com | HK | marketplace | blocked | — | · | · | · | · | none | · | · | · | · | blocking | unknown | none | USD | later | medium | Bot protection blocks fetches. |
| Kikikickz | kikikickz.com | FR | marketplace | blocked | — | · | ✓ | · | · | none | · | · | · | ✓ | blocking (CF) | unknown | none | EUR | later | very_hard | 403 for the bot UA on every path including /robots.txt. |
| KLEKT | klekt.com | GB | marketplace | blocked | — | · | · | · | · | none | · | · | · | · | blocking | unknown | none | EUR/GBP | later | medium | Bot protection blocks fetches. |
| KREAM (크림, Naver) | kream.co.kr | KR | marketplace | planned | — | · | ✓ | ✓ | · | years | · | · | · | ✓ | medium | cursor | none | KRW | wave2 | very_hard | Not implemented: the product API needs app-secret request headers (would be circumvention); the SSR HTML only exposes a Nuxt payload serialised as a JS function and an og:product:price meta whose meaning (last trade vs. lowest ask) is ambiguous — storing it would violate the data-honesty rule. Revisit if KREAM publishes a partner API. |
| Laced | laced.com | GB | marketplace | implemented | laced | · | ✓ | · | · | none | · | · | · | · | none | page_number | api | GBP | wave2 | easy | entry synthesized from connector meta.json |
| Livestock | deadstock.ca | CA | dealer | implemented | livestock | · | ✓ | · | · | none | · | · | · | · | none | page_number | shopify | CAD | wave3 | easy | Canadian sneaker boutique (Livestock, deadstock.ca). Shopify storefront; sizes as variants with structured SKU (style|colour|size). Retail asks, not resale. ~450 footwear SKUs (adidas Originals, ASICS, Jordan, Converse). Verified live 2026-09-08: robots.txt, /products.json?limit=1 (200 JSON), /collections.json, /meta.json currency=CAD. |
| Novelship | novelship.com | SG | marketplace | implemented | novelship | · | ✓ | · | · | none | · | · | · | · | none | page_number | api | USD | wave2 | easy | entry synthesized from connector meta.json |
| OVERKILL | overkillshop.com | DE | dealer | implemented | overkillshop | · | ✓ | · | · | none | · | · | · | · | none | page_number | shopify | EUR | wave3 | easy | Berlin sneaker boutique (since 2003): adidas/ASICS/New Balance/Nike/Jordan releases and an "Overkill Archive" of past drops with EU sizes and article-number tags, plus Medicom Be@rbrick 1000% art toys. Prices are the base currency EUR (/meta.json currency EUR, Shopify.currency rate 1.0), German VAT included. |
| Restocks | restocks.net | NL | marketplace | blocked | — | · | ✓ | · | · | none | · | · | · | ✓ | blocking (CF) | unknown | none | EUR | later | very_hard | TLS handshake rejected for the bot client (LibreSSL alert internal error on restocks.net and www) and Firecrawl scrape timed out — site unreachable to non-browser clients. |
| Sneakers123 | sneakers123.com | AT | analytics_provider | rejected | — | · | ✓ | · | · | none | · | · | · | · | none | sitemap | none | EUR | later | medium | Retail price comparison of shop inventories (affiliate), not collectible resale/market data. |
| SNKRDUNK (スニーカーダンク) | snkrdunk.com | JP | marketplace | blocked | — | · | ✓ | ✓ | · | months | · | · | · | ✓ | low | sitemap | none | JPY | wave2 | hard | Product pages are server-rendered without any price (verified on /en/sneakers/019332 and /en/trading-cards/843266); prices come from /en/v1/* which robots.txt disallows. Sitemaps (5 sneaker + 9 card shards) exist but yield only URLs/titles. |
| Sole Retriever | soleretriever.com | US | analytics_provider | blocked | — | · | · | · | · | none | · | · | · | ✓ | high (CF) | sitemap | none | USD | later | hard | Release-date / raffle aggregator (no market prices) and the allowed /collections/* path returns 403 (Cloudflare) to the bot UA. |
| Solebox | solebox.com | DE | dealer | rejected | — | · | ✓ | · | · | none | · | · | · | · | none | unknown | none | EUR | later | medium | Custom (non-Shopify) storefront; no product JSON found. |
| Stadium Goods | stadiumgoods.com | US | marketplace | blocked | — | · | · | · | · | none | · | · | · | · | blocking | unknown | none | USD | later | medium | Bot protection (Akamai) blocks fetches. |
| StockX | stockx.com | US | marketplace | blocked | — | · | ✓ | ✓ | · | years | · | · | · | ✓ | blocking | unknown | none | USD | wave1 | very_hard | PerimeterX returns 404/403 to every non-browser and to rendered fetches; public API is partner-only. No circumvention attempted (SPEC §36). Partner data feed is the lawful route. |
| The Sole Supplier (Sole Market) | thesolesupplier.co.uk | GB | analytics_provider | rejected | — | · | ✓ | · | · | none | · | · | · | ✓ | low | sitemap | none | GBP | later | medium | Affiliate aggregator of retailers' retail prices (not resale market data) — duplicates retailer feeds without adding transactions or asks. |
| Urban Necessities | urbannecessities.com | US | dealer | blocked | — | · | ✓ | · | · | none | · | · | · | · | medium | unknown | none | USD | later | hard | Shopify but /products.json answers 401 — storefront JSON disabled by the merchant. Respected. |
| Wethenew | wethenew.com | FR | marketplace | blocked | — | · | ✓ | · | · | none | · | · | · | · | high (CF) | page_number | none | EUR | later | hard | Shopify storefront JSON (/products.json) returns 403 to the honest UA (bot protection); HTML home is 200 but products.json is the only structured route. |
space (1)
| Source | Domain | Country | Type | Status | Connectors | API | Live | Sold | Auction | Hist. | Pop. | Cert | GTIN | JS | Anti-bot | Pagination | Engine | Currency | Priority | Difficulty | Notes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| RR Auction | rrauction.com | US | auction_house | implemented | rr-auction | · | · | ✓ | · | none | · | · | · | ✓ | low (CF) | page_number | firecrawl | USD | wave1 | medium | entry synthesized from connector meta.json |
sports_cards (14)
| Source | Domain | Country | Type | Status | Connectors | API | Live | Sold | Auction | Hist. | Pop. | Cert | GTIN | JS | Anti-bot | Pagination | Engine | Currency | Priority | Difficulty | Notes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 130point | 130point.com | US | analytics_provider | rejected | — | · | · | ✓ | · | none | · | · | · | · | blocking | unknown | none | USD | later | medium | Re-publishes eBay sold data under eBay's terms; bot-protected; use eBay official API instead. |
| Alt | alt.xyz | US | analytics_provider | implemented | alt-xyz | · | ✓ | ✓ | · | none | · | · | · | ✓ | low | page_number | firecrawl | USD | wave3 | medium | entry synthesized from connector meta.json |
| Beckett Grading Services (BGS) — card lookup & pop report | beckett.com | US | grading_company | blocked | — | · | · | · | · | none | ✓ | ✓ | · | ✓ | high (CF) | none | none | USD | wave2 | very_hard | BGS card lookup (/grading/card-lookup → /api/grading/*) and pop report (/grading/pop-report) both require a reCAPTCHA token; verified live 2026-09-08 (plain POST of the pop form and a Firecrawl render of the lookup URL both return the reCAPTCHA gate). Grader slug bgs stays taxonomy-only. |
| Blowout Cards | blowoutcards.com | US | dealer | rejected | — | · | · | · | · | none | · | · | · | · | none | unknown | none | USD | later | hard | Custom (Magento-style) platform: /products.json 403, /wp-json/wc/store/v1/products returns HTML. Not a Shopify/Woo storefront — out of scope for this fleet. |
| Burbank Sportscards | burbanksportscards.com | US | dealer | rejected | — | · | · | · | · | none | · | · | · | · | none | unknown | none | USD | later | hard | Host unreachable on 2026-09-08 (connection failed). Skipped. |
| Card Ladder | cardladder.com | US | analytics_provider | blocked | — | · | · | · | · | none | · | · | · | · | none | unknown | api | USD | later | medium | Subscription product; login required. |
| COMC | comc.com | US | marketplace | implemented | comc | · | ✓ | · | · | none | · | · | · | ✓ | low | page_number | firecrawl | USD | wave2 | medium | entry synthesized from connector meta.json |
| Dave & Adam's Card World | dacardworld.com | US | dealer | blocked | — | · | ✓ | · | · | none | · | · | · | · | blocking (CF) | unknown | none | USD | later | hard | Cloudflare 403 to the honest bot UA on / and every probed path; custom (non-Shopify) platform. Not circumvented. |
| Heritage Auctions | ha.com | US | auction_house | blocked | — | · | · | ✓ | ✓ | decades | · | ✓ | · | · | high | unknown | none | USD | wave1 | very_hard | Prices-realised archive requires a free but mandatory account (login wall) and terms prohibit automated access; upcoming-lot pages are protected. Data licence/partnership is the lawful route. |
| MySlabs | myslabs.com | US | marketplace | implemented | myslabs | ✓ (none) | ✓ | · | · | none | · | · | · | · | none | page_number | api | USD | wave2 | easy | entry synthesized from connector meta.json |
| SGC (Sportscard Guaranty) — cert lookup & pop report | gosgc.com | US | grading_company | blocked | — | ✓ (partner) | · | · | · | none | ✓ | ✓ | · | ✓ | medium | none | none | USD | wave2 | very_hard | Cert lookup behind reCAPTCHA; pop report only through an origin-restricted XHR API; legacy ASP.NET report offline. Verified live 2026-09-08. Grader slug sgc stays taxonomy-only. |
| SportsCardsPro (PriceCharting) | sportscardspro.com | US | pricing_guide | implemented | sportscardspro | · | · | ✓ | · | none | · | · | · | ✓ | low (CF) | page_number | firecrawl | USD | wave1 | medium | entry synthesized from connector meta.json |
| Steel City Collectibles | steelcitycollectibles.com | US | dealer | blocked | — | · | ✓ | · | · | none | · | · | · | · | blocking (CF) | unknown | none | USD | later | hard | Cloudflare 403 to the honest bot UA on all paths; custom platform. Not circumvented. |
| TCDB – Trading Card Database | tcdb.com | US | collector_database | blocked | — | · | · | · | · | none | · | · | · | ✓ | blocking (CF) | page_number | none | USD | later | very_hard | Cloudflare managed challenge on all paths including robots.txt (HTTP 403); no lawful automated access path — not crawled. |
sports_memorabilia (5)
| Source | Domain | Country | Type | Status | Connectors | API | Live | Sold | Auction | Hist. | Pop. | Cert | GTIN | JS | Anti-bot | Pagination | Engine | Currency | Priority | Difficulty | Notes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Grey Flannel Auctions | greyflannelauctions.com | US | auction_house | blocked | — | · | · | ✓ | ✓ | years | · | · | · | · | blocking (CF) | unknown | none | USD | later | very_hard | Cloudflare WAF 403 block page for every request (bot and browser UA). Not fought. |
| Iconic Auctions | iconicauctions.com | US | auction_house | blocked | — | · | · | ✓ | ✓ | years | · | · | · | · | blocking | unknown | none | USD | later | very_hard | Akamai 'Access Denied' for every request incl. robots.txt. Not fought. |
| Lelands | auction.lelands.com | US | auction_house | implemented | lelands | · | · | ✓ | · | none | · | · | · | ✓ | low (CF) | page_number | firecrawl | USD | wave2 | medium | entry synthesized from connector meta.json |
| Pristine Auction | pristineauction.com | US | marketplace | blocked | — | · | · | ✓ | ✓ | years | · | · | · | ✓ | high (CF) | unknown | none | USD | later | very_hard | Cloudflare 'Just a moment' challenge on the homepage for both UAs; no public sold endpoint reachable without passing the challenge. Could be revisited with Scrapfly ASP on the public sold pages if terms allow. |
| SCP Auctions | catalogs.scpauctions.com | US | auction_house | implemented | scp-auctions | ✓ (none) | · | ✓ | ✓ | none | · | · | · | · | none | page_number | api | USD | wave2 | easy | entry synthesized from connector meta.json |
stamps (10)
| Source | Domain | Country | Type | Status | Connectors | API | Live | Sold | Auction | Hist. | Pop. | Cert | GTIN | JS | Anti-bot | Pagination | Engine | Currency | Priority | Difficulty | Notes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Aste Bolaffi | astebolaffi.it | IT | auction_house | implemented | aste-bolaffi | · | · | ✓ | ✓ | years | · | · | · | · | none | page_number | api | EUR | wave2 | medium | 10 lots per page → slow (3 s politeness). |
| Cherrystone Philatelic Auctioneers | auctions.cherrystoneauctions.com | US | auction_house | implemented | cherrystone | · | · | ✓ | · | none | · | · | · | ✓ | low | page_number | firecrawl | USD | wave2 | medium | entry synthesized from connector meta.json |
| Colnect | colnect.com | IL | catalog | rejected | — | ✓ (partner) | · | · | · | none | · | · | · | · | blocking | unknown | none | USD | later | very_hard | Automated access prohibited without a CAPI licence (robots.txt + Anubis challenge). Revisit only with a licence. |
| Corinphila Auctions | corinphila.ch | CH | auction_house | implemented | corinphila | · | · | ✓ | ✓ | years | · | · | · | · | none | page_number | api | CHF | wave3 | easy | Archive auctions 12–28 (Nov 2016 – Jun 2024) with 'Hammer price : X CHF' per lot; 2025+ sales only as PDF result lists + JS catalogue. |
| Daniel F. Kelleher Auctions | stampauctionnetwork.com | US | auction_house | implemented | kelleher | · | · | ✓ | · | none | · | · | · | · | none | page_number | api | USD | wave2 | easy | entry synthesized from connector meta.json |
| David Feldman SA | davidfeldman.com | CH | auction_house | blocked | — | · | · | ✓ | ✓ | years | · | · | · | ✓ | blocking (CF) | unknown | none | EUR/CHF | later | very_hard | Cloudflare hard block ('Attention Required!' 403) on every page for the bot UA; robots also disallows /wp-json/. Not retried with anti-bot tooling. |
| Robert A. Siegel Auction Galleries | siegelauctions.com | US | auction_house | blocked | — | · | · | · | · | none | · | · | · | · | high | unknown | none | USD | later | medium | Power Search results require login. |
| Stamp Auction Network (prices realized, all firms) | stampauctionnetwork.com | US | marketplace | partial | kelleher | · | · | ✓ | ✓ | decades | · | · | · | · | none | page_number | api | USD/GBP/EUR/CAD/AUD/CHF | wave3 | medium | Kelleher (firm V) is implemented; a generic connector for the other ~100 firms in the same cCatalog3 format (Rasdale RA, Harmers HN, Cavendish CV, Gärtner CG, Soler y Llach SO, Sandafayre ZG, Gibbons GI, Maresch RM…) needs the POST 'Next' pagination (form-encoded) that the HTTP engine does not send yet. |
| Stanley Gibbons Baldwin's | sgbaldwins.com | GB | auction_house | implemented | sgbaldwins | ✓ (none) | · | ✓ | ✓ | years | · | · | · | · | none | none | api | GBP | wave2 | easy | ≈ 200 past auctions since Jan 2020 (Stamps 111, Coins 38, Medals 4; trading cards/comics left to other connectors). buildId read from the home page at each run. |
| Stanley Gibbons online shop | shop.stanleygibbons.com | GB | dealer | implemented | stanley-gibbons-shop | ✓ (none) | ✓ | · | · | none | · | · | · | · | none | page_number | shopify | GBP | wave3 | trivial | Collections stamps-great-britain (≈ 1 600) and stamps-commonwealth (≈ 4 100). stanleygibbons.com itself exposes no public price guide (printed catalogues only); coins are sold on baldwin.co.uk. |
star_wars_tcg (1)
| Source | Domain | Country | Type | Status | Connectors | API | Live | Sold | Auction | Hist. | Pop. | Cert | GTIN | JS | Anti-bot | Pagination | Engine | Currency | Priority | Difficulty | Notes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| SWU-DB | swu-db.com | US | catalog | implemented | swu-db | ✓ (none) | · | · | · | none | · | · | · | · | none | page_number | api | USD | wave2 | easy | entry synthesized from connector meta.json |
trading_cards (3)
| Source | Domain | Country | Type | Status | Connectors | API | Live | Sold | Auction | Hist. | Pop. | Cert | GTIN | JS | Anti-bot | Pagination | Engine | Currency | Priority | Difficulty | Notes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Buyee (proxy shopping for Yahoo! Auctions / Mercari) | buyee.jp | JP | marketplace | rejected | — | · | ✓ | · | · | none | · | · | · | · | high (CF) | page_number | none | JPY | later | hard | Adds no access: Yahoo! Auctions serves its public pages directly to the bot UA (yahoo-auctions-jp). Buyee returns 403 to non-browser clients (even /robots.txt) and only mirrors Yahoo/Mercari items with a proxy fee. |
| Shopee Taiwan (蝦皮購物) | shopee.tw | TW | marketplace | blocked | — | · | ✓ | · | · | none | · | · | · | ✓ | blocking | offset | none | TWD | later | very_hard | Anti-bot: JSON search endpoint returns 403 to non-browser clients; the site is a JS shell. Not retried. |
| TCGCSV | tcgcsv.com | US | pricing_guide | implemented | tcgcsv | ✓ (none) | · | · | · | none | · | · | · | · | none | page_number | api | USD | wave1 | easy | entry synthesized from connector meta.json |
video_games (9)
| Source | Domain | Country | Type | Status | Connectors | API | Live | Sold | Auction | Hist. | Pop. | Cert | GTIN | JS | Anti-bot | Pagination | Engine | Currency | Priority | Difficulty | Notes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Console Passion | consolepassion.co.uk | GB | dealer | rejected | — | · | ✓ | · | · | none | · | · | · | · | none | unknown | none | GBP | later | medium | Custom platform (redirect to bare host, no products.json / Store API). |
| eStarland | estarland.com | US | dealer | implemented | estarland | · | ✓ | · | · | none | · | · | · | · | high (CF) | page_number | scrapfly | USD | wave2 | medium | Main-grid cards: h4 name, platformName "Nintendo / NES", New/Used, priceProductHolder (unavailPrice = out of stock), product id in URL; 50 platform pages listed in the nav. Carousel/featured cards duplicate grid items and are ignored. |
| GameValueNow | gamevaluenow.com | US | pricing_guide | blocked | — | · | · | · | · | years | · | · | · | · | blocking (CF) | unknown | none | USD | later | very_hard | Cloudflare challenge for plain HTTP and connection refused for Scrapfly (2026-09-08); robots.txt could not be read → not crawled. PriceCharting (implemented) covers loose/CIB/new retro game prices. |
| JJGames | jjgames.com | US | dealer | rejected | — | · | ✓ | · | · | none | · | · | · | ✓ | none | infinite_scroll | none | USD | later | hard | Ecwid SPA with no public product endpoint (storefront API 404 without token, REST API 403); JJGames is PriceCharting's sister store and PriceCharting is already implemented → not worth a rendered-crawl connector. |
| Mighty Ape | mightyape.co.nz | NZ | dealer | blocked | — | · | ✓ | · | · | none | · | · | · | · | blocking | unknown | none | NZD | later | medium | Bot-protection interstitial ("Please wait…") returned to all automated requests; custom platform. |
| PriceCharting | pricecharting.com | US | pricing_guide | implemented | pricecharting | ✓ (none) | · | ✓ | · | none | · | · | · | · | none | page_number | api | USD | wave1 | easy | entry synthesized from connector meta.json |
| Retro Games Ltd | retrogames.co.uk | GB | dealer | rejected | — | · | ✓ | · | · | none | · | · | · | · | none | unknown | none | GBP | later | medium | Custom CGI shop ("Search Found No Entries" for /wp-json); robots disallows most .cgi endpoints. No structured data. |
| VGA, ANACS, ICCS, HGA (minor graders) — desk research only | vggrader.com | US | grading_company | researching | — | · | · | · | · | none | · | ✓ | · | ✓ | medium | none | none | USD | later | hard | Not probed live this session (brief: research only unless trivially public). VGA (vggrader.com) publishes no per-cert verification page; ANACS (anacs.com) has a serial lookup form; ICCS (iccscoin.ca) has no online verification; HGA (hybridgrading.com) has a cert page behind a JS app. To be verified in a later wave. |
| WATA Games (now PSA Video Games) — cert verification | psavideogames.com | US | grading_company | rejected | — | · | · | · | · | none | · | ✓ | · | ✓ | high (CF) | none | none | USD | wave3 | hard | watagames.com redirects to psavideogames.com whose verify page is a 404; no public WATA population report found (taxonomy populationUrl https://www.watagames.com/population is dead). Video-game certs verify through psa-cert where PSA-graded. Verified live 2026-09-08. |
vintage_toys (9)
| Source | Domain | Country | Type | Status | Connectors | API | Live | Sold | Auction | Hist. | Pop. | Cert | GTIN | JS | Anti-bot | Pagination | Engine | Currency | Priority | Difficulty | Notes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Craigslist | craigslist.org | US | marketplace | rejected | — | · | · | · | · | none | · | · | · | · | high | unknown | none | USD | later | medium | Terms forbid scraping; RSS feeds removed; low value for pricing (no sold data, unstructured titles). |
| Etsy (Open API v3) | etsy.com | US | marketplace | gated | etsy | ✓ (api_key) | ✓ | · | · | none | · | · | · | · | none | offset | api | USD/GBP/EUR/CAD/AUD | wave1 | easy | Connector implemented against the official OpenAPI schema (etsy.com/openapi/generated/oas/3.0.0.json); needs ETSY_API_KEY. Fixture synthesised from the schema (the reference carries no example response). |
| Facebook Marketplace | facebook.com | US | marketplace | rejected | — | · | · | · | · | none | · | · | · | · | blocking | unknown | none | USD | later | medium | Requires a Facebook login; Meta terms prohibit automated collection. Not lawfully accessible. |
| Gumtree | gumtree.com | GB | marketplace | rejected | — | · | · | · | · | none | · | · | · | · | high | unknown | none | GBP | later | medium | Anti-bot; classifieds without sold data; low pricing value. |
| Hake's Auctions | hakes.com | US | auction_house | implemented | hakes | · | · | ✓ | ✓ | none | · | · | · | · | none | page_number | api | USD | wave2 | easy | entry synthesized from connector meta.json |
| Kijiji | kijiji.ca | CA | marketplace | rejected | — | · | · | · | · | none | · | · | · | · | high | unknown | none | CAD | later | medium | Anti-bot; terms forbid automated access; asking prices only, no sold data. |
| Leboncoin | leboncoin.fr | FR | marketplace | blocked | — | · | · | · | · | none | · | · | · | · | blocking | unknown | none | EUR | later | medium | DataDome; terms forbid scraping. |
| Morphy Auctions | morphyauctions.com | US | auction_house | implemented | morphy | · | · | ✓ | · | none | · | · | · | · | none | page_number | api | USD | wave2 | easy | entry synthesized from connector meta.json |
| Wallapop | wallapop.com | ES | marketplace | researching | — | · | · | · | · | none | · | · | · | · | high | unknown | none | EUR | later | medium | Public search API observed (api.wallapop.com) — terms review pending. |
watches (16)
| Source | Domain | Country | Type | Status | Connectors | API | Live | Sold | Auction | Hist. | Pop. | Cert | GTIN | JS | Anti-bot | Pagination | Engine | Currency | Priority | Difficulty | Notes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Antiquorum | catalog.antiquorum.swiss | CH | auction_house | implemented | antiquorum | · | · | ✓ | ✓ | none | · | · | · | · | none | page_number | api | CHF/HKD/EUR/USD | wave1 | easy | entry synthesized from connector meta.json |
| Carousell (SG / HK) | carousell.sg | SG | marketplace | blocked | — | · | ✓ | · | · | none | · | · | · | ✓ | high (CF) | cursor | none | SGD/HKD | later | very_hard | Search pages are robots-disallowed and the allowed api-service endpoint returns 403 (Cloudflare) to the bot UA. |
| CHRONEXT | chronext.com | DE | dealer | implemented | chronext | · | ✓ | · | · | none | · | · | · | · | none | offset | api | USD/EUR/GBP/CHF | wave2 | easy | Displayed currency follows the requester's geo (USD seen from North America) — stored as shown. |
| Chrono24 | chrono24.com | global | marketplace | implemented | chrono24 | · | ✓ | · | · | none | · | · | · | ✓ | high (CF) | page_number | scrapfly | USD | wave1 | hard | entry synthesized from connector meta.json |
| European Watch Company | europeanwatch.com | US | dealer | implemented | european-watch-company | · | ✓ | · | · | none | · | · | · | · | none | none | api | USD | wave2 | easy | One ~5 MB page = whole inventory (750 watches). |
| European Watch Company | europeanwatch.com | US | dealer | implemented | crown-caliber | · | ✓ | · | · | none | · | · | · | · | none | page_number | api | USD | wave2 | easy | entry synthesized from connector meta.json |
| Fellows Auctioneers | fellows.co.uk | GB | auction_house | blocked | — | · | · | ✓ | ✓ | years | · | · | · | ✓ | blocking | unknown | none | GBP | later | very_hard | Same AWS ELB 202/empty-body bot challenge as Forum Auctions on every page. |
| Loupe This | loupethis.com | US | auction_house | implemented | loupe-this | ✓ (none) | · | ✓ | ✓ | years | · | · | · | · | none | page_number | api | USD | wave1 | easy | 4 251 closed lots (43 pages) since 2021; ~30 live lots per week. |
| Subdial | subdial.com | GB | marketplace | implemented | subdial | · | ✓ | · | · | none | · | · | · | · | none | page_number | api | GBP | wave2 | easy | entry synthesized from connector meta.json |
| The 1916 Company (WatchBox / Govberg) | the1916company.com | US | dealer | planned | — | · | ✓ | · | · | none | · | · | · | ✓ | medium (CF) | unknown | none | USD | later | hard | No product sitemap (sitemap_0-pipeline/sitemap_1 hold 60 static pages) and the category URL returned 404 to the bot; inventory grid appears JS/API driven under /api/* (robots-disallowed). Needs a Scrapfly render experiment before deciding. |
| WatchCharts | watchcharts.com | US | analytics_provider | blocked | — | ✓ (partner) | · | · | · | years | · | · | · | ✓ | blocking (CF) | none | none | USD | wave2 | very_hard | 403 for every path with the honest UA (robots.txt, home, terms — re-verified 2026-09-08, also via Firecrawl → 404/403). Circumventing would require a browser fingerprint against an explicit block; market-index values are the company's paid product. |
| Watchfinder & Co. | watchfinder.co.uk | GB | dealer | implemented | watchfinder | · | ✓ | · | · | none | · | · | · | ✓ | low | page_number | firecrawl | GBP | wave2 | medium | entry synthesized from connector meta.json |
| WatchUSeek forums (sales corner) | watchuseek.com | US | forum | rejected | — | · | ✓ | · | · | years | · | · | · | · | medium (CF) | page_number | none | USD | later | hard | Forum classifieds: unstructured member posts with personal data, no reliable price/sale fields — out of scope per brief. |
| Wind Vintage | windvintage.com | US | dealer | rejected | — | · | ✓ | · | · | none | · | · | · | · | none | none | none | USD | later | medium | Inventory is 3 blog-style posts without structured prices (mostly sells by appointment); the 5 685-URL sitemap is editorial content. Not worth a connector. |
| Wind Vintage | windvintage.com | US | dealer | rejected | — | · | ✓ | · | · | none | · | · | · | · | none | unknown | firecrawl | USD | later | medium | Squarespace storefront (no Shopify/Woo JSON). Squarespace exposes ?format=json on collection pages — candidate for a small dedicated connector later; low volume (curated vintage watches). |
| Xupes | xupes.com | GB | dealer | rejected | — | · | ✓ | · | · | none | · | · | · | · | none | unknown | firecrawl | GBP | later | medium | Magento 2 storefront (no public JSON catalogue). Pre-owned watches already covered by Watchfinder/Subdial/Chrono24; candidate for a later JSON-LD (adapters.productsFromHtml) connector. |
whisky (8)
| Source | Domain | Country | Type | Status | Connectors | API | Live | Sold | Auction | Hist. | Pop. | Cert | GTIN | JS | Anti-bot | Pagination | Engine | Currency | Priority | Difficulty | Notes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Just Whisky | just-whisky.co.uk | GB | auction_house | implemented | just-whisky | ✓ (none) | · | ✓ | · | none | · | · | · | · | none | page_number | api | GBP | wave1 | easy | entry synthesized from connector meta.json |
| Scotch Whisky Auctions | scotchwhiskyauctions.com | GB | auction_house | implemented | scotch-whisky-auctions | · | · | ✓ | ✓ | none | · | · | · | · | none | page_number | api | GBP | wave1 | easy | entry synthesized from connector meta.json |
| Spirits Auctioneer | spiritsauctioneer.com | GB | auction_house | rejected | — | · | · | · | · | none | · | · | · | · | none | none | none | GBP | later | trivial | Domain serves a 114-byte empty page (parked/no content) on 2026-09-08 — no auction data. |
| Unicorn Auctions | unicornauctions.com | US | auction_house | blocked | — | · | ✓ | ✓ | ✓ | years | · | · | · | ✓ | low | infinite_scroll | none | USD | wave2 | hard | Terms of Use expressly forbid automated access/copying, and the only data path is the robots-disallowed /api/. Not crawled. |
| Whisky Auctioneer | whiskyauctioneer.com | GB | auction_house | blocked | — | · | · | · | · | none | · | · | · | · | blocking | unknown | none | GBP | later | medium | Cloudflare challenge on all pages. |
| Whisky Hammer | whiskyhammer.com | GB | auction_house | implemented | whisky-hammer | · | · | ✓ | · | none | · | · | · | ✓ | low (CF) | page_number | firecrawl | GBP | wave2 | medium | entry synthesized from connector meta.json |
| Whisky.Auction | whisky.auction | GB | auction_house | implemented | whisky-auction | · | · | ✓ | ✓ | years | · | · | · | · | none | page_number | api | GBP | wave1 | easy | ~190 past auctions since 2016 (ids 10–202), 800–4,000 lots each; category filter accepts comma lists; lots sorted by price desc, unsold lots carry winning bid -1. |
| Whiskybase | whiskybase.com | NL | collector_database | blocked | — | · | · | · | · | none | · | · | · | · | blocking | unknown | none | EUR | later | medium | Cloudflare challenge; terms forbid scraping. |
wine (7)
| Source | Domain | Country | Type | Status | Connectors | API | Live | Sold | Auction | Hist. | Pop. | Cert | GTIN | JS | Anti-bot | Pagination | Engine | Currency | Priority | Difficulty | Notes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Acker Merrall & Condit (Acker Wines) | ackerwines.com | US | auction_house | blocked | — | · | ✓ | ✓ | ✓ | decades | · | · | · | ✓ | blocking (CF) | unknown | firecrawl | USD/HKD/SGD | wave2 | very_hard | Direct HTTP blocked by Cloudflare WAF (403 for every UA); prices-realised archive behind login (verified via Firecrawl 2026-09-08). Only pre-sale catalogues are public — no realised prices. |
| Hart Davis Hart Wine Co. | hdhauctions.com | US | auction_house | implemented | hdh-wine | · | · | ✓ | · | none | · | · | · | ✓ | low | page_number | firecrawl | USD | wave2 | medium | entry synthesized from connector meta.json |
| iDealwine | idealwine.com | FR | pricing_guide | implemented | idealwine | ✓ (none) | · | · | · | none | · | · | · | · | none | page_number | api | EUR | wave2 | easy | entry synthesized from connector meta.json |
| Liv-ex | liv-ex.com | GB | analytics_provider | rejected | — | ✓ (partner) | · | ✓ | · | decades | · | · | · | ✓ | medium | none | none | GBP | later | very_hard | Paid, members-only data (per brief). Only headline index values are public. |
| Wine-Searcher | wine-searcher.com | NZ | pricing_guide | rejected | — | ✓ (partner) | ✓ | · | · | years | · | · | · | ✓ | high | page_number | none | USD/GBP/EUR | later | very_hard | Paid API / licensed data; site terms forbid scraping and robots disallows the price facets we would need. Merchant asking prices only — no sales. |
| WineBid | winebid.com | US | marketplace | implemented | winebid | · | ✓ | ✓ | ✓ | none | · | · | · | · | none | page_number | api | USD | wave2 | easy | entry synthesized from connector meta.json |
| Zachys Wine Auctions | bid.zachys.com | US | auction_house | blocked | — | · | ✓ | ✓ | ✓ | years | · | · | · | · | blocking | page_number | none | USD/HKD | wave2 | hard | bid.zachys.com answers HTTP 403 (CloudFront 'Request blocked') to plain requests for auction lists and catalogues; not circumvented. Retail Shopify storefront (www.zachys.com/products.json) noted for the Shopify connector group. |
yugioh (1)
| Source | Domain | Country | Type | Status | Connectors | API | Live | Sold | Auction | Hist. | Pop. | Cert | GTIN | JS | Anti-bot | Pagination | Engine | Currency | Priority | Difficulty | Notes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| YGOPRODeck | ygoprodeck.com | US | catalog | implemented | ygoprodeck | ✓ (none) | · | · | · | none | · | · | · | · | none | page_number | api | USD/EUR | wave1 | easy | entry synthesized from connector meta.json |
Rejected / blocked sources and why
| Source | Status | Reason |
|---|---|---|
| 130point | rejected | Re-publishes eBay sold data under eBay's terms; bot-protected; use eBay official API instead. |
| AbeBooks | blocked | Amazon-owned; bot protection; no public API. |
| Ace Grading — population report & cert lookup | rejected | No URL-addressable population or cert pages (Livewire-only, Cloudflare challenge). Verified live 2026-09-08 with Firecrawl (5 s wait): filters rendered, zero rows/cert results. Revisit if Ace publishes an API or static pop pages. |
| Acker Merrall & Condit (Acker Wines) | blocked | Direct HTTP blocked by Cloudflare WAF (403 for every UA); prices-realised archive behind login (verified via Firecrawl 2026-09-08). Only pre-sale catalogues are public — no realised prices. |
| Adorama Used | blocked | Bot management returns 403 to every non-browser session; terms prohibit scraping. Existing MPB/B&H Used connectors already cover used-camera dealer listings. |
| Advance Guard | blocked | Every path (including robots.txt) returns a JavaScript "lander" redirect page to non-browser clients. |
| Alphaspel | rejected | Custom platform; no product JSON. |
| Ansorena | blocked | Public pages show start price and a VENDIDO badge but the hammer price ('Remates subasta — Regístrese o inicie sesión') is login-gated. |
| Artnet Price Database | rejected | Paid, subscription-only price database (per brief). |
| Artsy | rejected | API licensed for non-commercial use only (no prices anyway); website Cloudflare-challenged and price database login-gated. Saatchi Art connector already covers online art listings. |
| AuctionZip | rejected | Bot UA denied at the edge and, more importantly, the site is a calendar of upcoming sales without realised prices — no sale data to gain. |
| Barnebys | blocked | robots.txt disallows everything for User-agent: * and states crawling is prohibited without written permission; aggregator anyway (sources covered directly). |
| Barrett-Jackson | blocked | Anti-bot blocks results pages. |
| Bazaar of Magic | rejected | Custom storefront (locale redirect /en-WW, no products.json). Cardmarket covers EU MTG. |
| Bazar de Magic | rejected | Host unreachable at probe time. |
| Beckett Grading Services (BGS) — card lookup & pop report | blocked | BGS card lookup (/grading/card-lookup → /api/grading/*) and pop report (/grading/pop-report) both require a reCAPTCHA token; verified live 2026-09-08 (plain POST of the pop form and a Firecrawl render of the lookup URL both return the reCAPTCHA gate). Grader slug bgs stays taxonomy-only. |
| BidSpotter | rejected | robots disallow /archivelot (prices realised) and the inventory is industrial equipment, not collectibles. |
| Big in Japan | rejected | Custom (PrestaShop-like) storefront; no product JSON. |
| Big Orbit Cards | blocked | Returns 403 to the RareIndexBot UA on all paths (bot block). Not retried with browser UA. |
| Blowout Cards | rejected | Custom (Magento-style) platform: /products.json 403, /wp-json/wc/store/v1/products returns HTML. Not a Shopify/Woo storefront — out of scope for this fleet. |
| Board Game Bliss | rejected | Shopify (verified) but a general new-board-game retailer: collections are player-count/mechanic buckets and clearance sales, no collectible focus (no Kickstarter-exclusive / out-of-print segmentation). Not worth a connector. |
| BoardGamePrices (meeple.dk) | rejected | Aggregator of retailer asking prices (not a primary source) and robots.txt disallows /item/history and /item/search — the only pages with analytical value. Primary retailer (Miniature Market) implemented instead. |
| Brick Loot | rejected | Shopify (verified) but sells third-party brick kits, light kits and subscription boxes — not LEGO sets or minifigures, so no fit with lego_sets/lego_minifigures. |
| BrickLink | blocked | robots.txt disallows the catalog and price-guide paths; the API is seller-only. Respecting robots (SPEC §36). |
| Bukowskis | blocked | Realised prices are not shown publicly: archived lot pages (archived_lots*.xml.gz sitemaps, e.g. lot 1569873 ended 2024-07-17) show 'Auction ended' and a 'contact us for a valuation' box instead of the result; live lot lists only show 'Current bid'. Only login-gated result access → not crawled. |
| Burbank Sportscards | rejected | Host unreachable on 2026-09-08 (connection failed). Skipped. |
| Buyee (proxy shopping for Yahoo! Auctions / Mercari) | rejected | Adds no access: Yahoo! Auctions serves its public pages directly to the bot UA (yahoo-auctions-jp). Buyee returns 403 to non-browser clients (even /robots.txt) and only mirrors Yahoo/Mercari items with a proxy fee. |
| Cambi Casa d'Aste | blocked | Cloudflare 'Just a moment…' JS challenge (403) on / and /it/risultati.asp for the honest UA. |
| Card Ladder | blocked | Subscription product; login required. |
| Card Merchant UK | rejected | Host unreachable at probe time (not related to Card Merchant NZ). |
| Card Universe | rejected | Host unreachable at probe time. |
| Cardcorner | rejected | Host unreachable at probe time. |
| Cardmarket storefront (cardmarket.com) | blocked | Cloudflare challenge on every page (403 to bots); deliberately not crawled. Price/catalog needs are covered by the public bulk files (cardmarket-priceguide). |
| Cards & Collections | rejected | Host unreachable at probe time (DNS/timeout). |
| Carousell (SG / HK) | blocked | Search pages are robots-disallowed and the allowed api-service endpoint returns 403 (Cloudflare) to the bot UA. |
| Carta Magica | rejected | Not Shopify/WooCommerce: CrystalCommerce platform (nginx/Passenger; /products.json 404, no Store API). Out of scope for the storefront-adapter fleet; would need a CrystalCommerce HTML parser. |
| CBCS (Comic Book Certification Service) — grading notes lookup & population report | blocked | Cert (grading notes) search requires reCAPTCHA and the backing API requires a bearer token; verified live 2026-09-08 (Firecrawl render shows the reCAPTCHA gate; api.cbcscomics.com → 401). |
| ChannelFireball | rejected | Custom Express app (301 to marketplace); /products.json returns non-JSON. Not Shopify/Woo. |
| Chaos Cards | blocked | Cloudflare "Just a moment…" challenge on every request (robots.txt 200 but all content paths challenged). No circumvention (SPEC §36). |
| Chimera Hobby Shop | rejected | Host unreachable on 2026-09-08. |
| Classic Auctions | blocked | Akamai 'Access Denied' (Reference #18…edgesuite) on robots.txt and homepage for both UAs. Same hosting stack as Mile High and Iconic. Not fought. |
| CloutsnChara | blocked | Cloudflare returns 403 to the honest RareIndexBot UA on every path (/, /products.json, /robots.txt). Bot access refused at the edge — not circumvented. |
| CoinArchives | blocked | Paywalled archive (subscription) — only a limited free window; the same lots are reachable through NumisBids for most houses. |
| Collectiblend (camera price guide) | blocked | Cloudflare managed JS challenge on all paths incl. robots.txt; policy unverifiable, no public structured data. Not circumvented. |
| Colnect | rejected | Automated access prohibited without a CAPI licence (robots.txt + Anubis challenge). Revisit only with a licence. |
| ComicsPriceGuide.com | blocked | Issue pages fetched through Scrapfly render only the navigation/catalogue shell; values require login. Catalogue duplicates GCD (implemented). |
| Console Passion | rejected | Custom platform (redirect to bare host, no products.json / Store API). |
| Cool Kicks | rejected | /products.json returns 200 but not a Shopify products payload (HTML). Not a usable Shopify storefront. |
| CoolStuffInc | rejected | Custom platform (Apache): no Shopify/Woo endpoints (404). Out of scope for storefront adapters. |
| CovrPrice | blocked | Sales history and FMV are only shown to logged-in subscribers. |
| Cowley Abbott | blocked | Cloudflare JS challenge on every page. Not fought. |
| Craigslist | rejected | Terms forbid scraping; RSS feeds removed; low value for pricing (no sold data, unstructured titles). |
| Dave & Adam's Card World | blocked | Cloudflare 403 to the honest bot UA on / and every probed path; custom (non-Shopify) platform. Not circumvented. |
| David Feldman SA | blocked | Cloudflare hard block ('Attention Required!' 403) on every page for the bot UA; robots also disallows /wp-json/. Not retried with anti-bot tooling. |
| DKOldies | rejected | BigCommerce storefront behind Cloudflare (__cf_bm), /products.json 404. Not Shopify/Woo — candidate for a future BigCommerce adapter. |
| Dolly's | rejected | Custom platform (nginx) answering HTTP 500 on / and 404 on /products.json; no Shopify or Woo endpoints. Unverifiable — skipped. |
| Dragon's Lair | rejected | Shopify (verified) but only 5 collections and the shop declares USD despite a .ca domain (meta.json currency=USD, country=CA) — too small and ambiguous to map safely. |
| Drouot | blocked | Results require a paid subscription (Drouot Digital); bot protection. |
| Durán Arte y Subastas | blocked | Lot grid is an empty div filled by a CSRF-protected POST (infinite scroll) and realised prices require an account. |
| EB Games Canada | blocked | 403 to the honest bot UA. Not circumvented. |
| Est-Ouest Auctions | rejected | Result PDFs list lot number + price (incl. buyer's premium) only — no titles — so prices cannot be attributed to assets. |
| Facebook Marketplace | rejected | Requires a Facebook login; Meta terms prohibit automated collection. Not lawfully accessible. |
| Fantasiapelit | rejected | Custom platform; no structured product JSON. |
| Fellows Auctioneers | blocked | Same AWS ELB 202/empty-body bot challenge as Forum Auctions on every page. |
| Figuya | rejected | Custom storefront (no Shopify/Woo JSON); German anime-figure retailer. Candidate for a later JSON-LD connector. |
| Finesse (solefiness.com) | rejected | Shopify (AUD) boutique of current-season women's sneakers at retail; no resale/collectible signal. |
| Forbidden Planet | blocked | Cloudflare challenge page ("Cloudflare @ ForbiddenPlanet.com") for non-browser clients; custom Nuxt/Neto storefront. Not circumvented. |
| Forum Auctions | blocked | AWS ELB bot challenge: every page (incl. robots.txt and home) answers HTTP 202 with an empty body for the honest UA. |
| Fragrantica | blocked | Cloudflare challenge + terms forbid automated access; catalogue only (no market prices). |
| Freeman's | Hindman | blocked | freemansauction.com serves a Vercel Security Checkpoint (429) to every request. Not fought. |
| Games Haven | rejected | Host unreachable at probe time. |
| Games Republic | rejected | Host unreachable on 2026-09-08. |
| GameValueNow | blocked | Cloudflare challenge for plain HTTP and connection refused for Scrapfly (2026-09-08); robots.txt could not be read → not crawled. PriceCharting (implemented) covers loose/CIB/new retro game prices. |
| Gathering Games | rejected | Shopify (GBP) but the singles collections (magic-the-gathering-single-cards, 2 668 products) return an empty products.json (collection not published to the online-store channel); the remaining stock is board games, paints and sealed product already covered by Total Cards / The Card Vault. |
| GOAT | blocked | Anti-bot (DataDome/PerimeterX) blocks all automated access; no public API. |
| GoCollect | blocked | Sales data is a paid membership product; terms forbid scraping. |
| Grailed | blocked | DataDome blocks automated access. |
| GreatCollections | blocked | Archive search requires login; anti-bot on public pages. |
| Grey Flannel Auctions | blocked | Cloudflare WAF 403 block page for every request (bot and browser UA). Not fought. |
| Guf | rejected | Shopify (AUD) with 112k MTG / 30k Pokémon / 46k Yu-Gi-Oh! singles, but every product carries one variant per physical store (Ballarat/Bendigo/Geelong/Werribee) at the same price, which would quadruple listings without price information; sealed products use per-store SKUs with UUIDs. Deferred until the adapter can collapse location variants. |
| Gumtree | rejected | Anti-bot; classifieds without sold data; low pricing value. |
| Hagerty Valuation Tools | blocked | Valuation tool is a member product; terms forbid extraction. |
| Hanon Shop | rejected | Host unreachable at probe time. |
| Heritage Auctions | blocked | Prices-realised archive requires a free but mandatory account (login wall) and terms prohibit automated access; upcoming-lot pages are protected. Data licence/partnership is the lawful route. |
| Hermann Historica | blocked | robots.txt disallows /en/auctions/, /en/live/ and /en/lotsearch/ — exactly the catalogue/result paths — so the site is not crawled. |
| HHV | rejected | Custom storefront without product JSON; Discogs covers vinyl pricing. |
| Hills Cards | rejected | Visualsoft platform, no structured storefront JSON. |
| Hobby Genki | rejected | PrestaShop storefront; no product JSON. |
| Hobby Japan HK | rejected | Host unreachable at probe time. |
| hobbyDB / Pop Price Guide | blocked | Values behind login; catalog API undocumented and protected. |
| Huggins & Scott Auctions | rejected | No public prices-realized archive: /lots?lots_range=past is an empty SPA shell (0 lot summaries server-side, no sitemap); the platform API requires a client token. Same vendor as REA. |
| Iconic Auctions | blocked | Akamai 'Access Denied' for every request incl. robots.txt. Not fought. |
| Impact Comics | blocked | Cloudflare challenge on all paths. |
| Incollect | rejected | No public prices (price on request only) → no market data to ingest; dealer/designer names only. |
| Index PDX | blocked | Shopify shop locked (HTTP 423 Locked on /products.json). Not accessible. |
| Invaluable | blocked | Confirmed 2026-09-08 (one curl): robots.txt prohibits automated access; the sold-lot search is a JS app whose realised prices require an account. Do not retry. |
| Japan Figure Store | rejected | Host unreachable at probe time. |
| JJGames | rejected | Ecwid SPA with no public product endpoint (storefront API 404 without token, REST API 403); JJGames is PriceCharting's sister store and PriceCharting is already implemented → not worth a rendered-crawl connector. |
| JM Bullion | rejected | Terms prohibit scraping; sitemap index geo-blocked (403 'unavailable in your location'); every product page and leaf category answers 401 with a Webscale reCAPTCHA challenge. |
| jpc.de | rejected | Custom storefront (openresty), no product JSON; new-release retail only. |
| JUICESTORE | rejected | Shopify (HKD) but a streetwear multi-brand store (CLOT); root products.json is empty and collections are apparel — low collectible relevance. |
| Julien's Auctions | blocked | Cloudflare JS challenge on every page. Not fought. |
| KEH Camera | blocked | Bot protection blocks fetches. |
| Kelz0r | rejected | Custom platform (no robots.txt, no products.json / Store API). |
| KicksCrew | blocked | Bot protection blocks fetches. |
| Kijiji | rejected | Anti-bot; terms forbid automated access; asking prices only, no sold data. |
| Kikikickz | blocked | 403 for the bot UA on every path including /robots.txt. |
| KLEKT | blocked | Bot protection blocks fetches. |
| Koller Auktionen | blocked | Every URL (robots.txt, home, Auktionsergebnisse) returns a 2.4 KB JavaScript 'leastFactor' anti-bot challenge for both bot and browser UAs; solving challenges is out of policy. |
| Kotobukiya Shop | rejected | Host unreachable at probe time (manufacturer shop). |
| Lawsons | blocked | CloudFront 403 'Access Denied' for the honest UA on robots.txt and the home page. |
| Leboncoin | blocked | DataDome; terms forbid scraping. |
| Legend Rare Coin Auctions | rejected | legendauctions.com now serves an unrelated Danish casino-affiliate site ('Casino uden ROFUS'); /auctions and /auction-archive/ are 404 and legendrarecoinauctions.com does not resolve. The coin auction archive is no longer online. |
| Leica Store (official retail) | rejected | Official retail store of new-production cameras (MSRP), not a secondary market; MSRP catalogue would belong to a manufacturer-catalog group. Not probed. |
| Liv-ex | rejected | Paid, members-only data (per brief). Only headline index values are public. |
| LiveAuctioneers | blocked | Prices realized behind login; robots disallow pagination parameters and APIs. Re-verified quickly on 2026-09-08 (homepage 200, robots as described); not fought. |
| Lloyds Auctions | rejected | No public realised-price pages: closed auctions show no lots, lot pages only show a live 'current bid'; lot lists need __doPostBack JS. |
| Lot-tissimo (ATG) | blocked | Same ATG platform and WAF as the-saleroom; robots.txt disallows the archived-lot pages. Underlying German houses are approached directly (Lempertz, Ketterer, Grisebach). |
| Love of the Game Auctions | blocked | Cloudflare WAF 403 block page for every request. Not fought. |
| Lyn Knight Auctions | rejected | No public realised-price archive (login); public catalogues (~1 year, ids 1624+) show only 'Current Price/Current Bid' without a sale date or hammer/premium label → cannot be recorded honestly as sales. |
| Magic Madhouse | rejected | BigCommerce storefront (no public products.json / Store API equivalent without an API token); would need HTML parsing of paginated category pages. Deferred — Total Cards and The Card Vault already cover UK TCG retail. |
| Magic Stronghold | rejected | /products.json 404 — not Shopify/Woo (custom TCG platform). |
| Mallet Japan | rejected | Results are PDFs listing only lot number and 落札価格 (no titles, no images) since 2005 — prices cannot be tied to an asset without the catalogue. |
| Mandarake | blocked | Bot protection returns challenge pages to all engines. |
| Meccha Japan | rejected | PrestaShop storefront; no public product JSON. |
| Memory Lane Inc | blocked | Cloudflare 'Attention Required / Sorry, you have been blocked' on the homepage for the honest bot UA and for a browser UA — a WAF rule, not a JS challenge. Not fought (SPEC §36). |
| Mercari (US) | blocked | Cloudflare challenge + session-bound search API (401 without SPA-minted auth); no NEXT_DATA reachable. Not circumvented. |
| Mercari Japan (メルカリ) | blocked | Search HTML is a JS shell with zero item data (verified: 0 titles server-side); the JSON API needs DPoP-signed headers generated by the app (robots also disallows /v1/, /v2/). Sold prices are therefore not lawfully reachable without circumvention. |
| Mighty Ape | blocked | Bot-protection interstitial ("Please wait…") returned to all automated requests; custom platform. |
| Mighty Jaxx | rejected | Migrated from Shopify to a custom Next.js storefront (us.mightyjaxx.com); /products.json no longer served. Candidate for a later NEXT_DATA connector. |
| Mile High Card Company | blocked | Akamai 'Access Denied' for every request incl. robots.txt. Not fought. |
| MTGStocks | rejected | Private API blocks bots (403 CloudFront) and the data (TCGplayer/Cardmarket price relays) is redundant with mtgjson, tcgcsv and cardmarket-priceguide. |
| MutualArt | rejected | Paid membership data (per brief). |
| MyFigureCollection | blocked | Anti-bot challenge; API requires account approval. |
| myplasticheart | rejected | /products.json 404 — not Shopify/Woo. |
| Nate D. Sanders Auctions | blocked | The only public results page is disallowed by robots.txt (Disallow: /AuctionResults.aspx; Google agents whitelisted only). Respected; nothing else exposes prices. |
| Nin-Nin Game | rejected | PrestaShop storefront; no public product JSON. |
| OK Comics | rejected | Shopify (GBP) works, but the stock is new graphic novels at cover price (ISBN books) rather than collectible back issues; Travelling Man covers the same segment with figures and manga. Revisit if key-issue/graded stock appears. |
| Overstreet Price Guide | rejected | Paid, copyrighted guide with no public data. Key Collector Comics (mobile app, subscription) rejected for the same reason. |
| Parfumo | rejected | Catalogue only — no market prices; the only trading surface (souk) is disallowed by robots. Low value for a pricing platform. |
| Phonica Records | rejected | Custom platform; no product JSON. |
| Piccadilly Records | rejected | Custom platform without structured product JSON; vinyl retail prices add little beyond Discogs (already implemented). |
| Pink Gorilla Games | rejected | Shopify (verified) but the storefront JSON only exposes plush/merch/books (product_type Plushies 187/250, Books, Apparel, Pins); the retro-game inventory is not sold online. Nothing collectible to index. |
| Play-in / Magic Bazar | rejected | Custom platform (magicbazar.fr redirects here); locale-prefixed HTML only, no product JSON. Cardmarket bulk files (group g1) cover EU TCG pricing. |
| Plaza Japan | rejected | BigCommerce storefront (no public product JSON without API token). |
| Pokellector | blocked | Terms of Use explicitly prohibit automated retrieval of their data (prices, images) without written permission → not crawled (SPEC §36). Their prices are TCGplayer relays anyway (covered by tcgcsv/limitless-tcg). |
| POP MART | rejected | Custom Next.js storefront with regional redirects (/ca, /us…); no public product JSON; primary-market prices only. Labubu resale is captured through Kick Game / Crepslocker listings. |
| Popsike | rejected | Paid subscription; terms prohibit extraction. Discogs marketplace covers vinyl. |
| Pristine Auction | blocked | Cloudflare 'Just a moment' challenge on the homepage for both UAs; no public sold endpoint reachable without passing the challenge. Could be revisited with Scrapfly ASP on the public sold pages if terms allow. |
| Propstore | blocked | propstoreauction.com catalog pages: CloudFront 403 'Request blocked' (bot UA) / 202 challenge (browser UA). Not fought. |
| Provident Metals | rejected | Product pages answer 401 with the Webscale reCAPTCHA challenge; category pages show sub-category tiles only; terms forbid automated retrieval. |
| Proxibid | blocked | robots.txt Disallow: /en-us/* covers all catalogue and lot pages. Respected. |
| Rakuma (ラクマ, Rakuten flea market) | rejected | robots.txt forbids every search/browse path with parameters, leaving no compliant discovery route to listings. |
| Rebel | rejected | Custom platform (products.json redirects to home); mostly board games. |
| Reece's Rare Comics | blocked | www.reecescomics.com: Cloudflare 'Attention Required' hard block for curl (bot and browser UA) and Scrapfly reports DNS_NAME_NOT_RESOLVED for the host on 2026-09-08 — site unreachable for automated access. |
| Resident Music | blocked | Shopify-hosted but /products.json answers 403 (storefront JSON disabled). |
| Restocks | blocked | TLS handshake rejected for the bot client (LibreSSL alert internal error on restocks.net and www) and Firecrawl scrape timed out — site unreachable to non-browser clients. |
| Retro Game Trader | rejected | Host unreachable on 2026-09-08. |
| Retro Games Ltd | rejected | Custom CGI shop ("Search Found No Entries" for /wp-json); robots disallows most .cgi endpoints. No structured data. |
| Robert A. Siegel Auction Galleries | blocked | Power Search results require login. |
| Robert Edward Auctions (REA) | rejected | robertedwardauctions.com redirects to collectrea.com; the public /lots?lots_range=past page (plain HTTP and a Firecrawl render) shows no lots and no prices — the archive is behind the bidding app (401 JSON API needing a client token). No sitemap. Nothing public to read; do not retry until REA publishes a results archive. |
| Rough Trade | blocked | 403 to the honest bot UA on /products.json. Not circumvented. |
| Rough Trade | blocked | 403 to the bot UA on catalogue paths; custom (non-Shopify) platform. |
| Round Two | rejected | Custom platform (DPS server, 301 redirects); /products.json 404. Not Shopify/Woo. |
| SGC (Sportscard Guaranty) — cert lookup & pop report | blocked | Cert lookup behind reCAPTCHA; pop report only through an origin-restricted XHR API; legacy ASP.NET report offline. Verified live 2026-09-08. Grader slug sgc stays taxonomy-only. |
| Shopee Taiwan (蝦皮購物) | blocked | Anti-bot: JSON search endpoint returns 403 to non-browser clients; the site is a JS shell. Not retried. |
| Simply Toys | rejected | PrestaShop storefront; no product JSON. |
| Sixbid | blocked | SPA + JSON APIs reject non-browser UAs (HTTP 204); realised-price archive is a paid subscription product. Most Sixbid houses also publish on NumisBids, which is covered. |
| Sneakers123 | rejected | Retail price comparison of shop inventories (affiliate), not collectible resale/market data. |
| SNKRDUNK (スニーカーダンク) | blocked | Product pages are server-rendered without any price (verified on /en/sneakers/019332 and /en/trading-cards/843266); prices come from /en/v1/* which robots.txt disallows. Sitemaps (5 sneaker + 9 card shards) exist but yield only URLs/titles. |
| Sole Retriever | blocked | Release-date / raffle aggregator (no market prices) and the allowed /collections/* path returns 403 (Cloudflare) to the bot UA. |
| Solebox | rejected | Custom (non-Shopify) storefront; no product JSON found. |
| Spirits Auctioneer | rejected | Domain serves a 114-byte empty page (parked/no content) on 2026-09-08 — no auction data. |
| Stack's Bowers Galleries | blocked | Archive behind login/anti-bot. |
| Stadium Goods | blocked | Bot protection (Akamai) blocks fetches. |
| Star City Games | rejected | BigCommerce storefront behind Cloudflare (__cf_bm cookie): no Shopify/Woo JSON. Would need a BigCommerce/GraphQL adapter — not built here. |
| Steel City Collectibles | blocked | Cloudflare 403 to the honest bot UA on all paths; custom platform. Not circumvented. |
| StockX | blocked | PerimeterX returns 404/403 to every non-browser and to rendered fetches; public API is partner-only. No circumvention attempted (SPEC §36). Partner data feed is the lawful route. |
| Tajan | blocked | WAF returns 403 'Access Denied — request blocked by our security policies' for the honest bot UA on every URL including robots.txt. |
| TCDB – Trading Card Database | blocked | Cloudflare managed challenge on all paths including robots.txt (HTTP 403); no lawful automated access path — not crawled. |
| Tenacious Toys | blocked | 403 to the honest bot UA on /products.json. Not circumvented. |
| Tennants Auctioneers | blocked | All results URLs redirect to auctions.tennants.co.uk, which returns a 403 Cloudflare 'Just a moment…' challenge. |
| TFSource | blocked | robots.txt: User-agent: * Disallow: / (verified through Scrapfly on 2026-09-08 — the site also serves a Cloudflare challenge). |
| The Comic Hunter | rejected | Host unreachable (connection failed on all probes on 2026-09-08). Skipped. |
| The Drift Record Shop | rejected | Shopify (GBP) but the online catalogue holds only ~17 products (merch and a handful of Drift releases) — no pricing signal. |
| The Minifigure Store | blocked | Cloudflare challenge on all paths. |
| The Sole Supplier (Sole Market) | rejected | Affiliate aggregator of retailers' retail prices (not resale market data) — duplicates retailer feeds without adding transactions or asks. |
| the-saleroom (ATG) | blocked | AWS WAF JavaScript challenge on every page (challenge.js), robots.txt disallows the archived-lot (prices realised) pages, and the price-results URL redirects to an error page. Aggregator platform — the underlying houses are covered directly instead (Sworders, Chiswick, Dominic Winter…). |
| Tokyo Hunter | rejected | Domain parked/for sale (redirects to Dynadot). |
| Tokyo Otaku Mode | rejected | Custom platform (CSRF-protected app); no public product JSON. AmiAmi/HobbySearch/Ninoma/Solaris cover figures. |
| Toyzone | rejected | Host unreachable at probe time. |
| Trader Online | blocked | Cloudflare challenge on every request. |
| Troll and Toad | blocked | Shopify shop (sets _shopify_essential) but the storefront JSON is disabled: /products.json answers 401 and / redirects. The merchant has opted out of the public JSON — respected, not worked around. |
| UltraJeux | rejected | Site answers 410 Gone on catalogue paths (shop closed/moved). |
| Unicorn Auctions | blocked | Terms of Use expressly forbid automated access/copying, and the only data path is the robots-disallowed /api/. Not crawled. |
| University Archives | blocked | Serves 'Access Denied' to the honest bot UA (same WAF page as bid.waddingtons.ca). Switching to a browser UA to evade a deliberate bot denial is not done. |
| Urban Necessities | blocked | Shopify but /products.json answers 401 — storefront JSON disabled by the merchant. Respected. |
| Venduehuis der Notarissen | rejected | Hash-routed Artisio SPA with no server-rendered lots; the Artisio web API needs an undocumented client id/shape → would require browser rendering for low volume. Not worth it now. |
| Vestiaire Collective | blocked | Anti-bot challenge on every page. |
| Video Games New York | rejected | /products.json 404 — not Shopify/Woo. |
| Vinted | blocked | DataDome on all pages; API is app-only. |
| Vinyl Me, Please | rejected | Site is a Cargo (cargo.site) page, not a storefront; no products.json. Nothing to crawl. |
| Waddington's | blocked | bid.waddingtons.ca (catalogue/results platform) serves 'Access Denied' to the bot UA — a UA-based WAF rule we do not evade; wine.waddingtons.ca robots disallow all current galleries; www.waddingtons.ca only has narrative results posts (top lots). No complete public prices-realized archive reachable within policy. |
| WATA Games (now PSA Video Games) — cert verification | rejected | watagames.com redirects to psavideogames.com whose verify page is a 404; no public WATA population report found (taxonomy populationUrl https://www.watagames.com/population is dead). Video-game certs verify through psa-cert where PSA-graded. Verified live 2026-09-08. |
| WatchCharts | blocked | 403 for every path with the honest UA (robots.txt, home, terms — re-verified 2026-09-08, also via Firecrawl → 404/403). Circumventing would require a browser fingerprint against an explicit block; market-index values are the company's paid product. |
| WatchUSeek forums (sales corner) | rejected | Forum classifieds: unstructured member posts with personal data, no reliable price/sale fields — out of scope per brief. |
| Webb's | blocked | Catalogue host auctions.webbs.co.nz returns CloudFront 403 'Request blocked'; the www site has no prices. |
| Wethenew | blocked | Shopify storefront JSON (/products.json) returns 403 to the honest UA (bot protection); HTML home is 200 but products.json is the only structured route. |
| Whatnot | blocked | Cloudflare managed challenge on every path (including robots.txt) for plain clients; no public API; sold data only inside the authenticated app. Not crawled (SPEC §36). |
| Whisky Auctioneer | blocked | Cloudflare challenge on all pages. |
| Whiskybase | blocked | Cloudflare challenge; terms forbid scraping. |
| Wind Vintage | rejected | Inventory is 3 blog-style posts without structured prices (mostly sells by appointment); the 5 685-URL sitemap is editorial content. Not worth a connector. |
| Wind Vintage | rejected | Squarespace storefront (no Shopify/Woo JSON). Squarespace exposes ?format=json on collection pages — candidate for a small dedicated connector later; low volume (curated vintage watches). |
| Wine-Searcher | rejected | Paid API / licensed data; site terms forbid scraping and robots disallows the price facets we would need. Merchant asking prices only — no sales. |
| Xupes | rejected | Magento 2 storefront (no public JSON catalogue). Pre-owned watches already covered by Watchfinder/Subdial/Chrono24; candidate for a later JSON-LD (adapters.productsFromHtml) connector. |
| Zachys Wine Auctions | blocked | bid.zachys.com answers HTTP 403 (CloudFront 'Request blocked') to plain requests for auction lists and catalogues; not circumvented. Retail Shopify storefront (www.zachys.com/products.json) noted for the Shopify connector group. |
Legal / compliance notes
| Source | Notes |
|---|---|
| 1stDibs | User Agreement (checked 2026-09-08) contains no clause on automated access to public pages. F5/Shape client-detection script present but no challenge served. |
| 401 Games | Public storefront data of a retailer; asking prices only (listings, never sales). Merchant terms: https://store.401games.ca/policies/terms-of-service. Attribution (sourceUrl) kept on every record. |
| Ace Grading — population report & cert lookup | Public data, but only reachable through stateful Livewire requests (CSRF token + session) — replaying those would mean emulating the app rather than reading a page. |
| Acker Merrall & Condit (Acker Wines) | Auction results archive is a members-only area (login wall) — never bypassed. Upcoming-auction catalogues (PDF/XLSX on rackcdn) are public but carry estimates, not results. |
| Ader | CGV: no anti-automation clause; pages state 'Résultats avec frais' (read per page). |
| Adorama Used | Adorama Terms of Use prohibit automated data collection. |
| Aguttes | CGU contain no anti-automation clause; Content-Signal forbids AI training (we use reference data only). |
| Alt | Alt's public item pages (robots.txt allows everything; discovery through the public sitemaps with lastmod) show the card, grade, PSA/BGS population, Alt's list price, the 'Alt Value' model estimate with its range, and a 'Recent transactions' list of observed sales (mostly eBay auctions/best offers) with date and price. Pages are client-rendered → Firecrawl, 1 credit per item, capped by `maxItemsPe |
| AmiAmi | Reads the public JSON API that AmiAmi's own storefront calls (api.amiami.com/api/v1.0/items with the storefront's X-User-Key header, no account or login). Plain requests from data-centre IPs get a Cloudflare 'Attention Required' page, so the request is routed through Scrapfly (asp, no JS, country jp; 1 credit per 50-item page). Data: item code, JAN, maker, release date, list price (tax-in), curren |
| Analog:Shift | Public Shopify storefront feed (analogshift.com/products.json, 250 products/page) over plain HTTPS with the RareIndex user agent; robots.txt allows / for generic agents. Each product is one vintage/pre-owned watch: vendor = brand, description carries Reference / Year / Case Size / Condition lines which are parsed into attributes; sold watches stay published with available=false and are recorded as |
| Ansorena | Realised prices ('Remates') shown only to registered users. |
| Antiquorum | Public auction catalogue (catalog.antiquorum.swiss/en → /en/auctions//lots?page=N) fetched over plain HTTPS with the RareIndex user agent; robots.txt only disallows /wp-admin/. Each lot carries schema.org RDFa (name, sku, brand, price, currency, image) and a spec table (Brand, Model, Reference, Year, Material). Sold lots show 'Sold: ' which Antiquorum's own price lists confirm |
| APMEX | Public category grids (apmex.com/category//) of one of the largest US coin dealers; robots.txt disallows /catalog/, /cart/, /account/, /spotprice/ etc., none of which are used. Plain HTTPS gets an Akamai 403 for non-browser clients, so pages are fetched with Firecrawl (1 credit per ~80-product page). Parsed per product card: APMEX product id, title, 'As Low As' price (USD, cash/wire tier |
| Artcurial | Paris/Monaco auction house (Nuxt app). The public results index (/en/results-auctions-sales) and each sale page (/en/sales/) are rendered through Firecrawl (JS wait ~5 s, 1 credit each); the sale page lists every lot with lot number, title, sub-title, estimate and 'Sold €X' plus the public lot URL. robots.txt disallows press, tracking and /motorcars paths only (car sales are listed under /en/sa |
| Artnet Price Database | Paid licence; terms prohibit scraping. |
| Artsy | Artsy Public API terms: non-commercial/educational use only, public-domain artworks only; price database requires an account. RareIndex is commercial → cannot use the API; site scraping blocked and against ToS. |
| Aste Bolaffi | Termini e condizioni: no anti-automation clause. 'Aggiudicato a' not labelled hammer vs fees → null. |
| aucfree — オークフリー | aucfree.com publishes closed Yahoo! Auctions Japan lots (end price, bid count, end date) free of charge; no robots.txt is served (404) so no path is disallowed. Plain HTTPS returns 403 to non-browser clients, so pages are fetched through Firecrawl (1 credit per search page of 50 lots ≈ 0.02 credit/sale) with Scrapfly as fallback. Search pages per keyword seed (/search?o=t2&q=<kw>&p=N, sorted by |
| Auctionet | terms_of_use contain no clause on automated access; results are winning bids (hammer) with buyer's fee added per house. |
| AuctionZip | UA-based CloudFront denial of the honest bot; not evaded. AuctionZip is an auction calendar/listing directory (owned by LiveAuctioneers) without a prices-realized archive of its own. |
| B&H Photo Video | Used-department category pages (bhphotovideo.com/c/buy/Used-…/ci/) rendered by Firecrawl (1 credit per page; plain HTTPS returns an Akamai browser check). robots.txt allows these /c/buy/ paths but disallows ?pn= pagination and search, so only the first page (~24–30 items) of each seeded category is read; coverage grows by adding category seeds. Each row gives name, B&H #, MFR #, the B&H used g |
| Banknote World | Cloudflare challenge on every page (incl. sitemap) for plain HTTPS; Firecrawl's normal render passes it. Terms not reviewed yet. |
| Barnebys | robots.txt notice: crawling prohibited without written permission. |
| Beckett Grading Services (BGS) — card lookup & pop report | reCAPTCHA gate on both tools = access control; SPEC §36 forbids CAPTCHA solving. Not implemented. |
| Bernaerts Auctioneers | Algemene voorwaarden: no anti-automation clause; sold_price = hammer (30 % premium stated separately). |
| BidSpotter | Archived lot pages (the only place with realised prices) are disallowed by robots.txt; the platform is industrial/commercial surplus, marginal for collectibles. |
| Big B Comics | Public storefront data of a retailer; asking prices only (listings, never sales). Merchant terms: https://www.bigbcomics.com/policies/terms-of-service. Attribution (sourceUrl) kept on every record. |
| BigBadToyStore | Search pages (/Search?SearchText=…&PageSize=50) rendered through Firecrawl at 1 credit per page of 50 products; plain HTTP receives the store's bot challenge page, which is not bypassed — Firecrawl renders the public page like a browser and robots.txt is not served to non-browser agents (403), so runs stay tiny (4 queries/run, 2 s politeness). Each card gives title, 'By: brand', stock status (PRE- |
| BoardGamePrices (meeple.dk) | Second-hand aggregation of retailer asks; robots disallows the history and search paths. |
| Bob's Watches | Public model-family pages (bobswatches.com/rolex-) fetched over plain HTTPS with the RareIndex user agent; robots.txt allows them (sort/query/search URLs are disallowed and never used). Each page embeds schema.org Product JSON-LD per watch (name, mpn = reference, sku = stock id, colour/material, USD price, availability). Listings only; Bob's does not publish realised prices. 1.5 s between p |
| Bonhams | Plain HTTPS (no rendering, no credits). Public results listing https://www.bonhams.com/auctions/results/?page=N and upcoming listing /auctions/upcoming/ are server-rendered Next.js pages whose NEXT_DATA carries 24 auctions per page (11k+ past auctions); each auction page /auction///?page=N carries 48 lots per page with estimates, hammer price, price including buyer's premium (hammerP |
| BrickEconomy | Public set pages fetched through Firecrawl (markdown; ~1 credit/page). robots.txt allows all crawlers (explicitly including AI bots). Plain HTTPS returns 403 for non-browser agents, so Firecrawl is the primary engine and Scrapfly the fallback. We capture set facts (number, name, theme, subtheme, year, release/retire dates, pieces, minifigs), retail price, and BrickEconomy's estimated New/Sealed an |
| Brickset | Public set pages (brickset.com/sets/-1/...) and theme listings (/sets/theme-/page-N, 25 sets per page) fetched over plain HTTPS with the RareIndex user agent; robots.txt disallows /admin, /export, /ajax, /profile, /webservices, /buy, /news, /reviews… — none of which are used (the Brickset API/webservices need a personal key: https://brickset.com/tools/webservices/requestkey). Fields |
| Bring a Trailer | Completed auctions read from the same public JSON the /auctions/results/ page uses (POST /wp-json/bringatrailer/1.0/data/listings-filter, 36 items/page, ~262k results, newest first) over plain HTTPS with the RareIndex user agent; no login, no bidder data. robots.txt allows the results pages (search and member areas are disallowed and not used). 'Sold for on ' entries become sa |
| Bunjang (번개장터) | Terms page is a JS shell (not readable to the bot); public listing data only, no seller identifiers stored. |
| Canadian Coin & Currency | Public storefront data of a retailer; asking prices only (listings, never sales). Merchant terms: https://www.cdncoin.com/policies/terms-of-service. Attribution (sourceUrl) kept on every record. |
| Capsule Toronto | Public storefront data of a retailer; asking prices only (listings, never sales). Merchant terms: https://www.capsuletoronto.com/policies/terms-of-service. Attribution (sourceUrl) kept on every record. |
| Card Kingdom | Card Kingdom publishes its full singles price list (https://api.cardkingdom.com/api/pricelist, ~46 MB JSON, refreshed daily) and sealed price list (/api/sealed_pricelist) publicly; each singles row carries the Scryfall id, edition, foil flag, retail price, retail stock, buylist price and buylist demand. Fetched once per run with an identifying User-Agent (two requests). Retail = dealer asking pric |
| Card Merchant NZ | Public storefront data; attribution via sourceUrl; asking prices only. No login, no personal data. |
| Cardboard Memories | Public storefront data of a retailer; asking prices only (listings, never sales). Merchant terms: https://www.cardboardmemories.ca/policies/terms-of-service. Attribution (sourceUrl) kept on every record. |
| Cardmarket price guide & product catalog (bulk files) | Files are published by Cardmarket for public download without authentication; guide values are aggregate statistics (not personal data). Attribution kept via sourceUrl. Storefront ToS not implicated because no site page is fetched. |
| Cardmarket storefront (cardmarket.com) | Cloudflare-protected storefront; per SPEC §36 we do not attempt to defeat it. Individual seller offers are personal data of private sellers. |
| Cardrush (カードラッシュ) stores | Retailer asking prices, no personal data. Pokémon store is public but Cloudflare-fronted: fetched via Scrapfly ASP within its robots allowance (search=yes), capped to 1 page/category/run for cost. |
| CardTrader | Official API under CardTrader's API terms; read-only endpoints. Private ('normal') sellers' usernames are personal data → not stored. |
| Cars & Bids | Public 'Past Results' list (/past-auctions/?page=N, ~50 auctions per page, newest first) rendered through Firecrawl (plain HTTPS returns a Cloudflare interstitial; we do not bypass it — Firecrawl fetches the public page like a browser). robots.txt allows the page (only /sell-car/, /widgets/, /dealers/ are disallowed). 'Sold for $X' + 'Ended m/d/yy' rows become sales; 'Bid to' rows (reserve not met |
| Catawiki | Scrapfly (asp, NL exit) because catawiki.com returns 403 to non-browser clients. Two-phase crawl: (1) discovery — a rendered category page (render_js, ~6 credits) lists the live themed auctions of the category; each auction page /en/a/-slug is server-rendered (NEXT_DATA, 1 credit, no JS) with its full lot list and closeAt; live lots are emitted as auction_lot records and remembered in the |
| CBCS (Comic Book Certification Service) — grading notes lookup & population report | reCAPTCHA + authenticated API = access controls; not circumvented. |
| CGC Cards | Free public lookup, no account. Population report pages not crawled. Legacy 9.5 grades are displayed as Gem Mint 10 by CGC; the connector stores what the page shows. |
| CGC Comics (Certified Guaranty Company) | CGC advertises the certification lookup as free and account-less; only per-cert pages are read. The CGC Census (population report) requires a login and is never fetched (blocked in earlier sessions). |
| Chairish | Terms of Service live in a JS-only help centre (not machine-readable); public browse pages only, seller business location kept, no personal data. |
| Chatterley Luxuries | Only a privacy policy is published (no automated-access clause). |
| Cherry Collectables | Public storefront data; attribution via sourceUrl; asking prices only. No login, no personal data. |
| Cherrystone Philatelic Auctioneers | Firecrawl (rawHtml), 1 credit per page; plain HTTPS returns 403 (not bypassed; robots.txt is empty → nothing disallowed). Sources: the auction site home page, which links 'Prices Realized from - ' → catalog.aspx?auctionid=N; the catalog page lists category pages (/Category/-.html?auctionid=N) whose lot cards show lot number, title (with LOT.aspx link), image, 'Final Pric |
| Christie's | Plain HTTPS JSON (no rendering, no credits) from the two endpoints the public christies.com pages themselves call: /api/discoverywebsite/auctioncalendar/auctionresults?language=en&month=M&year=Y (closed sales of a month with SaleID/SaleNumber, category/location filters and sale totals) and /api/discoverywebsite/auctionpages/lotsearch?language=en&SaleNumber=…&SaleId=…&page=N&pageSize=…&sortby=lotnu |
| CHRONEXT | Dealer asking prices, public pages, honest UA. |
| Chrono24 | Public model listing pages (e.g. /rolex/daytona--mod2.htm) fetched through Scrapfly without JS rendering (Cloudflare shield → ~40 credits/page); robots.txt allows these paths (Crawl-delay 0.1). Each page embeds a schema.org ItemList of Offers (name, price in the site currency, image, listing URL) — we store asking prices as listings only, never as sales. No login, no per-listing detail fetch (sell |
| Classic Auctions | Akamai edge denies all non-browser-fingerprint traffic; not circumvented. |
| Clean Sweep Auctions | Public past-auction archive. 'Winning bid' is the hammer price; a 22 % buyer's premium is added (auction rule 4) → buyerPremiumIncluded=false. Only the auction month is published → saleDate is the first of the month with sale_date_precision='month' in metadata. |
| CoinArchives | Archive is a paid subscription (CoinArchives Pro); the free site shows only recent sales in a limited search. Not circumvented. |
| Collectiblend (camera price guide) | robots.txt cannot be read, so path permissions cannot be verified → not crawled. |
| Collecting Cars | Public results list (/sold?page=N, 48 lots per page, ~26k sold lots, newest first) rendered through Firecrawl (plain HTTPS gets a Cloudflare interstitial; not bypassed). robots.txt: Allow / for generic agents (named AI-training crawlers are disallowed; RareIndexBot is not one — we only record public sale facts and link back). Most sold prices are shown only to signed-in users ('Sign in to view sol |
| Colnect | robots.txt explicitly prohibits automated use without a CAPI licence. |
| Colonial Acres Coins | Public storefront data of a retailer; asking prices only (listings, never sales). Merchant terms: https://www.colonialacres.com/policies/terms-of-service. Attribution (sourceUrl) kept on every record. |
| COMC | COMC's category browse pages (/Cards///) are public and allowed by robots.txt (only /Search/, /ItemDetails/, /Item/ and account paths are disallowed — item detail pages are therefore never fetched, only linked). Plain HTTP returns 403 to non-browser agents; pages are rendered through Firecrawl (1 credit per 100-listing page). Each listing row gives set/year/number, player, the gr |
| ComicConnect | Public sold archive (/browse/comics/?filtertype=Sold, ~479k results, 20 per page) fetched over plain HTTPS with the RareIndex user agent. robots.txt: Allow / with Content-Signal search=yes, ai-train=no (we only index sale facts and link back). Each card exposes title, publisher + grade, sold date/time, 'Sold For' price and whether a 15% buyer's premium applies (bp attribute) — we store hammer pric |
| ComicLink | Public results pages only; item pages hide prices behind login (never fetched). Sale dates carry month precision (session label). |
| ComicsPriceGuide.com | Guide values are the site's product and are member-gated; public pages show navigation and catalogue only. |
| Corinphila Auctions | Conditions of sale https://corinphila.ch/en/versteigerungsbedingungen/. Static archive pages, no login. |
| CovrPrice | Paywalled subscription data — login wall, never circumvented (SPEC §36). |
| Cowley Abbott | Cloudflare managed challenge; not solved. |
| Crepslocker | Public storefront data; attribution via sourceUrl; asking prices only. No login, no personal data. |
| Daniel F. Kelleher Auctions | Plain HTTPS, 0 credits. Kelleher publishes its catalogues and prices realized on Stamp Auction Network (stampauctionnetwork.com; robots.txt has no disallow rules). Sources: the firm page (/Kelleher.cfm, 'Prices Realized' section) → cCatalog.cfm?SrchFirm=V&SrchSale= → major groups (cCatalog2.cfm) → category pages (cCatalog3.cfm) whose lot tables show Sale/Lot/Cat numbers, description, image, |
| David Feldman SA | Cloudflare 'Attention Required' (403, hard block) for non-browser access; not circumvented. |
| David Lawrence Rare Coins | Terms https://www.davidlawrence.com/terms-and-conditions. Public consumer API, no account endpoints called. 'DLRC has no buyer's fee' (site notice) → sale price = total paid. |
| DigimonCard.io | Free public JSON API (https://digimoncard.io/api-public/search?series=Digimon Card Game returns every card in one call; the documented '.php' paths 301 to the extensionless ones). Catalog only — no prices; TCGplayer product ids are included and used as the deterministic identifier (tcgplayer_id) so TCGCSV prices attach to the same assets. Images from images.digimoncard.io/images/cards/.jpg |
| Discogs | Official public Discogs API (api.discogs.com) used unauthenticated with the RareIndex user agent: database/search (type=master), masters/{id}/versions (pressings with label, catno, country, year, format and community have/want counts) and marketplace/stats/{release_id} (lowest asking price + number for sale). Unauthenticated limit is 25 requests/minute → 2.6 s throttle; price_suggestions requires |
| Doyle | Public past-auction list and results search pages only. 'Sold for' prices include the buyer's premium (stated on lot pages: 'Includes Buyer's Premium'). No login. |
| Dunbar Sloane | 'Realised: $140 + premium' = hammer. |
| Durán Arte y Subastas | Hammer prices ('remates') require login. |
| e-Rocks | e-rocks.com returns 403 to plain HTTPS clients; Firecrawl renders the public auction index and auction pages (1 credit each). robots.txt sets Crawl-delay: 10 (honoured: 10 s between requests) and disallows /search/ and /itemssearch, which are not used. Each weekly dealer auction page lists its lots with locality, size class, current bid in EUR, bid count and seller; the header gives start/end time |
| eBay (Browse API) | eBay API License Agreement: attribution, listing data caching limits, no scraping of ebay.com HTML. Connector uses the official API exclusively. |
| Entertainment Earth | Public listing pages only; Cloudflare managed challenge for non-browser clients passed by Scrapfly (public pages). |
| eStarland | Public listing pages; Cloudflare managed challenge for non-browser clients (Scrapfly passes at 1 credit). |
| Etsy (Open API v3) | Etsy API Terms of Use (etsy.com/legal/api): attribution, data use limited to the app's purpose; commercial apps reviewed by Etsy. |
| European Watch Company | Dealer asking prices, public pages. |
| European Watch Company | crownandcaliber.com now redirects to europeanwatch.com (Boston dealer). Public brand pages (/brand/?page=N) embed a schema.org ItemList of Products (name, sku, USD price, availability, condition) — fetched over plain HTTPS with the RareIndex user agent; robots.txt only disallows /login. References and circa years are parsed from the product name; box/papers/condition details live on product |
| Everything Games | Public storefront data of a retailer; asking prices only (listings, never sales). Merchant terms: https://www.everythinggames.ca/policies/terms-of-service. Attribution (sourceUrl) kept on every record. |
| Face to Face Games | Public storefront data of a retailer; asking prices only (listings, never sales). Merchant terms: https://www.facetofacegames.com/policies/terms-of-service. Attribution (sourceUrl) kept on every record. |
| Fanatics Collect | Public sales-history pages listed in the site's own sitemaps. Sold price includes the 20 % buyer's premium (soldFor 276 vs winning bid 230 → buyerPremiumIncluded=true, hammer kept in metadata). Terms of Use are on a client-rendered Zendesk page whose text could not be read over plain HTTP — noted, not verified. No login, no bidding, no personal data (bidder identities are not exposed). |
| FASHIONPHILE | Public Shopify storefront feed (www.fashionphile.com/collections//products.json) fetched over plain HTTPS with the RareIndex user agent; robots.txt allows /collections/ (only sort/filter permutations, cart, account and checkout paths are disallowed). Each product is one authenticated pre-owned item priced in USD; available:false on a still-published product means the item shows SOLD on th |
| Flagship Games | Public storefront data; attribution via sourceUrl; asking prices only. No login, no personal data. |
| Flight Club | Plain HTTPS requests receive 403 (robots.txt itself is not served to non-browser agents); Firecrawl's standard fetch returns the public category pages (flightclub.com/air-jordans?page=N …) whose NEXT_DATA holds the search grid: product id, name, brand, image, lowest price, retail price and a slug ending with the style code. 1 Firecrawl credit per page of 30 products; 2 s between pages. Listing |
| FOOTDISTRICT | Public storefront data; attribution via sourceUrl; asking prices only. No login, no personal data. |
| FossilEra | Public category pages (fossilera.com/fossils-for-sale/?page=N) and specimen pages fetched over plain HTTPS with the RareIndex user agent (robots.txt only disallows gift-card/checkout helpers). Each card gives the specimen title, price (and previous price when reduced), image and the FossilEra item number; specimen pages add species, geological age, location, formation, size and category. |
| Fragrantica | Terms of use prohibit scraping/data mining. |
| Freeman's | Hindman | Vercel bot-protection checkpoint; not circumvented. |
| Fritz Rudolf Künker | Terms https://www.kuenker.de/general-terms-conditions/ and /auction-terms-and-conditions. Lot listings (/widgets/) are robots-disallowed → discovery through product sitemaps only. |
| Funko (official shop) | Only sitemap-listed product pages would be read (listing pagination params are robots-disallowed). |
| Fusion Gaming | Public storefront data of a retailer; asking prices only (listings, never sales). Merchant terms: https://www.fusiongamingonline.com/policies/terms-of-service. Attribution (sourceUrl) kept on every record. |
| Gameology | Public storefront data; attribution via sourceUrl; asking prices only. No login, no personal data. |
| Games Portal | Public storefront data; attribution via sourceUrl; asking prices only. No login, no personal data. |
| GameZilla | Public storefront data of a retailer; asking prices only (listings, never sales). Merchant terms: https://www.gamezilla.ca/policies/terms-of-service. Attribution (sourceUrl) kept on every record. |
| Goblin Games NZ | Public storefront data; attribution via sourceUrl; asking prices only. No login, no personal data. |
| Goldin | Public 'Sold Items' result grids (https://goldin.co/buy/sc/?show_only=Sold%20Items&sort=Most_Recent_Bids&number_of_lots=240) rendered through Scrapfly (asp + JS rendering, ~6 credits per page of 240 sold lots). goldin.co/robots.txt allows /buy/ and /item/ and disallows /api/; we never call goldin.co/api ourselves — the lot data is read from the XHR (lots_v2 on their CloudFront search |
| Good Games | Public storefront data; attribution via sourceUrl; asking prices only. No login, no personal data. |
| Gooding & Company | Gooding & Company's public 'Prices Realized' pages are a Gatsby site; each realized auction page ships its full lot list as static JSON at /page-data/auction/realized//page-data.json (one plain HTTPS request per auction, 0 credits; robots.txt has no disallow rules). Each lot carries salePrice (auction currency), lotNumber, title, model year, make, model and Cloudinary image ids (cloud 'goodi |
| Grand Archive TCG Index | Official Grand Archive card index API (https://api.gatcg.com/cards/search, paginated, no key). Emits one catalog_item per edition × circulation (non-foil / foil) with the publisher's declared print run in productionQuantity when the operator is exact ('=') and in metadata when approximate ('≈') — a rare case of manufacturer-published production counts. No prices (TCGCSV supplies Grand Archive pr |
| Grand Comics Database | Data is CC-BY-SA (attribution kept in metadata + link to the issue page). SQL dumps require a GCD account → not used. |
| Grey Flannel Auctions | Cloudflare WAF block; not circumvented. |
| Grisebach | Versteigerungsbedingungen: no anti-automation clause; results 'inkl. Aufgeld'. |
| Hake's Auctions | Plain HTTPS on the public Bidsquare-hosted site (robots.txt disallows /search, account pages and filtered/sorted query URLs; we only load /auctions and unfiltered catalog pages with ?page=N, 2 s politeness). Hake's hides its past-auction list, so upcoming catalogs are crawled for auction lots (estimate, current bid, countdown end) and their URLs are remembered in the connector cursor; after an eve |
| Hareruya (晴れる屋) | Retailer asking prices, no personal data. HTML search result pages with page/sort/order (robots-disallowed) are never requested. |
| Hart Davis Hart Wine Co. | Hart Davis Hart (Chicago; ~8 fine-wine auctions a year, 100% sold rates) publishes every auction's full prices-realized as a PDF linked from /auction-archives/ ('View auction results'). Plain HTTP is 403 for non-browser clients, so the archive page (1 credit) and each PDF (Firecrawl PDF parser, 1 credit per page, ≈130–140 pages for a 2,500-lot sale) are fetched with Firecrawl; config.pdfsPerRun ca |
| Heffel Fine Art Auction House | Plain HTTPS, 0 credits. heffel.com serves no robots.txt (404 → nothing disallowed). Sources: the public 'Auction Results' index (/Links/Results_Choose_E.aspx, ~16 recent live + online sales) and each results page (/Links/Results_E?Request=) which lists lot number, thumbnail, title, artist and price for every sold lot. Heffel states on the page: 'Prices include Buyer's Premium' and prices ar |
| Hermann Historica | Militaria: only lawful historical reference data would be kept; robots forbids the needed paths. |
| HiBid | Public past catalogs only; 'price realized' is shown only when the auctioneer enables it (hammer; buyer's premium separate). The seller shown is the auction house, not a private person. Lots in firearms categories are never emitted. Terms page is client-rendered (text not readable over plain HTTP) — noted, not verified. |
| HiFiShark | Search pages (hifishark.com/search?q=) are fetched over plain HTTPS with the RareIndex user agent, 2 s apart; robots.txt allows /search for generic agents. Only the server-rendered 'For Sale' tab is used (title, asking price in the seller's currency, marketplace, country, listing date, image); the Sold/Expired tab and the /searchrt, /searchSlice and /api endpoints are disallowed by robots.t |
| Historics Auctioneers | Historics (UK classic-car auctions, Ascot/Windsor/Brooklands + online automobilia & registration sales) lists past sales at /auction-results (title, sale number, end date) and renders each sale's 'Past lots' server-side at /auction/details/?au=&pp=96&pn= with 'Sold £X' per lot card (plain HTTPS, 0 credits). robots.txt sets crawl-delay 10, so the connector waits 10 s between request |
| Hobbiesville | Public storefront data of a retailer; asking prices only (listings, never sales). Merchant terms: https://www.hobbiesville.com/policies/terms-of-service. Attribution (sourceUrl) kept on every record. |
| HobbySearch | Public English search/list pages (1999.co.jp/eng/search?...; robots.txt allows all for generic agents) and item pages. Direct HTTPS returns 403 to non-browser clients, so pages go through Firecrawl (1 credit per page of 60 items). Parsed per card: HobbySearch item id, title, street price and list price (JPY), discount, stock state (In Stock / Sold Out / Pre-Order / Back-order), image. Emits catalo |
| HODINKEE Shop | Public storefront data; attribution via sourceUrl; asking prices only. No login, no personal data. |
| Huggins & Scott Auctions | Robots disallow all but /lots and /marketplace; lots load via authenticated XHR. |
| Hypeboost | Plain HTTPS gets 403 (robots.txt not served to non-browser agents); Firecrawl's standard fetch returns the public category grid (hypeboost.com/en/category/sneakers/[?page=N]) with product name, EUR lowest price, brand/category data attributes and product id (36 per page, 1 credit). Product pages (lookup) expose the style code in schema.org Product sku. 2 s between pages. |
| Iconic Auctions | Akamai edge denial; not circumvented. |
| iDealwine | Public price-index pages (/en/cote/?page=N) of iDealwine, the leading French wine auction house: each card lists a wine (region > appellation, colour, producer picture) with the iDealwine Price Estimate per vintage in EUR per 75 cl bottle. The estimate is computed by iDealwine from auction results (hammer price INCLUDING buyer's premium, updated weekly from 3M+ French auction prices since |
| Il Ponte Casa d'Aste | Terms only as per-auction PDFs; 'Awarded € 4,000' = hammer label. |
| Invaluable | robots.txt header: 'The use of robots or other automated means to access the Invaluable site without the express permission of Invaluable is strictly prohibited.' |
| JM Bullion | Terms https://www.jmbullion.com/terms-and-conditions/ explicitly forbid automated retrieval/scraping without written consent (search engines excepted). |
| Julien's Auctions | Cloudflare managed challenge; not solved. |
| Just Whisky | Just Whisky (Scotland, monthly online whisky auctions since 2013) renders its Past Auctions page from a public JSON API that we read directly: GET /api/lots/?min_end_date=dd/mm/yyyy&max_end_date=dd/mm/yyyy&ordering=-price&page_size=200&page=N and GET /api/auctions/ (plain HTTPS, 0 credits; robots.txt disallows only /account/ and /checkout). A lot is a sale when reserve_met is true (hammer_price is |
| KanZen Games | Public storefront data of a retailer; asking prices only (listings, never sales). Merchant terms: https://www.kanzengames.com/policies/terms-of-service. Attribution (sourceUrl) kept on every record. |
| Kapow Toys | Public storefront data; attribution via sourceUrl; asking prices only. No login, no personal data. |
| Ketterer Kunst | Impressum: no anti-automation clause; 'Ergebnis (inklusive Aufgeld)' = premium-inclusive. |
| Kick Game | Public storefront data; attribution via sourceUrl; asking prices only. No login, no personal data. |
| Kidrobot | Public storefront data of a retailer; asking prices only (listings, never sales). Merchant terms: https://www.kidrobot.com/policies/terms-of-service. Attribution (sourceUrl) kept on every record. |
| Kings Comics | Public storefront data; attribution via sourceUrl; asking prices only. No login, no personal data. |
| KREAM (크림, Naver) | 이용약관 (/agreement) forbids abnormal use of the service functions via automated means; no explicit public-data crawling clause. |
| Kunsthaus Lempertz | Kaufbedingungen: no anti-automation clause. 'Alle Ergebnisse beinhalten den Zuschlagspreis und das Aufgeld' → premium-inclusive. |
| Laced | Public brand pages (laced.com/) list product slugs; each product page embeds a schema.org ProductGroup with the style code (sku), brand and one Product per size carrying the current lowest ask in GBP. Plain HTTPS with the RareIndex user agent; robots.txt allows everything except account/admin. New-condition marketplace (deadstock). 1.5 s between pages; productsPerSeed caps product-page fetc |
| LEGO Shop (official) | Official manufacturer store. Public theme pages (lego.com/en-us/themes/?page=N) and product pages are rendered client-side and return 403 to plain non-browser clients, so they are fetched with Firecrawl (1 credit per page; ~22 products per theme page). Parsed per product leaf: set number (from the product URL), name, US retail price, badges (New / Retiring soon / Coming Soon / Exclusive / H |
| Lelands | The public gallery auction.lelands.com/Lots/Gallery?size=250&page=N lists the currently displayed auction's lots with title, bids, opening bid, status and 'SOLD FOR $X'; the sidebar gives the auction start/end and states 'Prices Shown Include Buyer's Premium' → buyer_premium_included=true, sale date = auction end (records are emitted only once the end has passed). Direct HTTP requests receive a Cl |
| Leonard Joel | Conditions of business: no anti-automation clause. 'Sold for $…' unlabelled → premium basis null. |
| Limitless TCG card database | Public card database; prices are third-party (TCGplayer/Cardmarket) values relayed by Limitless and stored with provider metadata at reduced confidence. No decklists/tournament/player data fetched. |
| Liv-ex | Paid membership/data licence; no public data. |
| LiveAuctioneers | Blocked in earlier sessions (login-gated prices realized, anti-bot); robots disallow the item API and all paginated/filtered pages. |
| Livestock | Public storefront data of a retailer; asking prices only (listings, never sales). Merchant terms: https://www.deadstock.ca/policies/terms-of-service. Attribution (sourceUrl) kept on every record. |
| Lloyds Auctions | Terms: no anti-automation clause. |
| Lorcast | Open Lorcast REST API (v0, no key): /sets then /cards/search?q=set:&page=N. Cards carry TCGplayer ids and USD market prices (normal / foil) without a timestamp, so observations are dated by the fetch day with confidence 0.7. Enchanted cards are emitted as a single 'Enchanted' variant. ~4 req/s self-throttled. |
| Los Angeles Modern Auctions (LAMA) | Public session pages only; lot detail pages never fetched (robots). |
| Lot-tissimo (ATG) | ATG terms (Nutzungsbedingungen page 302s to an error page) prohibit automated access. |
| Loupe This | Public auction results; sold price includes the 10 % buyer's premium (flagged). Bidder ids ignored. |
| Love of the Game Auctions | Cloudflare WAF block; not circumvented. |
| Lukie Games | Lukie's category pages render products through SearchSpring; the connector calls the same public JSON feed the storefront uses (dytuzo.a.searchspring.io/api/search/search.json, filtered by platform via bgfilter.extrafield5, 100 results/page, sorted by price desc). No login or key; 1.5 s between requests. Only games are kept (systems/accessories filtered by name and SKU); completeness defaults to ' |
| Lyn Knight Auctions | Terms https://www.lynknight.com/terms. The prices-realized archive (/archives) is login-only. |
| Lyon & Turnbull | Edinburgh/London/Glasgow auction house. Past auctions are listed in the public /auctions/past-auctions page (Next.js NEXT_DATA: title, sale number, date, link); each auction page embeds the full lot list as JSON (lot number, title, sub-title, estimate, hammer_price, status sold/unsold, images, buyer's premium tiers). Plain HTTPS with the RareIndex user agent; robots.txt disallows only /account |
| MA-Shops | Public search gallery pages (ma-shops.com/search.php?keywords=…, 45 items per page; category landing pages only show a handful of featured items) fetched over plain HTTPS with the RareIndex user agent; robots.txt is fully permissive. Each gallery cell gives the dealer's item URL, title, price with the displayed currency (the site picks a currency per visitor — CAN$, US$ or EUR — which is parsed an |
| magi (magi.camp) | C2C marketplace: seller usernames/profiles are personal data → never stored (only 'certified seller' boolean). Sold items carry no sale date → emitted as listings with availability sold, never as sales (§192). |
| Martian Toys | Public storefront data of a retailer; asking prices only (listings, never sales). Merchant terms: https://martiantoys.com/policies/terms-of-service. Attribution (sourceUrl) kept on every record. |
| Mattel Creations | Official manufacturer shop; MSRP listings, never sales. |
| Mecum Auctions | Public results: the /results/ page lists completed auctions (plain HTTPS), each auction's lot list (/auctions//lots/?page=N, 24 lots per page) is rendered through Firecrawl because prices are client-rendered. robots.txt allows the pages (only /search/ is disallowed). Lots carrying the 'sold' badge with a price become sales; 'bid goes on'/unsold lots are skipped. Sale date = first day of the |
| Memory Lane Inc | Cloudflare WAF block (error 1020-style) for automated access; not circumvented. |
| Mercari (US) | Mercari Terms of Service prohibit scraping/automated access. |
| Mercari Japan (メルカリ) | Mercari terms prohibit unauthorised automated access; API requires signed requests → circumvention would be needed. |
| Mile High Card Company | Akamai edge denial; not circumvented. |
| Miller & Miller Auctions | Public catalog pages only; robots allows everything with a 10 s crawl delay. Winning bid = hammer (21 % buyer's premium charged on top, not included). No login, no API token, no personal data (bidder paddles/customer ids in the JSON are ignored). |
| Millon | CGU contain no anti-automation clause. 'Adjugé à' not labelled hammer vs fees → premium basis null. |
| Miniature Market | Public listing pages, honest UA, crawl-delay honoured. |
| Mondo | Public storefront data of a retailer; asking prices only (listings, never sales). Merchant terms: https://mondoshop.com/policies/terms-of-service. Attribution (sourceUrl) kept on every record. |
| Morphy Auctions | Two public hosts, plain HTTPS, 0 credits, 2 s politeness. morphyauctions.com/auctions/past-auctions/ (WordPress; robots.txt allows) lists every past sale with department, title and date; auctions.morphyauctions.com/catalog.aspx?auctionid=N shows each lot with 'Final Price: $X', min bid, estimate and bid count. Paging on the ASP.NET catalog is the page's own form POST (page number + Go, 100 lots pe |
| MPB | MPB blocks non-browser clients (403 'Security check', robots.txt itself returns 403) but category pages render for Firecrawl (1 credit per page, ~2.5 s wait). The connector reads the model cards of seeded category pages (name, units available, price range, model URL, image) for the US storefront (add en-uk / en-eu seeds for GBP/EUR). One listing per model at the cheapest available unit; per-unit c |
| MTGGoldfish | Public set pages (https://www.mtggoldfish.com/sets/<Set+Name>) embed a JSON payload with every printing (card_uuid, set code, collector number, finish, current paper/online price, images). robots.txt allows '/' for generic agents (only widgets/embeds are disallowed; Content-Signal ai-train=no is respected — data is used as market reference, not for training). Paper price = TCGplayer-derived market |
| MTGJSON | Open MTG data project (free bulk files, no key). Incremental runs download SetList.json, the newest maxSetsPerRun set files (LEA.json… with per-card identifiers: scryfallId, tcgplayerProductId, cardKingdomId, mcmId, cardsphereId, multiverseId) and AllPricesToday.json.gz (~5 MB gz) which carries the latest daily retail/buylist price per printing from TCGplayer, Cardmarket (EUR), Card Kingdom, Car |
| MTGStocks | Angular SPA fed by a private API that rejects non-browser clients; its prices are TCGplayer/Cardmarket relays already covered by tcgcsv, mtgjson and cardmarket-priceguide. |
| MutualArt | Paid membership; terms prohibit scraping. |
| MyComicShop | Imperva Incapsula interstitial for all non-browser clients; public listing pages read through Scrapfly. No sold data is published outside the (robots-disallowed) auction section; asking prices are listings. |
| MySlabs | Public fixed-price marketplace for graded slabs. robots.txt only disallows /account/, /api/, /admin/, /ajax_select/. Discovery uses the public sitemaps (sitemap-slabs-*.xml, newest ids first); slab pages are plain HTML with a schema.org Product JSON-LD (name, images, offers.price USD, availability InStock/OutOfStock). OutOfStock slabs are stored as listings with availability 'sold' at their last a |
| Nate D. Sanders Auctions | robots.txt disallows the prices-realized page (/AuctionResults.aspx) for all non-Google agents → not crawled (SPEC §36). |
| Newbury Comics | Public storefront data of a retailer; asking prices only (listings, never sales). Merchant terms: https://www.newburycomics.com/policies/terms-of-service. Attribution (sourceUrl) kept on every record. |
| NGC (Numismatic Guaranty Company) — price guide | LEGAL FLAG: https://www.ngccoin.com/legal/terms-of-use/ forbids robots/spiders 'for any purpose'. Connector implemented against the public retail guide only, at the lowest cadence, with attribution — needs a legal review before production use. World price guide is behind a Cloudflare interactive challenge (not fetched); census requires an account (not fetched). |
| Ninoma | Public storefront data; attribution via sourceUrl; asking prices only. No login, no personal data. |
| Noble Knight Games | Plain HTTPS. robots.txt disallows the client-rendered category/search listings (/Catalog, /category-search, /AdvancedSearch…) but allows product pages (/P//) and the sitemaps (sitemapproducts1-5.xml ≈ 120k products), so products are enumerated from the sitemaps with a rotating cursor and read from each page's schema.org Product JSON-LD (name, sku, mpn, brand, price, itemCondition, availa |
| Noble Numismatics | Terms https://www.noble.com.au/about/terms-and-conditions (catalogue text not to be reproduced without permission → stored for identification/attribution only). Prices page states 'All prices exclude buyer and vendor premiums'. |
| Noonans Mayfair (ex Dix Noonan Webb) | Terms https://www.noonans.co.uk/help-and-information/#TermsAndConditions_UK ; images © Noonans (personal use) — only URLs referenced. Cloudflare challenge on plain HTTPS answered by Firecrawl's normal render. |
| Novelship | Public Novelship browse pages (novelship.com/sneakers/?page=N) and product pages fetched over plain HTTPS with the RareIndex user agent; robots.txt only disallows sell/auth/dashboard/pay paths. The server-rendered payload embeds each product's SKU (style code), colorway, retail cost, release date, last sale price, lowest listing price and 180-day sales count — no login or private endpoint i |
| NumisBids | Terms https://www.numisbids.com/terms (personal use of the site; we read public catalogue/result pages only, attribute NumisBids + the auction house). Cloudflare 403 on plain HTTPS is answered by Firecrawl's normal render, no CAPTCHA solving. |
| Numista | Licence https://en.numista.com/api/license.php: commercial use allowed, attribution 'Source: Numista' + N# mandatory, no bulk download, no feed/API re-serving, no sublicensing; photos CC BY-NC-SA / third-party. Pricing https://en.numista.com/api/pricing.php. |
| Open Library (Internet Archive) | Open Library's JSON endpoints /isbn/.json, /works/.json and /authors/.json (allowed by robots.txt; /search and /api are disallowed and not used) with a descriptive user agent and 1 request/second, as their API terms ask. Seeds are ISBNs of collectible modern first editions/first printings (config.seeds with a note); each yields one catalog item (title, author, publisher, place, year, |
| OPTCG API | Open community API (no key): /api/allSets/ then /api/sets/<set_id>/ returning every card of the set with TCGplayer-derived market_price / inventory_price and a date_scraped, used as the observation date (confidence 0.7 / 0.65). Alternate arts share the card code and are distinguished by image id. One request per set, 0.5 s politeness. |
| Osenat | CGU: no anti-automation clause; pages state 'Résultats sans frais' = hammer (read per page). Militaria = lawful historical reference data. |
| OVERKILL | Public storefront data; attribution via sourceUrl; asking prices only. No login, no personal data. |
| Overstreet Price Guide | Copyrighted paid publication. |
| Pamono | /terms/ is disallowed for crawlers and therefore not reviewed automatically; only public category grids are read. |
| Parfumo | Member-to-member marketplace (souk) is robots-disallowed; catalogue pages public. |
| PBA Galleries | Public auction list (pbagalleries.com/auctions/?page=N: sale number, title, date, catalog id) and closed catalogs (/auctions/catalog/id/?page=N, 'Sold for $X' + 'Status Sold' per lot with title/publisher/date fields) rendered through Firecrawl (plain HTTPS gets a Cloudflare interstitial; not bypassed; robots.txt allows the site). PBA's realized prices include the 25% buyer's premium (verified: |
| PCARMARKET | PCARMARKET's public results page (/results/) is fed by the same JSON endpoint we read: GET /api/auctions/?status=sold&type=all&sort_by=ending_soon&limit=50&page=N (plain HTTPS, 0 credits; robots.txt: 'User-agent: * Allow: /'). Each item has title, vehicle {make, model, year}, high_bid (USD winning bid), end_date, status 'Sold', country, images. Price = winning bid; PCARMARKET charges the buyer a s |
| PCGS (Professional Coin Grading Service) | Public verification page; PCGS's own text: 'According to the PCGS Certification Database, the requested certification number is defined as the following'. Price-guide value kept as metadata only. Auction Prices Realized and Set Registry not fetched. |
| Peyton Street Pens | Store policies contain grading definitions, no automated-access clause. |
| Phillips | Same public mechanism as phillips-watches (past-sales JSON on /auctions/past over plain HTTPS, then one Firecrawl render per sale page, 1 credit) applied to the Editions, Design, 20th Century & Contemporary Art, Photographs, Jewels and Handbags departments. Prices realised are published by Phillips including buyer's premium (buyer_premium_included=true). Sale date = sale end date. robots.txt disal |
| PIASA | CGU: no anti-automation clause; CGV reserve reproduction rights on catalogue texts (we store titles/prices/links only). Results labelled 'Frais de vente inclus'. |
| PMG (Paper Money Guaranty) | Free public verification, no account. Serial numbers are item-specific and kept in metadata only. Registry / full population report not fetched. |
| Pokellector | https://www.pokellector.com/terms — 'You agree not to use automated means to interact with the data we store without written permission. This includes, but isn't limited to, retrieving prices, images and managing collections.' |
| Pokémon TCG API | Public REST API v2 (https://api.pokemontcg.io/v2). Optional X-Api-Key (POKEMONTCG_API_KEY) raises limits (20k/day) — without a key ~1k/day and 30/min. Crawl = sets, then cards per set (pageSize 250, cursor {setIndex,page}). The API is intermittently unavailable (5xx); the connector retries with backoff and falls back to the maintainers' public GitHub mirror (PokemonTCG/pokemon-tcg-data, same card |
| PokemonPrice.com | Public server-rendered card pages (robots.txt allows '/' for generic agents; Content-Signal ai-train=no respected). Each card page embeds, in its React Server Components payload, a per-grade price model (Raw, PSA 1–10, BGS, CGC: fair/low/high price, model confidence, last sale date) derived from eBay and other public sold listings, plus monthly transaction counts. Emitted as price_observations 'gu |
| Potter & Potter Auctions | Plain HTTPS, 0 credits. robots.txt only disallows /s3cr3t/. Sources: the public past-auction list (auction.potterauctions.com/auctions/past?page=N — event id, title, start date) and each closed auction's catalog pages (/auctions/potter-potter/-/catalog?page=N, ~47 lots/page, server-rendered on the Bidsquare platform) whose lot cards show 'Sold for $X' (winning bid = hammer, buyer's premi |
| PriceCharting | Public product pages fetched over plain HTTPS with the RareIndex user agent (robots.txt only disallows /buy, /publish-offer, /stripe-connect). Each product page exposes PriceCharting guide values per condition and a table of recently completed eBay sales (date, title, price, eBay item id) — we store those as sales with the PriceCharting page as source URL. No account, no API key, no photos (TimeWa |
| Pristine Auction | Cloudflare managed challenge on all pages; solving challenges to reach the SPA's sold endpoints was not attempted. |
| Propstore | CloudFront/WAF blocks automated access to the auction catalogue; Crawl-delay 120 s would also make a full archive crawl impractical. |
| Provident Metals | Same corporate family and terms as JM Bullion (https://www.providentmetals.com/terms.html). |
| Proxibid | robots.txt disallows /en-us/* for all agents → every catalogue/lot page is off limits. |
| PSA (Professional Sports Authenticator) | PSA's cert page states the database is provided 'for the sole purpose of confirming data regarding authenticated items with a particular certification number' — exactly the use (per-cert verification, no enumeration). APR and the population report are member-only and are never fetched (see connector psa-cert accessNotes). The PSA Estimate is stored as metadata only, never as a sale. |
| Rakuten Ichiba (楽天市場) — Item Search API | Rakuten Web Service terms: attribution required, 1 req/s, no redistribution of raw data beyond permitted use. |
| Rebag | Public Shopify storefront feed (shop.rebag.com/collections//products.json) over plain HTTPS with the RareIndex user agent; rebag.com robots.txt disallows nothing relevant (only /digital_certificate/). Each product is one authenticated pre-owned item in USD; Rebag's condition grade (Pristine/Excellent/Great/Good/Fair) is the first token of the variant title and the estimated retail price co |
| Reverb | Read-only public listings API (api.reverb.com/api/listings, HAL JSON with Accept-Version 3.0) — no token is required for listing search; the price-guide endpoint is no longer public and sold data needs an authenticated app, so only live asking prices are collected. robots.txt allows /api/listings (only /api/my and per-listing upsell helpers are disallowed). Reverb returns prices converted to USD; |
| RM Sotheby's | Public results: /results/ (auction list per year with date ranges) and each auction's lot grid (/auctions//lots/) rendered through Firecrawl because RM's site is an Angular app (no robots.txt is served; nothing is login-gated). Limitation: the lot grid paginates client-side (40 lots per view) and does not expose a page URL, so only the first 40 lots of each auction are captured per run — par |
| Robert Edward Auctions (REA) | Robots disallow everything except /lots and /marketplace; no public prices-realized archive found. |
| Rotofugi | Public storefront data of a retailer; asking prices only (listings, never sales). Merchant terms: https://www.rotofugi.com/policies/terms-of-service. Attribution (sourceUrl) kept on every record. |
| RR Auction | Two public pages rendered through Firecrawl (plain HTTPS gets a Cloudflare interstitial; not bypassed; robots.txt allows everything except /admin): the past-auction calendar (/auctions/auction-calendar/cron/past/?page=N: auction id, title, date, realized total) and each auction's lot gallery (/auctions/auction-details/?page=N&itemQty=96&view=gallery&sort=time&cat=0) whose cards show 'Sold For: |
| Ruten (露天拍賣) | Public storefront data only; sold_num is an aggregate counter (kept as metadata, never a sale). |
| Saatchi Art | Public category browse pages (/paintings, /photography, /sculpture, /prints … with ?page=N) served as Next.js pages whose NEXT_DATA carries 25 artworks per page: title, artist, category, mediums, materials, dimensions (cm), list price (USD cents), availability status (avail/sold), SKU and image. Plain HTTPS with the RareIndex user agent. robots.txt only disallows filter/sort query parameters ( |
| Scotch Whisky Auctions | Public monthly auction archive (Glasgow; ~4,500–5,000 lots per auction, 20 lots per page, plain HTTPS with the RareIndex user agent, robots.txt disallows only /cmsplus/). Each lot card exposes title, lot number and 'Sold for £X in ' — this is the hammer price; the buyer's commission (SWA charges a separate buyer's premium plus VAT) is NOT included, so buyer_premium_included=false. Sale |
| SCP Auctions | Plain HTTPS on the public Bidsquare-hosted catalog (robots.txt: only /wp-admin/ disallowed, Crawl-delay 10 → 2 s politeness plus small runs). Past auctions are listed at /auctions/past?page=N; each catalog page (/auctions/scp-auctions-inc/-/catalog?page=N, 48 lots) shows 'Sold for $X' and the bid count; the event start/end come from the page's schema.org Event JSON-LD (sale date = event |
| Scryfall | Official public API, no key. Bulk 'default_cards' JSONL (gzip, ~78 MB, refreshed daily) is streamed for the full catalog; single-card lookups use /cards//. Scryfall asks for ≤10 req/s (we pace 100 ms), an identifying User-Agent and Accept headers. Prices (usd/usd_foil/usd_etched/eur/eur_foil) are Scryfall's daily market aggregates from TCGplayer/Cardmarket → stored as price_observatio |
| SD Bullion | Terms https://sdbullion.com/terms-use (no anti-scraping clause found). Bullion asks track spot price; only graded/collectible coin categories are worth listings. |
| SGC (Sportscard Guaranty) — cert lookup & pop report | Cert lookup is reCAPTCHA-protected (no solving). The API explicitly restricts service to the website origin — spoofing Origin/Referer would be circumvention. The former server-rendered pop report (sgclegacy.com/PopulationReport.aspx) is gone (404). |
| Shortboxed | GraphQL requires an authenticated user (401) → login wall; SPA shell carries no data. Not circumvented. |
| Sideshow Collectibles | Public product pages; JSON-LD Product with GTIN — clean to normalise. |
| Sixbid | The lot/auction APIs answer 204 (empty) to non-browser user agents — accessing them would require UA spoofing, which we do not do. The historical archive is the paid 'Sixbid Coin Collector's Archive' (subscription). |
| Solaris Japan | Public storefront data; attribution via sourceUrl; asking prices only. No login, no personal data. |
| Sorcery TCG (Erik's Curiosa) | Official public JSON (https://api.sorcerytcg.com/api/cards, one call ≈1,100 cards with every printing: set code/name, finish Standard/Foil, product Booster/Precon/Promo, print date). Catalog only, no prices or images; TCGCSV supplies Sorcery prices via TCGplayer product names. One catalog_item per printing (finish → 'Foil' variant; non-booster product noted in metadata). |
| Sotheby's | Auction pages https://www.sothebys.com/en/buy/auction// are server-rendered (NEXT_DATA Apollo cache) with auction metadata, department names, currency, dates and the first 48 lot cards including estimates and, for closed sales, the visible result (BidState.sold.premiums.finalPriceV2 = price including buyer's premium, currentBidV2 = hammer). Remaining lots are paged with the same pu |
| Spink & Son | Terms https://www.spink.com/terms-and-conditions. 'Sold for' is not annotated hammer vs premium → stored with buyer_premium_included=null. |
| SportsCardsPro (PriceCharting) | Public product pages of PriceCharting's sports-card site. robots.txt only disallows /buy, /publish-offer, /stripe-connect. Plain HTTP with our user agent gets a Cloudflare interstitial (HTTP 403), so pages are fetched through Firecrawl (1 credit per page, ~1 MB each) — no login, no CAPTCHA solving, no account. Each page exposes guide values per grade (Ungraded, Grade 1–9.5, TAG/ACE/SGC/CGC/PSA/BGS |
| Stamp Auction Network (prices realized, all firms) | No site terms linked from pr.cfm (© Droege Computing Services). Public catalogue/result pages; Siegel (SR) excluded per earlier session. |
| Stanley Gibbons Baldwin's | Terms https://sgbaldwins.com/terms-and-conditions. Hammer and buyer's premium are explicit per lot. |
| Stanley Gibbons online shop | Shopify policies https://shop.stanleygibbons.com/policies/terms-of-service. Asking prices only (listings). |
| Strangecat Toys | Public storefront data of a retailer; asking prices only (listings, never sales). Merchant terms: https://strangecattoys.com/policies/terms-of-service. Attribution (sourceUrl) kept on every record. |
| Subdial | Listing URLs come from the public sitemap (subdial.com/sitemap-listing.xml); each listing page embeds a schema.org Product (brand, mpn = reference, sku = Subdial id, GBP price, availability) plus a specification table (reference, year, condition, box, papers). robots.txt allows / for generic agents (it blocks a list of named AI crawlers, which we are not). Plain HTTPS with the RareIndex user agent |
| Super7 | Public storefront data of a retailer; asking prices only (listings, never sales). Merchant terms: https://www.super7.com/policies/terms-of-service. Attribution (sourceUrl) kept on every record. |
| Suruga-ya | Public search result pages (suruga-ya.jp/search?...; robots.txt: 'Allow: /' for generic agents with Content-Signal search=yes, ai-train=no, use=reference — we only index prices and never train on content). Plain HTTPS returns 403 from data-centre IPs, so pages are fetched through Firecrawl (1 credit per page, ~24 items). Parsed per card: product id (shinaban), title, condition/type label, release |
| Swann Auction Galleries | Public pages over plain HTTPS with the RareIndex user agent (robots.txt: Disallow empty): the past-auctions list (/auctions/past-auctions/: date, sale number, department, catalog link) and archived catalogs (/auction-catalog/?algoliaParam=archive_lotNumber_asc_prod[page]=N, 20 lots per page) whose server-rendered cards show lot number, title, estimate and 'Sold: $X' with the note 'Sold price |
| Sworders Fine Art Auctioneers | Terms page: no anti-automation clause. 'Sold for £…' not labelled hammer vs premium → null. |
| SWU-DB | Free community API (https://api.swu-db.com/cards/, no key). Each card carries TCGplayer ids and USD MarketPrice/LowPrice (+ FoilPrice/LowFoilPrice) relayed from TCGplayer without a timestamp → observations dated by the fetch day, confidence 0.7. Set codes are configured (the /catalog/sets endpoint needs an API key); VariantType (Normal, Hyperspace, Showcase…) becomes the variant, foil prices |
| TAG Grading | Public pop report and DIG reports; nothing behind the customer login is touched. Per-card sub-scores not stored. |
| TCDB – Trading Card Database | Community checklist database protected by a Cloudflare challenge on every path; terms could not be retrieved by a bot. Not circumvented (SPEC §36). |
| TCGCSV | Public daily mirror of TCGplayer's catalog and price API (JSON endpoints /tcgplayer/{categoryId}/groups, /{groupId}/products, /{groupId}/prices; robots.txt allows everything and the FAQ explicitly invites programmatic access with an identifying User-Agent and ~4 req/s). Prices (low/mid/high/market per printing subtype) are TCGplayer market data, not transactions: stored as price_observations dated |
| TCGdex | Open REST API (https://api.tcgdex.net/v2, no key, MIT-licensed data) covering every Pokémon TCG language including Japanese; English cards carry TCGplayer (USD) and Cardmarket (EUR) prices per variant with their own update timestamps, which we store as price observations dated by the price's updated field. One request per set and per card at ≈8 req/s (self-throttled 120 ms). English ids match po |
| TFSource | robots.txt forbids all crawling for generic agents → not crawled (SPEC §36). |
| The Card Vault | Public storefront data; attribution via sourceUrl; asking prices only. No login, no personal data. |
| The Game Steward | Public storefront data of a retailer; asking prices only (listings, never sales). Merchant terms: https://www.thegamesteward.com/policies/terms-of-service. Attribution (sourceUrl) kept on every record. |
| The Market by Bonhams | The Market by Bonhams (online collector-car auctions, UK/EU/AU) publishes results server-side at /auctions/results?page=N (18 cards per page, ≈330 pages back to 2019; plain HTTPS with the RareIndex user agent; robots.txt 'User-agent: * Allow: /'). Each card: title, 'Sold for £56,000 on 17 Aug 2026' (native currency symbol £/€/A$), listing URL, bid count, location. Price = winning bid; The Market c |
| the-saleroom (ATG) | Terms page 302s to an error page; ATG terms prohibit automated access without a licence. |
| Tokyo Chuo Auction (tcabid.com) | Buyer guide describes 15–20 % commission separately → final_price = hammer. |
| Total Cards | Public storefront data; attribution via sourceUrl; asking prices only. No login, no personal data. |
| Toy Snowman | Public storefront data of a retailer; asking prices only (listings, never sales). Merchant terms: https://www.toysnowman.ca/policies/terms-of-service. Attribution (sourceUrl) kept on every record. |
| Toy Tokyo | Public storefront data of a retailer; asking prices only (listings, never sales). Merchant terms: https://www.toytokyo.com/policies/terms-of-service. Attribution (sourceUrl) kept on every record. |
| TOYZEROPLUS | Public storefront data; attribution via sourceUrl; asking prices only. No login, no personal data. |
| Trade Me (API v1) | Trade Me API Terms (developer.trademe.co.nz/api-terms): attribution, no raw resale of data. |
| Trainz.com | Public Shopify JSON feed (/collections//products.json?limit=250&page=N; robots.txt allows) — the same data the storefront renders. Each product gives title (with Trainz's condition code suffix such as LN/Box, EX/Box), vendor, tags (condition:, class:, era:, Inventory Type2_), variant price/SKU/availability and images. Emits a catalog item (brand = vendor, scale/gauge when present) and a fi |
| Travelling Man | Public storefront data; attribution via sourceUrl; asking prices only. No login, no personal data. |
| Turntable Lab | Public storefront data of a retailer; asking prices only (listings, never sales). Merchant terms: https://www.turntablelab.com/policies/terms-of-service. Attribution (sourceUrl) kept on every record. |
| Unicorn Auctions | Terms of Use: 'Use any robot, spider, or other automatic device, process, or means to access the Service for any purpose, including monitoring or copying any of the material' is prohibited. |
| University Archives | UA-based denial of the honest bot; not evaded. |
| Venduehuis der Notarissen | Voorwaarden: no anti-automation clause. |
| Video Game Trader | Public storefront JSON; asking prices are listings. |
| Waddington's | The catalogue host denies the honest bot UA outright; the wine host's robots disallow crawling; the WordPress results posts are editorial highlights, not complete prices realized. |
| WATA Games (now PSA Video Games) — cert verification | No dedicated public verification page any more; WATA's 2023 'Cert Verification' blog post lives behind a Cloudflare challenge. PSA's cert page covers PSA-graded video games. |
| WatchCharts | Terms could not be read (403); WatchCharts sells its market data commercially. |
| Watchfinder & Co. | Plain HTTPS returns 403 to non-browser agents (robots.txt is not served either); Firecrawl's standard fetch returns the public model pages (watchfinder.co.uk/watches//?p=N). Each product card carries data attributes (sku, brand, series, model reference, image), box/papers icons, year and the GBP price (data-price-amount). 1 Firecrawl credit per page (~24 watches); 2 s between pages. |
| WatchUSeek forums (sales corner) | User-generated forum posts with personal data (member names, PayPal details). |
| Waxwork Records | Public storefront data of a retailer; asking prices only (listings, never sales). Merchant terms: https://waxworkrecords.com/policies/terms-of-service. Attribution (sourceUrl) kept on every record. |
| Whatnot | Whatnot Terms of Service prohibit automated access; data requires a logged-in session. |
| Whisky Hammer | Whisky Hammer (Aberdeenshire, monthly auctions, UK + EU warehouses) lists previous auctions at /previous-auctions (plain HTTPS) but the per-auction lot pages (/auction/past/auc-/?page=N, 50 lots per page sorted high→low bid) sit behind a Cloudflare interstitial for plain clients, so they are fetched with Firecrawl (1 credit per page, ≈88 pages for a 4,300-lot auction; capped by config.pagesPerR |
| Whisky.Auction | T&Cs cover bidding/selling only; no automated-access clause. Winning bid = hammer (buyer commission separate). |
| Wine-Searcher | Terms of use prohibit scraping; data licensed commercially. |
| WineBid | US online wine auction (weekly auctions). Category browse pages (/BuyWine/Items//) are rendered through Firecrawl (1 credit, plain HTTP returns 403 for list pages) to discover item URLs; each public item page (/BuyWine/Item//, plain HTTPS) shows the wine, the current auction lot (estimate / current bid) and a 'Recent sales' table of past winning bids for the same wine: item i |
| Wizard's Tower | Public storefront data of a retailer; asking prices only (listings, never sales). Merchant terms: https://www.kanatacg.com/policies/terms-of-service. Attribution (sourceUrl) kept on every record. |
| Woolley & Wallis | HammerPrice explicit (hammer). Terms not fetched; no anti-automation language seen. |
| Wright (Rago/Wright) | Public session pages only (one page per sale lists every lot with its result). Lot detail pages (/items/item/*) are disallowed by robots and never fetched. Results include the buyer's premium when the session style says show_results_with_premium. |
| Yahoo! Auctions Japan (ヤフオク!) | LY Corporation terms of service; public pages only, honest UA, robots respected; seller names are masked by the site; no bidding/login. |
| Yahoo! Shopping Japan — itemSearch V3 API | Yahoo! JAPAN Web API guidelines: credit display required; commercial use per guidelines. |
| YGOPRODeck | Public API v7 (https://db.ygoprodeck.com/api/v7/cardinfo.php), no key; rate limit 20 req/s — a full crawl is ONE request (~21 MB, ~14.5k cards / ~44k printings) plus optional misc=yes. The API carries no price timestamp: card_sets[].set_price (USD, per printing) and card_prices (cardmarket EUR / tcgplayer / ebay / amazon / coolstuffinc USD, card-level) are recorded as price_observations dated at f |
| Yuyu-tei (遊々亭) | Shop asking prices of a retailer (no personal data). Buy-list prices and damaged-card pages deliberately not fetched. |
| Zachys Wine Auctions | Not evaluated beyond robots (blocked before content). |