TypeScript 61.9%
HTML 37.2%
SQL 0.7%
1> Verbatim product mandate as provided on 2026-09-07. The repository CLAUDE.md is the condensed working version; this file is the authoritative full text.23# CLAUDE.md45## RareIndex.io67Global Collectibles Market Intelligence, Search, Pricing & Index Platform89RareIndex.io must become the global reference platform for discovering, tracking, pricing, comparing, analyzing, and researching collectible assets.1011The ambition is significantly larger than a marketplace aggregator.1213RareIndex should become:1415The Bloomberg Terminal, Google, CoinMarketCap, Zillow, and StockX of the global collectibles economy.1617The platform must continuously collect public market data from marketplaces, auction houses, dealers, specialized websites, historical databases, grading companies, collector communities, manufacturer catalogs, archives, and other relevant sources.1819RareIndex should cover as many collectible categories as technically possible.2021The architecture must be built around:2223- Firecrawl24- Scrapfly25- direct APIs when available26- structured feeds27- official datasets28- auction databases29- marketplace connectors30- AI extraction31- multimodal image analysis32- entity resolution33- historical sale normalization34- deduplication35- valuation models36- global collectible indices37- category indices38- individual asset price histories39- collection tracking40- alerts41- comparable-sales analysis42- rarity analysis43- grading normalization44- liquidity analysis45- AI-assisted identification4647The platform language must be English-first.4849The application must be:5051- extremely fast52- visually exceptional53- mobile-first54- responsive55- data dense without feeling cluttered56- professional57- credible58- research-grade59- scalable to hundreds of millions of records6061## 1. CORE PRODUCT VISION6263RareIndex should answer questions such as:6465- What is this collectible worth?66- How rare is it?67- Has its value increased?68- What are the latest comparable sales?69- Where is it currently for sale?70- Which marketplace has the cheapest listing?71- What is the global market price?72- What is the price trend?73- What is the liquidity?74- How often does it sell?75- Is the market accelerating or declining?76- What grade commands the highest premium?77- Is this listing unusually cheap?78- Is this listing unusually expensive?79- Is the collectible likely misidentified?80- How many examples exist?81- What are similar collectibles?82- What are the most valuable objects in this category?83- What collectibles are trending globally?84- Which categories are outperforming?85- Where are collectors moving capital?86- How has Pokémon performed versus watches?87- How has LEGO performed versus the S&P 500?88- What are the best performing collectibles over 1Y / 5Y / 10Y?89- What is the most liquid collectible market?90- What items are becoming scarce?91- What discontinued products are appreciating rapidly?9293RareIndex must transform fragmented collectible markets into structured financial-style data.9495## 2. PRIMARY PLATFORM MODULES9697Main navigation:98991. Home1002. Explore1013. Markets1024. Categories1035. RareIndex1046. Trending1057. Sales1068. Listings1079. Auctions10810. Price History10911. Collections11012. Watchlist11113. Compare11214. Scanner11315. AI Research11416. Market Map11517. Grading11618. Auction Calendar11719. News11820. Data11921. API12022. About121122## 3. RAREINDEX GLOBAL INDEX123124Create a flagship index:125126RareIndex Global Collectibles Index127128Ticker:129130RARE131132Possible subindices:133134- RARE-TCG135- RARE-SPORT136- RARE-WATCH137- RARE-SNEAKER138- RARE-LEGO139- RARE-COMIC140- RARE-GAME141- RARE-ART142- RARE-LUXURY143- RARE-WINE144- RARE-COIN145- RARE-TOY146- RARE-MUSIC147- RARE-AUTO148- RARE-TECH149- RARE-BOOK150- RARE-MILITARIA151- RARE-SPACE152- RARE-FOSSIL153- RARE-DESIGN154155Each index should support:156157- current value158- daily change159- weekly change160- monthly change161- YTD162- 1 year163- 3 years164- 5 years165- 10 years166- all time167- volatility168- drawdown169- liquidity score170- transaction count171- median sale price172- average sale price173- market capitalization estimate174- number of tracked assets175- category breadth176- momentum177178## 4. COLLECTIBLE CATEGORY UNIVERSE179180The architecture MUST NOT hardcode a small number of collectible categories.181182Use an extensible taxonomy.183184Every category should support:185186- category187- subcategory188- franchise189- brand190- series191- model192- release193- variant194- year195- edition196- condition197- grade198- grading company199- certification number200- provenance201- country202- material203- size204- color205- serial number206- production quantity207- rarity208- population209- original MSRP210- estimated value211- latest sale212- listing price213- currency214- marketplace215- images216- description217- source URLs218219## 5. CATEGORY MASTER LIST220221RareIndex should attempt to cover all of the following.222223### 5.1 Trading Cards224225Pokémon226227Track:228229- Base Set230- Base Set 2231- Jungle232- Fossil233- Team Rocket234- Gym Heroes235- Gym Challenge236- Neo Genesis237- Neo Discovery238- Neo Revelation239- Neo Destiny240- Legendary Collection241- Expedition242- Aquapolis243- Skyridge244- EX era245- Diamond & Pearl246- Platinum247- HeartGold SoulSilver248- Black & White249- XY250- Sun & Moon251- Sword & Shield252- Scarlet & Violet253- Japanese expansions254- Korean editions255- Chinese editions256- promotional cards257- tournament cards258- trophy cards259- staff cards260- prerelease cards261- stamped cards262- error cards263- shadowless264- first edition265- unlimited266- reverse holo267- holo268- secret rare269- illustration rare270- special illustration rare271- gold cards272- rainbow rares273- alternate arts274275Grades:276277- PSA278- BGS279- CGC280- SGC281- TAG282- raw283284### 5.2 Magic: The Gathering285286Track:287288- Alpha289- Beta290- Unlimited291- Revised292- Arabian Nights293- Antiquities294- Legends295- The Dark296- Fallen Empires297- Ice Age298- Alliances299- Mirage300- Visions301- Weatherlight302- Tempest303- Urza block304- Mercadian Masques305- Invasion306- Odyssey307- Onslaught308- Mirrodin309- Kamigawa310- Ravnica311- Lorwyn312- Zendikar313- Innistrad314- Return to Ravnica315- Theros316- Khans317- Battle for Zendikar318- Kaladesh319- Dominaria320- War of the Spark321- Modern Horizons322- Commander323- Secret Lair324- serialized cards325- artist proofs326- reserved list327- Judge promos328- foils329- etched foils330- masterpieces331- special treatments332333### 5.3 Yu-Gi-Oh!334335Track:336337- Legend of Blue Eyes338- Metal Raiders339- Spell Ruler340- Pharaoh's Servant341- Labyrinth of Nightmare342- Legacy of Darkness343- tournament packs344- championship cards345- prize cards346- Ghost Rare347- Ultimate Rare348- Collector Rare349- Starlight Rare350- Quarter Century351- first edition352- unlimited353- Japanese cards354- Korean cards355- promotional cards356357### 5.4 One Piece Card Game358359Track:360361- booster sets362- starter decks363- promotional cards364- manga rares365- alternate arts366- tournament cards367- championship cards368- serialized cards369- Japanese variants370- English variants371372### 5.5 Disney Lorcana373374Track:375376- First Chapter377- Rise of the Floodborn378- Into the Inklands379- Ursula's Return380- Shimmering Skies381- future sets382- Enchanted cards383- promos384- tournament cards385- graded cards386387### 5.6 Other TCGs388389Include:390391- Dragon Ball Super392- Dragon Ball Masters393- Digimon394- Flesh and Blood395- Weiss Schwarz396- Final Fantasy TCG397- Star Wars Unlimited398- Star Wars CCG399- Star Wars Destiny400- Naruto401- My Hero Academia402- UniVersus403- MetaZoo404- Cardfight Vanguard405- Battle Spirits406- Force of Will407- KeyForge408- Chaotic409- Duel Masters410- Altered411- Sorcery Contested Realm412- Riftbound413- Grand Archive414- Gundam Card Game415- Marvel trading cards416- DC trading cards417- Garbage Pail Kids418- Topps entertainment cards419- non-sport cards420421## 6. SPORTS CARDS422423Sports:424425- baseball426- basketball427- hockey428- American football429- soccer430- Formula 1431- UFC432- boxing433- golf434- tennis435- cricket436- wrestling437- NASCAR438- Olympics439- lacrosse440- rugby441442Brands:443444- Topps445- Panini446- Upper Deck447- Bowman448- Fleer449- Donruss450- Score451- Leaf452- Futera453454Track:455456- rookie cards457- numbered cards458- parallels459- refractors460- autographs461- patches462- memorabilia cards463- game-used cards464- one-of-one cards465- printing plates466- redemptions467- inserts468- short prints469- super short prints470471## 7. COMICS472473Publishers:474475- Marvel476- DC477- Image478- Dark Horse479- IDW480- Boom Studios481- Archie482- Valiant483- Dynamite484- EC Comics485486Track:487488- first appearances489- first issues490- key issues491- variants492- retailer exclusives493- convention exclusives494- signed copies495- sketch covers496- newsstand variants497- direct editions498- pedigree copies499500Grades:501502- CGC503- CBCS504- raw505506## 8. MANGA507508Track:509510- first editions511- first printings512- limited printings513- signed copies514- Japanese original editions515- English editions516- French editions517- box sets518- special editions519- promotional volumes520521Series examples:522523- Dragon Ball524- One Piece525- Naruto526- Bleach527- Berserk528- Vagabond529- Slam Dunk530- Akira531- Attack on Titan532- Demon Slayer533- Jujutsu Kaisen534- Chainsaw Man535- Hunter x Hunter536- JoJo537- Death Note538- Sailor Moon539540## 9. VIDEO GAMES541542Platforms:543544- Atari545- Intellivision546- ColecoVision547- NES548- Famicom549- SNES550- Super Famicom551- Nintendo 64552- GameCube553- Wii554- Wii U555- Switch556- Game Boy557- Game Boy Color558- Game Boy Advance559- Nintendo DS560- 3DS561- Sega Master System562- Genesis563- Mega Drive564- Saturn565- Dreamcast566- Game Gear567- PlayStation568- PS2569- PS3570- PS4571- PS5572- PSP573- Vita574- Xbox575- Xbox 360576- Xbox One577- Xbox Series578- Neo Geo579- PC Engine580- TurboGrafx581- MSX582- Commodore583- Amiga584- PC games585586Track:587588- sealed games589- graded games590- CIB591- loose592- prototypes593- review copies594- developer builds595- kiosk demos596- press kits597- collector editions598- limited editions599- regional variants600- misprints601602## 10. GAMING HARDWARE603604Track:605606- consoles607- handhelds608- controllers609- accessories610- development kits611- prototypes612- retail demo units613- special editions614- limited editions615- anniversary editions616- transparent consoles617- promotional consoles618619## 11. ARCADE & PINBALL620621Track:622623- arcade cabinets624- PCBs625- conversion kits626- marquees627- control panels628- pinball machines629- prototypes630- tournament machines631- promotional units632- replacement art633- original parts634635## 12. SNEAKERS636637Brands:638639- Nike640- Jordan641- Adidas642- Yeezy643- New Balance644- ASICS645- Reebok646- Puma647- Converse648- Vans649- Salomon650- Hoka651- BAPE652- Supreme collaborations653654Track:655656- SKU657- size658- colorway659- release date660- original retail661- resale662- deadstock663- used664- samples665- friends & family666- player editions667- prototypes668- collaborations669- region exclusives670671## 13. WATCHES672673Brands:674675- Rolex676- Patek Philippe677- Audemars Piguet678- Richard Mille679- Vacheron Constantin680- Omega681- Cartier682- Tudor683- Breitling684- IWC685- Jaeger-LeCoultre686- A. Lange & Söhne687- Breguet688- Blancpain689- Zenith690- Grand Seiko691- Seiko692- TAG Heuer693- Panerai694- Hublot695- F.P. Journe696- MB&F697- De Bethune698- Greubel Forsey699- Urwerk700701Track:702703- reference704- dial705- bracelet706- movement707- year708- production period709- serial710- papers711- box712- service history713- auction history714- provenance715716## 14. LUXURY HANDBAGS717718Brands:719720- Hermès721- Chanel722- Louis Vuitton723- Dior724- Gucci725- Goyard726- Fendi727- Bottega Veneta728- Prada729- Celine730- Loewe731- Saint Laurent732733Models:734735- Birkin736- Kelly737- Constance738- Chanel Classic Flap739- Chanel 2.55740- Louis Vuitton trunks741- Speedy742- Neverfull743- rare runway pieces744745Track:746747- leather748- hardware749- size750- year751- stamp752- condition753- color754- rarity755756## 15. FASHION & STREETWEAR757758Brands:759760- Supreme761- BAPE762- Palace763- Stüssy764- Kith765- Off-White766- Chrome Hearts767- Fear of God768- Stone Island769- Arc'teryx770- Kapital771- Visvim772- Neighborhood773- Undercover774775Track:776777- release778- season779- collaboration780- size781- condition782- retail price783- resale price784785## 16. LEGO786787Track:788789- sealed sets790- opened complete sets791- minifigures792- promotional sets793- employee exclusives794- convention exclusives795- LEGO House exclusives796- retired sets797- prototypes798799Themes:800801- Star Wars802- Technic803- Icons804- Ideas805- Architecture806- Modular Buildings807- Castle808- Pirates809- Space810- Harry Potter811- Marvel812- DC813- Lord of the Rings814- Indiana Jones815- Ninjago816- Bionicle817- Monkie Kid818819## 17. FUNKO820821Track:822823- Funko Pop824- Soda825- Wacky Wobblers826- prototypes827- convention exclusives828- chase editions829- vaulted products830- signed products831- error variants832833## 18. DESIGNER TOYS834835Brands/artists:836837- Bearbrick838- Medicom839- KAWS840- Kidrobot841- Superplastic842- Mighty Jaxx843- Pop Mart844- Labubu845- Molly846- Skullpanda847- Dimoo848- Banksy-related editions849- Murakami collectibles850851## 19. ACTION FIGURES852853Track:854855- Hot Toys856- Sideshow857- NECA858- Hasbro859- Mattel860- McFarlane861- Bandai862- Tamashii Nations863- S.H. Figuarts864- Mafex865- Mezco866- Nendoroid867- Figma868869Franchises:870871- Star Wars872- Marvel873- DC874- Transformers875- G.I. Joe876- TMNT877- Masters of the Universe878- Power Rangers879- Dragon Ball880- One Piece881- Gundam882- Pokémon883884## 20. VINTAGE TOYS885886Track:887888- Kenner889- Matchbox890- Hot Wheels891- Dinky Toys892- Corgi893- Barbie894- Fisher-Price895- LEGO vintage896- Playmobil897- Transformers898- G.I. Joe899- Star Wars900- He-Man901- TMNT902- My Little Pony903- Care Bears904- Polly Pocket905- Micro Machines906- Tamagotchi907- Furby908- Beanie Babies909910## 21. DOLLS911912Track:913914- Barbie915- Blythe916- American Girl917- Bratz918- Monster High919- antique dolls920- bisque dolls921- porcelain dolls922- artist dolls923- limited editions924925## 22. PLUSH926927Track:928929- Steiff930- Jellycat931- Pokémon932- Disney933- Sanrio934- Squishmallows935- Beanie Babies936- Build-A-Bear exclusives937- vintage plush938939## 23. MODEL CARS940941Brands:942943- Hot Wheels944- Matchbox945- Tomica946- Mini GT947- AUTOart948- Kyosho949- Minichamps950- BBR951- CMC952- Spark953- Tarmac Works954- GreenLight955- Maisto956957Scales:958959- 1:64960- 1:43961- 1:24962- 1:18963- 1:12964- 1:8965966## 24. MODEL TRAINS967968Track:969970- Märklin971- Lionel972- Hornby973- Bachmann974- Kato975- Atlas976- Fleischmann977- vintage railway models978- locomotives979- cars980- accessories981- limited sets982983## 25. AUTOMOBILES984985Collectible vehicle categories:986987- classic cars988- supercars989- hypercars990- JDM991- muscle cars992- homologation specials993- rally cars994- race cars995- concept cars996- celebrity cars997- low-production models998999Brands:10001001- Ferrari1002- Porsche1003- Lamborghini1004- McLaren1005- Bugatti1006- Pagani1007- Koenigsegg1008- Mercedes-Benz1009- BMW1010- Audi1011- Ford1012- Chevrolet1013- Dodge1014- Nissan1015- Toyota1016- Honda1017- Mazda1018- Subaru1019- Mitsubishi10201021## 26. MOTORCYCLES10221023Brands:10241025- Ducati1026- Harley-Davidson1027- Honda1028- Yamaha1029- Kawasaki1030- Suzuki1031- BMW Motorrad1032- Triumph1033- Indian1034- MV Agusta10351036Track:10371038- rare models1039- production numbers1040- race provenance1041- celebrity ownership1042- original condition10431044## 27. AUTOMOTIVE MEMORABILIA10451046Track:10471048- steering wheels1049- race-used parts1050- engines1051- badges1052- hood ornaments1053- dealership signs1054- manuals1055- brochures1056- license plates1057- racing suits1058- helmets1059- signed parts10601061## 28. FORMULA 110621063Track:10641065- race-used helmets1066- gloves1067- suits1068- bodywork1069- steering wheels1070- signed memorabilia1071- cards1072- programs1073- tickets1074- model cars1075- team-issued clothing10761077Drivers:10781079- Ayrton Senna1080- Michael Schumacher1081- Lewis Hamilton1082- Max Verstappen1083- Sebastian Vettel1084- Fernando Alonso1085- Alain Prost1086- Niki Lauda1087- future drivers dynamically10881089## 29. SPORTS MEMORABILIA10901091Sports:10921093- hockey1094- baseball1095- basketball1096- football1097- soccer1098- tennis1099- golf1100- boxing1101- UFC1102- Olympics11031104Assets:11051106- jerseys1107- game-worn jerseys1108- match-issued jerseys1109- helmets1110- gloves1111- shoes1112- balls1113- pucks1114- bats1115- sticks1116- trophies1117- medals1118- tickets1119- autographs1120- photographs11211122## 30. COINS11231124Track:11251126- ancient coins1127- Roman coins1128- Greek coins1129- medieval coins1130- US coins1131- Canadian coins1132- European coins1133- Asian coins1134- bullion coins1135- commemoratives1136- proof coins1137- mint errors1138- pattern coins11391140Grading:11411142- PCGS1143- NGC1144- ANACS1145- ICCS11461147## 31. BANKNOTES11481149Track:11501151- world currency1152- historical notes1153- rare serial numbers1154- replacement notes1155- error notes1156- specimen notes1157- proof notes1158- obsolete currency11591160## 32. STAMPS11611162Track:11631164- world stamps1165- classic issues1166- rare errors1167- inverted centers1168- first-day covers1169- postal history1170- blocks1171- sheets1172- proofs11731174## 33. BOOKS11751176Track:11771178- first editions1179- first printings1180- signed editions1181- presentation copies1182- association copies1183- manuscripts1184- illuminated manuscripts1185- incunabula1186- banned editions1187- limited editions11881189Authors across:11901191- literature1192- fantasy1193- science fiction1194- philosophy1195- economics1196- science1197- children's literature1198- comic literature11991200## 34. HISTORICAL DOCUMENTS12011202Track:12031204- letters1205- manuscripts1206- government documents1207- presidential documents1208- royal documents1209- treaties1210- maps1211- deeds1212- certificates1213- newspapers1214- telegrams1215- handwritten notes12161217## 35. AUTOGRAPHS12181219Categories:12201221- politicians1222- scientists1223- astronauts1224- musicians1225- actors1226- athletes1227- authors1228- royalty1229- entrepreneurs1230- historical personalities12311232## 36. MUSIC12331234Track:12351236- vinyl1237- shellac1238- CDs1239- cassettes1240- master tapes1241- acetates1242- test pressings1243- promo copies1244- signed albums1245- rare pressings1246- colored vinyl1247- box sets12481249Artists dynamically discovered.12501251## 37. MUSIC MEMORABILIA12521253Track:12541255- guitars1256- stage-used instruments1257- handwritten lyrics1258- posters1259- concert tickets1260- backstage passes1261- costumes1262- tour merchandise1263- signed items1264- awards1265- gold records12661267## 38. MUSICAL INSTRUMENTS12681269Track:12701271- Fender1272- Gibson1273- Martin1274- Gretsch1275- Rickenbacker1276- PRS1277- vintage synthesizers1278- Moog1279- Roland1280- Yamaha1281- Sequential1282- drum machines1283- microphones1284- effects pedals1285- amplifiers12861287## 39. MOVIE MEMORABILIA12881289Track:12901291- screen-used props1292- costumes1293- scripts1294- storyboards1295- production artwork1296- posters1297- lobby cards1298- miniatures1299- masks1300- weapons props1301- signed items13021303## 40. MOVIE POSTERS13041305Track:13061307- one sheets1308- half sheets1309- inserts1310- lobby cards1311- international posters1312- original theatrical posters1313- rare variants1314- recalled posters13151316## 41. ANIMATION ART13171318Track:13191320- production cels1321- backgrounds1322- concept art1323- key animation1324- storyboards1325- model sheets1326- signed cels13271328Studios:13291330- Disney1331- Warner Bros.1332- Studio Ghibli1333- Toei1334- Gainax1335- Madhouse1336- Production I.G1337- Pixar1338- DreamWorks13391340## 42. ART13411342Track:13431344- paintings1345- drawings1346- sculptures1347- prints1348- lithographs1349- screenprints1350- etchings1351- photographs1352- editions1353- multiples1354- artist proofs13551356## 43. CONTEMPORARY ART13571358Track artists such as:13591360- Banksy1361- KAWS1362- Takashi Murakami1363- Damien Hirst1364- Jeff Koons1365- Yayoi Kusama1366- Jean-Michel Basquiat1367- Keith Haring13681369Do not hardcode value assumptions.13701371## 44. PHOTOGRAPHY13721373Track:13741375- signed prints1376- vintage prints1377- limited editions1378- artist proofs1379- contact sheets1380- negatives1381- historic photographs13821383## 45. CAMERAS13841385Track:13861387- Leica1388- Hasselblad1389- Rolleiflex1390- Contax1391- Nikon1392- Canon1393- Olympus1394- Polaroid1395- Fujifilm13961397Include:13981399- rare bodies1400- lenses1401- prototypes1402- military cameras1403- limited editions14041405## 46. APPLE COLLECTIBLES14061407Track:14081409- Apple I1410- Apple II1411- Macintosh1412- Lisa1413- Newton1414- iMac1415- iBook1416- PowerBook1417- Power Macintosh1418- iPod1419- iPhone1420- iPad1421- Apple Watch1422- prototypes1423- engineering samples1424- sealed devices1425- packaging1426- manuals1427- posters1428- Think Different campaign items1429- employee memorabilia14301431## 47. VINTAGE COMPUTERS14321433Track:14341435- Commodore1436- Amiga1437- Atari1438- IBM1439- NeXT1440- SGI1441- DEC1442- Sun Microsystems1443- Sinclair1444- Tandy1445- TRS-801446- Altair1447- early PCs1448- early laptops14491450## 48. COMPUTER HARDWARE14511452Track collectible:14531454- CPUs1455- GPUs1456- motherboards1457- sound cards1458- development hardware1459- engineering samples1460- vintage memory1461- rare graphics accelerators1462- boxed hardware1463- first-generation hardware14641465## 49. MOBILE PHONES14661467Track:14681469- early mobile phones1470- Nokia1471- Motorola1472- BlackBerry1473- Palm1474- first-generation iPhones1475- prototypes1476- limited editions1477- sealed products14781479## 50. KEYBOARDS14801481Track:14821483- vintage IBM keyboards1484- mechanical keyboards1485- custom keyboards1486- group buys1487- artisan keycaps1488- rare switches1489- prototype boards14901491## 51. AUDIO EQUIPMENT14921493Track:14941495- turntables1496- amplifiers1497- receivers1498- tape machines1499- speakers1500- headphones1501- vacuum tube equipment1502- studio equipment15031504Brands:15051506- Marantz1507- McIntosh1508- Technics1509- Nakamichi1510- Pioneer1511- Sony1512- JBL1513- Klipsch1514- Sennheiser15151516## 52. WINE15171518Regions:15191520- Bordeaux1521- Burgundy1522- Champagne1523- Rhône1524- Loire1525- Tuscany1526- Piedmont1527- Napa1528- Rioja1529- Mosel1530- Port15311532Track:15331534- producer1535- vintage1536- bottle size1537- provenance1538- fill level1539- storage1540- auction prices1541- critic score1542- lot composition15431544## 53. WHISKY15451546Track:15471548- Scotch1549- Japanese whisky1550- bourbon1551- Irish whiskey1552- Canadian whisky1553- closed distilleries1554- limited editions1555- single casks1556- numbered releases15571558## 54. RUM15591560Track:15611562- vintage rum1563- closed distilleries1564- limited editions1565- single casks1566- historic bottlings15671568## 55. COGNAC15691570Track:15711572- vintage Cognac1573- rare houses1574- limited editions1575- historic bottles15761577## 56. PERFUME15781579Track:15801581- vintage bottles1582- discontinued fragrances1583- limited editions1584- rare formulations1585- sealed bottles1586- Lalique bottles1587- Guerlain1588- Chanel1589- Dior1590- Hermès15911592## 57. JEWELRY15931594Track:15951596- Cartier1597- Van Cleef & Arpels1598- Tiffany1599- Bulgari1600- Graff1601- Harry Winston1602- vintage jewelry1603- signed jewelry1604- Art Deco jewelry16051606## 58. GEMSTONES16071608Track:16091610- diamonds1611- colored diamonds1612- rubies1613- sapphires1614- emeralds1615- alexandrite1616- spinel1617- opal1618- jadeite16191620Capture certification and provenance.16211622## 59. MINERALS16231624Track:16251626- museum-quality specimens1627- crystals1628- rare minerals1629- type specimens1630- fluorescent minerals1631- historical specimens16321633## 60. METEORITES16341635Track:16361637- lunar meteorites1638- Martian meteorites1639- iron meteorites1640- pallasites1641- chondrites1642- witnessed falls1643- historic meteorites16441645Capture weight and classification.16461647## 61. FOSSILS16481649Track legally traded:16501651- ammonites1652- trilobites1653- dinosaur fossils1654- dinosaur teeth1655- mammoth remains1656- shark teeth1657- fish fossils1658- plant fossils16591660Include provenance and jurisdiction flags.16611662## 62. ANTIQUES16631664Categories:16651666- furniture1667- clocks1668- mirrors1669- ceramics1670- porcelain1671- silverware1672- glass1673- lighting1674- decorative arts1675- scientific instruments16761677## 63. PORCELAIN16781679Brands:16801681- Meissen1682- Sèvres1683- Wedgwood1684- Royal Copenhagen1685- Royal Worcester1686- Limoges1687- Herend16881689## 64. GLASS & CRYSTAL16901691Track:16921693- Baccarat1694- Lalique1695- Murano1696- Daum1697- Steuben1698- Waterford1699- antique glass17001701## 65. SILVER17021703Track:17041705- Tiffany1706- Christofle1707- Georg Jensen1708- sterling objects1709- antique silver1710- tea services1711- flatware17121713## 66. CLOCKS17141715Track:17161717- mantel clocks1718- carriage clocks1719- marine chronometers1720- astronomical clocks1721- grandfather clocks1722- industrial clocks1723- railway clocks17241725## 67. PENS17261727Track:17281729- Montblanc1730- Namiki1731- Pelikan1732- Parker1733- Waterman1734- Sailor1735- Aurora1736- limited editions1737- vintage fountain pens17381739## 68. LIGHTERS17401741Track:17421743- Zippo1744- S.T. Dupont1745- Dunhill1746- Cartier1747- vintage advertising lighters17481749## 69. ADVERTISING COLLECTIBLES17501751Track:17521753- Coca-Cola1754- Pepsi1755- Michelin1756- Texaco1757- Shell1758- Esso1759- automotive brands1760- tobacco historical advertising1761- neon signs1762- enamel signs1763- posters1764- clocks1765- vending machines17661767## 70. DISNEY COLLECTIBLES17681769Track:17701771- pins1772- park exclusives1773- animation art1774- figurines1775- costumes1776- props1777- attraction memorabilia1778- vintage toys1779- limited editions17801781## 71. SANRIO17821783Track:17841785- Hello Kitty1786- My Melody1787- Kuromi1788- Cinnamoroll1789- rare collaborations1790- vintage items1791- Japanese exclusives17921793## 72. STAR WARS17941795Track virtually everything collectible:17961797- toys1798- cards1799- comics1800- props1801- costumes1802- posters1803- LEGO1804- games1805- books1806- autographs1807- production memorabilia18081809## 73. MARVEL18101811Track:18121813- comics1814- cards1815- toys1816- statues1817- posters1818- movie props1819- LEGO1820- autographs18211822## 74. DC18231824Same broad collectible structure.18251826## 75. HARRY POTTER18271828Track:18291830- books1831- first editions1832- props1833- costumes1834- LEGO1835- cards1836- wands1837- signed memorabilia18381839## 76. LORD OF THE RINGS18401841Track:18421843- books1844- first editions1845- props1846- miniatures1847- collectibles1848- autographs1849- LEGO18501851## 77. WARHAMMER18521853Track:18541855- miniatures1856- discontinued models1857- boxed armies1858- limited editions1859- Forge World1860- painted armies1861- tournament-winning armies1862- books1863- rulebooks1864- vintage miniatures18651866## 78. GUNDAM18671868Track:18691870- Gunpla1871- Perfect Grade1872- Master Grade1873- Real Grade1874- limited editions1875- event exclusives1876- Premium Bandai1877- vintage kits18781879## 79. TRAVEL COLLECTIBLES18801881Track:18821883- postcards1884- magnets1885- hotel memorabilia1886- airline memorabilia1887- cruise memorabilia1888- travel posters1889- luggage labels1890- tickets18911892## 80. AIRLINE COLLECTIBLES18931894Track:18951896- safety cards1897- menus1898- uniforms1899- aircraft models1900- amenity kits1901- china1902- silverware1903- seats1904- signs1905- retired airline memorabilia19061907## 81. AVIATION19081909Track:19101911- aircraft parts1912- cockpit instruments1913- propellers1914- aircraft models1915- pilot equipment1916- military aviation memorabilia1917- historic documentation19181919## 82. SPACE19201921Track:19221923- NASA memorabilia1924- mission patches1925- astronaut autographs1926- flown items1927- spacecraft components1928- mission documentation1929- Apollo memorabilia1930- Shuttle memorabilia1931- Soviet space memorabilia19321933## 83. MILITARIA19341935Track legal historical collectibles:19361937- medals1938- uniforms1939- helmets1940- insignia1941- documents1942- patches1943- flags1944- equipment1945- trench art19461947Compliance restrictions must be implemented.19481949## 84. MEDALS19501951Track:19521953- military decorations1954- Olympic medals1955- sporting medals1956- civic medals1957- commemorative medals19581959## 85. OLYMPIC COLLECTIBLES19601961Track:19621963- medals1964- torches1965- pins1966- tickets1967- posters1968- uniforms1969- mascots1970- signed memorabilia19711972## 86. MAPS19731974Track:19751976- antique maps1977- atlases1978- globes1979- exploration maps1980- nautical charts1981- city plans1982- railway maps19831984## 87. POSTCARDS19851986Track:19871988- real photo postcards1989- historic cities1990- disasters1991- transportation1992- military1993- exhibitions1994- world's fairs19951996## 88. LICENSE PLATES19971998Track:19992000- antique plates2001- low numbers2002- vanity plates2003- diplomatic plates2004- historic jurisdictions2005- rare designs20062007## 89. PIN COLLECTIONS20082009Track:20102011- Disney2012- Olympics2013- Hard Rock2014- political2015- corporate2016- travel2017- military2018- sports2019- conventions20202021## 90. BOARD GAMES20222023Track:20242025- first editions2026- discontinued games2027- Kickstarter editions2028- prototypes2029- deluxe editions2030- signed editions20312032## 91. CHESS20332034Track:20352036- antique chess sets2037- tournament sets2038- artist sets2039- luxury sets2040- signed boards2041- historic pieces20422043## 92. PLAYING CARDS20442045Track:20462047- casino decks2048- designer decks2049- historical decks2050- rare printing variants2051- sealed decks20522053## 93. CASINO MEMORABILIA20542055Only where legally appropriate:20562057- casino chips2058- tokens2059- playing cards2060- signs2061- historic casino items20622063## 94. POLITICAL MEMORABILIA20642065Track historically significant:20662067- campaign buttons2068- posters2069- signs2070- signed documents2071- inauguration memorabilia2072- ballots2073- campaign literature20742075Neutral presentation only.20762077## 95. ROYAL MEMORABILIA20782079Track:20802081- coronation items2082- signed photographs2083- correspondence2084- porcelain2085- medals2086- royal warrants2087- ceremonial objects20882089## 96. SCIENTIFIC INSTRUMENTS20902091Track:20922093- microscopes2094- telescopes2095- laboratory instruments2096- calculators2097- slide rules2098- surveying instruments2099- navigational instruments21002101## 97. TYPEWRITERS21022103Track:21042105- Underwood2106- Olivetti2107- IBM2108- Royal2109- Hermes2110- rare models2111- author-owned machines21122113## 98. VENDING MACHINES21142115Track:21162117- Coca-Cola2118- Pepsi2119- candy machines2120- cigarette machines2121- arcade vending2122- antique dispensers21232124## 99. HISTORIC CORPORATE MEMORABILIA21252126Track:21272128- early company stock certificates2129- employee badges2130- promotional objects2131- prototypes2132- corporate gifts2133- early packaging21342135## 100. DIGITAL COLLECTIBLES21362137Potentially support separately:21382139- NFTs2140- blockchain collectibles2141- tokenized physical assets2142- game skins2143- CS skins2144- digital trading cards2145- virtual items21462147These markets require a separate valuation model due to extreme volatility.21482149## 101. FUTURE CATEGORY DISCOVERY21502151RareIndex must automatically discover new collectible categories.21522153Create an AI workflow that:215421551. crawls marketplaces21562. identifies recurring product clusters21573. detects categories not represented in the taxonomy21584. measures transaction volume21595. proposes new taxonomy nodes21606. sends proposed categories to an admin queue21617. allows approval21628. automatically generates source connectors and schemas21632164The taxonomy must evolve continuously.21652166## 102. CONNECTOR ARCHITECTURE21672168RareIndex requires a professional connector framework.21692170Every source must use a standardized connector interface.21712172Example conceptual interface:21732174```ts2175interface RareIndexConnector {2176 id: string2177 name: string2178 category: string[]2179 countries: string[]2180 languages: string[]2181 crawl(): Promise<RawRecord[]>2182 normalize(records: RawRecord[]): Promise<NormalizedRecord[]>2183 healthCheck(): Promise<ConnectorHealth>2184}2185```21862187## 103. FIRECRAWL21882189Firecrawl should be the preferred connector engine for websites that can be reliably parsed using:21902191- HTML2192- markdown extraction2193- structured data extraction2194- sitemap discovery2195- page crawling2196- search2197- dynamic rendering where supported21982199Use Firecrawl for:22002201- category pages2202- search results2203- public catalog pages2204- auction archives2205- sold-item databases2206- dealer inventory2207- pricing guides2208- manufacturer archives2209- grading information2210- collectible encyclopedias2211- editorial market data22122213Firecrawl output should be converted into canonical JSON.22142215## 104. SCRAPFLY22162217Scrapfly should act as:221822191. secondary extraction engine22202. difficult-site connector22213. dynamic rendering layer22224. proxy/geo routing layer22235. anti-bot-compatible access layer where legally permitted22246. fallback when ordinary extraction fails22252226Routing logic:22272228```2229Direct API2230 ↓2231Structured Feed2232 ↓2233Firecrawl2234 ↓2235Scrapfly2236 ↓2237Browser Extraction2238 ↓2239Manual Review2240```22412242Do NOT attempt to circumvent authentication, paywalls, CAPTCHAs, access controls, or other security protections unlawfully.22432244Respect:22452246- applicable laws2247- source terms2248- robots policies where applicable2249- copyright2250- privacy2251- rate limits2252- authentication boundaries22532254## 105. CONNECTOR FALLBACK ENGINE22552256Every connector should produce health metrics:22572258```json2259{2260 "connector": "example",2261 "status": "healthy",2262 "success_rate_24h": 0.982,2263 "pages_attempted": 18752,2264 "pages_success": 18414,2265 "firecrawl_success_rate": 0.91,2266 "scrapfly_fallback_rate": 0.07,2267 "parse_failure_rate": 0.02,2268 "last_success": "timestamp",2269 "schema_version": "3.2"2270}2271```22722273Automatically detect:22742275- page redesigns2276- selector failures2277- missing fields2278- duplicate explosion2279- abnormal price distributions2280- blocked requests2281- empty pages2282- unexpected redirects2283- currency parsing problems22842285## 106. CONNECTOR REGISTRY22862287Create:22882289/connectors/registry.json22902291Each connector:22922293```json2294{2295 "id": "source-id",2296 "displayName": "Source",2297 "sourceType": "marketplace",2298 "enginePriority": [2299 "api",2300 "firecrawl",2301 "scrapfly"2302 ],2303 "categories": [],2304 "regions": [],2305 "languages": [],2306 "currency": [],2307 "supportsListings": true,2308 "supportsSold": true,2309 "supportsAuctions": false,2310 "supportsImages": true,2311 "refreshFrequencyMinutes": 302312}2313```23142315## 107. SOURCE TYPES23162317Support:23182319- marketplace2320- auction_house2321- dealer2322- pricing_guide2323- grading_company2324- manufacturer2325- museum2326- archive2327- catalog2328- collector_database2329- community2330- forum2331- news2332- analytics_provider2333- registry2334- official_source23352336## 108. RAW INGESTION LAYER23372338Never directly write scraped records into final product tables.23392340Pipeline:23412342```2343Source2344 ↓2345Raw HTML/API payload2346 ↓2347Extraction2348 ↓2349Raw JSON2350 ↓2351Normalization2352 ↓2353Entity Resolution2354 ↓2355Deduplication2356 ↓2357Price Validation2358 ↓2359Canonical Asset Match2360 ↓2361Sale/Listing Database2362 ↓2363Indices & Analytics2364```23652366Raw records should be immutable.23672368## 109. CANONICAL ASSET MODEL23692370Example:23712372```json2373{2374 "asset_id": "rare_xxxxx",2375 "category": "trading_cards",2376 "subcategory": "pokemon",2377 "brand": "Pokemon",2378 "franchise": "Pokemon",2379 "set": "Base Set",2380 "name": "Charizard",2381 "year": 1999,2382 "number": "4/102",2383 "variant": "1st Edition Holo",2384 "language": "English",2385 "grade": 10,2386 "grader": "PSA",2387 "certification_number": null,2388 "population": null,2389 "rarity": null,2390 "images": [],2391 "identifiers": {},2392 "metadata": {}2393}2394```23952396## 110. SALE MODEL23972398```json2399{2400 "sale_id": "sale_xxxxx",2401 "asset_id": "rare_xxxxx",2402 "source": "source",2403 "source_url": "",2404 "sale_type": "auction",2405 "sale_date": "",2406 "sale_price": 0,2407 "currency": "USD",2408 "sale_price_usd": 0,2409 "buyer_premium_included": false,2410 "condition": "",2411 "grade": "",2412 "location": "",2413 "image_urls": [],2414 "raw_title": "",2415 "confidence": 0.982416}2417```24182419## 111. LISTING MODEL24202421Track:24222423- asking price2424- seller2425- source2426- location2427- shipping2428- condition2429- grade2430- listing date2431- update date2432- availability2433- quantity2434- seller reputation where public2435- images2436- description24372438Listing price MUST NOT automatically equal market value.24392440## 112. ENTITY RESOLUTION24412442This is one of the most important parts of RareIndex.24432444Different sources may describe the same collectible differently.24452446Example:24472448```24491999 Pokemon Base Charizard 1st PSA 1024502451Pokémon 1999 First Edition Charizard Holo PSA GEM MT 10245224531999 Pokemon Game Charizard-Holo #4 PSA 102454```24552456These must resolve to the same canonical asset variant.24572458Use:24592460- deterministic identifiers2461- manufacturer model numbers2462- card numbers2463- sets2464- release year2465- UPC2466- ISBN2467- SKU2468- certification2469- serial2470- visual similarity2471- text embeddings2472- multimodal embeddings2473- LLM verification24742475## 113. IMAGE INTELLIGENCE24762477Images are fundamental.24782479Build image pipelines for:24802481- duplicate detection2482- visual identification2483- edition recognition2484- card recognition2485- shoe identification2486- watch reference recognition2487- LEGO identification2488- comic issue recognition2489- coin recognition2490- autograph comparison2491- condition estimation2492- box/seal recognition24932494Generate multimodal embeddings.24952496Store vectors in a vector database.24972498## 114. RAREINDEX SCANNER24992500Allow users to:25012502- upload a photo2503- take a smartphone photo2504- upload multiple photos2505- paste marketplace URL25062507RareIndex AI should estimate:25082509- category2510- item2511- edition2512- year2513- variation2514- likely condition2515- grade range where reasonable2516- rarity2517- market value2518- price range2519- latest sales2520- comparable sales2521- current listings25222523Never claim professional authentication from AI alone.25242525Display confidence.25262527## 115. PRICE ENGINE25282529Never use only the average price.25302531Calculate:25322533- latest sale2534- median 5 sales2535- median 10 sales2536- median 20 sales2537- volume-weighted price2538- trimmed mean2539- exponentially weighted price2540- comparable-adjusted price2541- grade-adjusted price2542- condition-adjusted price25432544RareIndex Fair Value:25452546RIV = RareIndex Valuation25472548Display:25492550- RIV2551- low estimate2552- high estimate2553- confidence score25542555## 116. OUTLIER DETECTION25562557Remove or flag:25582559- obvious data errors2560- fake sales2561- cancelled auctions2562- bundle sales2563- incomplete items2564- incorrectly identified items2565- extremely abnormal prices2566- suspicious self-trades where detectable25672568Never silently delete data.25692570Maintain audit logs.25712572## 117. CONDITION NORMALIZATION25732574Build category-specific condition scales.25752576Cards:25772578- raw2579- graded25802581Games:25822583- loose2584- CIB2585- sealed2586- graded25872588Sneakers:25892590- new2591- deadstock2592- lightly used2593- used25942595Watches:25962597- unworn2598- excellent2599- good2600- fair2601- poor2602- parts26032604Books:26052606- fine2607- very good2608- good2609- fair2610- poor26112612Use category schemas.26132614## 118. GRADING NORMALIZATION26152616Track grading company separately.26172618Never treat:26192620PSA 10 == BGS 10 == CGC 1026212622automatically.26232624Measure market premiums empirically.26252626Example:26272628```json2629{2630 "grader": "PSA",2631 "grade": "10",2632 "market_multiplier": 2.31,2633 "sample_size": 1482634}2635```26362637## 119. POPULATION REPORTS26382639Where grading population data is available, calculate:26402641- total graded population2642- population by grade2643- gem rate2644- highest grade2645- grade scarcity2646- population growth26472648Create:26492650Population Momentum26512652to show whether supply is expanding rapidly.26532654## 120. RARITY SCORE26552656Create a RareIndex Rarity Score:265726580–10026592660Possible factors:26612662- production quantity2663- surviving population2664- graded population2665- number listed2666- listing frequency2667- sale frequency2668- historical scarcity2669- variant rarity2670- production errors2671- region exclusivity2672- promotional distribution26732674Do not fabricate production counts.26752676Use unknown when unavailable.26772678## 121. LIQUIDITY SCORE26792680RareIndex Liquidity Score26812682Factors:26832684- transactions per month2685- number of marketplaces2686- number of active listings2687- bid depth if available2688- sale frequency2689- days between transactions2690- spread between asking and sold prices26912692Scale:269326940–10026952696## 122. MOMENTUM SCORE26972698Measure:26992700- 7d2701- 30d2702- 90d2703- 1y27042705Use:27062707- price acceleration2708- transaction acceleration2709- search interest2710- listing velocity2711- auction activity27122713## 123. VALUE OPPORTUNITY SCORE27142715Detect collectibles where listings are materially below estimated fair value.27162717Example:27182719```2720RIV Fair Value $3,8502721Current Listing $2,9502722Discount -23.4%2723Confidence 91%2724```27252726Label this as analytical data, not investment advice.27272728## 124. MARKET CAPITALIZATION27292730Estimate collectible market capitalization cautiously.27312732Possible methods:27332734Estimated population × representative market value27352736Must display methodology and confidence.27372738Never imply impossible precision.27392740## 125. CATEGORY MARKET PAGES27412742Example:27432744/markets/pokemon27452746Display:27472748- market index2749- market cap estimate2750- volume2751- number of sales2752- top gainers2753- top losers2754- highest volume2755- trending2756- biggest auctions2757- most expensive cards2758- newest records2759- population trends2760- listings2761- news27622763## 126. ASSET PAGE27642765Every collectible should get a world-class asset page.27662767Header:27682769- title2770- hero image2771- category2772- year2773- variant2774- grade27752776Metrics:27772778- RareIndex Fair Value2779- latest sale2780- daily change2781- 30-day change2782- 1-year change2783- all-time high2784- all-time low2785- liquidity2786- rarity2787- active listings2788- sales last 30d27892790Charts:27912792- price history2793- transaction volume2794- active listings2795- grade distribution2796- population history2797- marketplace distribution27982799Tabs:28002801- Overview2802- Sales2803- Listings2804- Grades2805- Population2806- Images2807- History2808- Comparables2809- AI Analysis2810- Sources28112812## 127. GLOBAL SEARCH28132814Search must handle natural-language requests.28152816Examples:28172818```28191999 Charizard PSA 102820Rolex Daytona Panda2821sealed Mario 642822first edition Harry Potter UK2823Michael Jordan rookie PSA 102824LEGO Millennium Falcon retired2825```28262827Search across:28282829- canonical assets2830- listings2831- historical sales2832- categories2833- brands2834- franchises2835- sets2836- auction houses28372838## 128. AI SEARCH28392840Provide a conversational research interface.28412842Examples:28432844```2845Find Pokémon cards under $5,000 that have increased more than 30% in the last year.2846Compare Rolex Daytona versus Patek Nautilus over five years.2847Find sealed Nintendo games with fewer than 20 public sales in the last year.2848What collectible category has the strongest momentum this month?2849```28502851AI must query structured internal data instead of hallucinating.28522853## 129. COLLECTION PORTFOLIO28542855Users can create portfolios.28562857Track:28582859- acquisition date2860- purchase price2861- source2862- grade2863- serial/cert2864- photos2865- notes2866- current estimated value2867- gain/loss2868- portfolio allocation2869- category exposure28702871Dashboard:28722873```2874Collection Value $127,4502875Cost Basis $91,2002876Unrealized Gain $36,2502877Return 39.7%2878```28792880## 130. COLLECTION ANALYTICS28812882Show:28832884- historical portfolio value2885- category diversification2886- concentration2887- best performer2888- worst performer2889- liquidity2890- rarity distribution2891- grading distribution28922893## 131. WATCHLIST28942895Users can watch:28962897- assets2898- categories2899- brands2900- sets2901- marketplaces2902- auctions29032904## 132. ALERTS29052906Alerts:29072908- price below threshold2909- price above threshold2910- new listing2911- new auction2912- auction ending2913- new record sale2914- unusual volume2915- market move2916- rare item appearance2917- population update29182919## 133. AUCTION CALENDAR29202921Aggregate upcoming auctions.29222923Views:29242925- today2926- this week2927- this month29282929Filters:29302931- category2932- auction house2933- price2934- region29352936## 134. COMPARABLE SALES29372938Every valuation should expose comps.29392940For each comparable:29412942- image2943- item2944- sale date2945- sale amount2946- source2947- grade2948- condition2949- similarity score29502951## 135. PRICE DISTRIBUTION29522953Show:29542955- minimum2956- 25th percentile2957- median2958- 75th percentile2959- maximum2960- trimmed mean29612962Avoid hiding dispersion.29632964## 136. CURRENCY29652966Store:29672968- native transaction currency2969- historical FX rate2970- normalized USD2971- normalized CAD2972- EUR2973- GBP2974- JPY29752976Allow users to choose display currency.29772978Never convert historical sales using today's exchange rate.29792980## 137. INTERNATIONALIZATION29812982Support later:29832984- English2985- French2986- Japanese2987- Spanish2988- German2989- Italian2990- Chinese2991- Korean29922993Canonical data remains language neutral.29942995## 138. SEARCH INFRASTRUCTURE29962997Use a hybrid search system:29982999- PostgreSQL3000- full-text search3001- vector search3002- optional OpenSearch/Elasticsearch at scale30033004Ranking combines:30053006- semantic relevance3007- lexical relevance3008- popularity3009- category match3010- historical volume3011- recency30123013## 139. DATABASE30143015Recommended:30163017- PostgreSQL3018- TimescaleDB where useful3019- object storage3020- Redis3021- vector storage30223023Core tables:30243025- assets3026- variants3027- brands3028- franchises3029- categories3030- listings3031- sales3032- auctions3033- sources3034- connectors3035- grades3036- population_reports3037- price_snapshots3038- valuations3039- indices3040- users3041- collections3042- collection_items3043- watchlists3044- alerts3045- images30463047## 140. EVENT-DRIVEN PIPELINE30483049Use queues.30503051Possible stack:30523053- Redis Streams3054- BullMQ3055- Kafka at larger scale30563057Events:30583059- page_discovered3060- page_crawled3061- listing_created3062- listing_updated3063- sale_detected3064- entity_matched3065- valuation_updated3066- index_updated30673068## 141. CRAWL SCHEDULING30693070Refresh cadence based on source importance.30713072Examples:30733074High-frequency:30753076- active marketplaces3077- auctions ending soon3078- major card markets30793080Medium-frequency:30813082- dealers3083- auction catalogs3084- grading data30853086Low-frequency:30873088- historical archives3089- manufacturer catalogs30903091Dynamic scheduling should prioritize sources with changing data.30923093## 142. DATA PROVENANCE30943095Every displayed data point should be traceable.30963097Store:30983099- source3100- URL3101- crawl timestamp3102- original currency3103- parsed value3104- normalized value3105- parser version3106- connector version31073108## 143. SOURCE TRUST SCORE31093110Score each source.31113112Factors:31133114- official source3115- historical consistency3116- sale verification3117- price reliability3118- duplicate rates3119- error rates31203121## 144. ADMIN CONNECTOR CENTER31223123Create internal page:31243125/admin/connectors31263127Display:31283129- connector3130- health3131- pages/min3132- errors3133- last crawl3134- records3135- duplicates3136- Firecrawl rate3137- Scrapfly rate3138- parser confidence3139- schema drift31403141Buttons:31423143- run3144- pause3145- retry3146- inspect3147- recrawl3148- edit mapping31493150## 145. AI CONNECTOR REPAIR31513152When extraction breaks:315331541. capture failed HTML31552. capture screenshot if permitted31563. compare old/new structure31574. ask LLM to identify schema changes31585. generate suggested parser patch31596. run fixture tests31607. deploy only after validation31613162## 146. CONNECTOR TEST SUITE31633164Every source connector requires fixtures.31653166Tests:31673168- title extraction3169- price extraction3170- currency extraction3171- date extraction3172- image extraction3173- pagination3174- sold status3175- auction status3176- canonical URL3177- duplicate handling31783179## 147. MARKETPLACE DEDUPLICATION31803181The same collectible may be cross-listed.31823183Detect using:31843185- title similarity3186- seller3187- images3188- price3189- serial numbers3190- descriptions3191- timestamps31923193Generate:31943195cross_listing_group_id31963197## 148. IMAGE DEDUPLICATION31983199Compute:32003201- perceptual hash3202- image embedding3203- similarity32043205Detect reused marketplace photos.32063207## 149. FRAUD SIGNALS32083209RareIndex can surface analytical warnings:32103211- suspiciously low price3212- stolen/reused image likelihood3213- newly created seller when available3214- inconsistent description3215- wrong variant3216- fake certification formatting3217- duplicate certification32183219Never claim definitive fraud without evidence.32203221## 150. DATA QUALITY SCORE32223223Every record should receive:32243225Data Quality: 0–10032263227Factors:32283229- source trust3230- field completeness3231- entity confidence3232- image match3233- date confidence3234- price confidence32353236## 151. MARKET HEATMAP32373238Create a visual global market map.32393240Show performance by category.32413242Example:32433244```3245Pokemon +12.4%3246Sports Cards +4.8%3247Watches -2.1%3248Sneakers -7.3%3249LEGO +9.7%3250Video Games +6.1%3251Comics +3.5%3252Coins +1.2%3253```32543255## 152. TRENDING ALGORITHM32563257Score:32583259```3260Trending =3261Price Momentum3262× Volume Momentum3263× Search Momentum3264× Listing Momentum3265× News Momentum3266```32673268Normalize values.32693270## 153. RAREINDEX 10032713272Create:32733274RareIndex 10032753276The 100 most important collectible assets globally.32773278Potential categories represented:32793280- cards3281- watches3282- sneakers3283- LEGO3284- games3285- comics3286- coins3287- luxury goods3288- art3289- cars32903291Do not select based purely on price.32923293Consider:32943295- liquidity3296- historical importance3297- data availability3298- global recognition3299- transaction frequency33003301## 154. RECORD SALES33023303Create:33043305/records33063307Track:33083309- highest collectible sale3310- highest Pokémon sale3311- highest sports card sale3312- highest game sale3313- highest comic sale3314- highest LEGO sale3315- highest watch sale3316- highest sneaker sale33173318Use verified transactions only.33193320## 155. NEWLY DISCOVERED ITEMS33213322Create:33233324Rare Radar33253326Detect:33273328- first listing in years3329- ultra-low population3330- rare auction appearance3331- unusual price discrepancy3332- previously undocumented variation33333334## 156. MARKET NEWS33353336Aggregate relevant collectible news.33373338Categories:33393340- auction results3341- record sales3342- grading changes3343- new releases3344- market trends3345- discoveries3346- collector events33473348AI summarize with links to source.33493350## 157. PUBLIC API33513352Future API:33533354```3355GET /v1/assets/search3356GET /v1/assets/:id3357GET /v1/assets/:id/sales3358GET /v1/assets/:id/listings3359GET /v1/assets/:id/history3360GET /v1/categories3361GET /v1/indices3362GET /v1/markets3363GET /v1/trending3364```33653366## 158. API TIERS33673368Possible:33693370- free3371- hobby3372- professional3373- research3374- enterprise33753376Rate limits configurable.33773378## 159. DATA EXPORT33793380Allow exports:33813382- CSV3383- JSON3384- Excel3385- PDF reports33863387Professional users may export historical comps.33883389## 160. DESIGN LANGUAGE33903391RareIndex must look like an institutional financial platform blended with a modern luxury marketplace.33923393Avoid:33943395- childish marketplace design3396- excessive gradients3397- crypto-style visual noise3398- giant empty cards3399- excessive rounded corners3400- generic AI SaaS appearance34013402Target aesthetic:34033404- Bloomberg3405- Sotheby's3406- Christie's3407- StockX3408- Linear3409- Stripe3410- Apple3411- modern financial terminals34123413## 161. COLOR SYSTEM34143415Suggested neutral base:34163417- white3418- off-white3419- near-black3420- dark charcoal3421- subtle gray34223423Use accent colors only for:34243425- gains3426- losses3427- index identity3428- rarity3429- alerts34303431Support dark mode.34323433## 162. HOMEPAGE34343435Hero:34363437The Global Market for Collectibles34383439Subtitle:34403441Discover, price, track and analyze collectible assets across the world's marketplaces and auction houses.34423443Search field:34443445Search cards, watches, games, sneakers, LEGO, art...34463447Below hero:34483449- RareIndex Global3450- total tracked assets3451- indexed sales3452- marketplaces3453- latest transactions3454- trending categories34553456## 163. HOMEPAGE LIVE TAPE34573458Create a financial-style ticker.34593460Example:34613462```3463RARE GLOBAL +1.28%3464POKÉMON +3.42%3465WATCHES -0.71%3466LEGO +2.11%3467COMICS +0.39%3468VIDEO GAMES +1.74%3469```34703471## 164. DISCOVERY GRID34723473Homepage sections:34743475- Trending Now3476- Biggest Movers3477- Record Sales3478- Rare Finds3479- Auctions Ending Soon3480- Most Watched3481- Newly Added3482- Market Insights34833484## 165. MOBILE DESIGN34853486Mobile is not an afterthought.34873488Must support:34893490- camera scanner3491- swipeable charts3492- watchlists3493- collection tracking3494- price alerts3495- instant search3496- compact market cards34973498Target:34993500excellent experience on modern iPhone and Android devices.35013502## 166. PERFORMANCE35033504Targets:35053506- homepage interactive under 2 seconds on fast connection3507- cached search results under 300 ms where possible3508- optimized image delivery3509- lazy loading3510- server rendering3511- aggressive CDN caching35123513## 167. TECH STACK35143515Recommended:35163517Frontend:35183519- Next.js3520- TypeScript3521- React3522- Tailwind3523- shadcn/ui3524- TanStack Query3525- TanStack Table35263527Backend:35283529- Node.js/TypeScript or Python services3530- PostgreSQL3531- Redis3532- object storage3533- queue workers35343535Scraping:35363537- Firecrawl3538- Scrapfly35393540AI:35413542provider abstraction supporting multiple models.35433544Do not lock the architecture to one AI vendor.35453546## 168. AI MODEL ROUTER35473548Create abstraction:35493550```ts3551interface ModelProvider {3552 complete()3553 extract()3554 embed()3555 vision()3556}3557```35583559Possible roles:35603561Fast/cheap models:35623563- normalization3564- classification3565- schema matching35663567Strong models:35683569- difficult entity resolution3570- connector repair3571- research3572- image analysis35733574## 169. COST CONTROL35753576Track AI and crawler cost per:35773578- connector3579- category3580- source3581- record3582- user3583- API endpoint35843585Create:35863587/admin/costs35883589## 170. SCRAPING BUDGET ENGINE35903591Avoid recrawling unchanged content.35923593Use:35943595- ETag3596- Last-Modified3597- content hashing3598- URL fingerprinting3599- change frequency estimates36003601## 171. CHANGE DETECTION36023603For listing pages:36043605```3606New Listing3607Price Changed3608Sold3609Removed3610Relisted3611Auction Ended3612```36133614Store event history.36153616## 172. HISTORICAL DATA BACKFILL36173618RareIndex should aggressively build historical datasets from legitimate publicly accessible archives.36193620Store raw source timestamps.36213622Never pretend crawl date equals sale date.36233624## 173. SEO36253626Generate indexable pages for:36273628- collectible3629- set3630- product3631- model3632- category3633- brand3634- year3635- marketplace3636- auction3637- price history36383639Example:36403641/pokemon/1999-base-set-charizard-4-1st-edition36423643Metadata:36443645- title3646- canonical description3647- latest price3648- chart preview36493650## 174. STRUCTURED DATA36513652Use Schema.org where applicable:36533654- Product3655- Offer3656- AggregateOffer3657- CollectionPage3658- Article3659- BreadcrumbList36603661## 175. USER AUTHENTICATION36623663Support:36643665- email3666- Google3667- Apple3668- passkeys36693670## 176. USER PRIVACY36713672Do not sell private collection data.36733674Private collections remain private by default.36753676Allow explicit public portfolio option.36773678## 177. COMPLIANCE36793680RareIndex is an information platform.36813682Required disclaimers:36833684- valuations are estimates3685- listing prices are not confirmed transactions3686- past performance does not guarantee future results3687- RareIndex does not authenticate items unless explicitly offering a separate verified authentication service36883689Respect:36903691- copyright3692- trademarks3693- privacy3694- database rights3695- marketplace terms3696- auction terms3697- API agreements3698- applicable scraping laws3699- regional regulations37003701## 178. SOURCE ATTRIBUTION37023703Show source attribution where necessary.37043705Do not falsely represent third-party content as RareIndex-owned.37063707## 179. PROHIBITED AUTOMATION37083709Do not build systems designed to:37103711- bypass login requirements3712- evade paywalls3713- defeat CAPTCHA protections3714- evade explicit authentication controls3715- access private user accounts3716- scrape private personal data3717- circumvent technical restrictions unlawfully37183719Firecrawl and Scrapfly are extraction infrastructure, not authorization to violate access restrictions.37203721## 180. PHASE 137223723Build foundation.37243725Categories:372637271. Pokémon37282. Sports Cards37293. Magic37304. Yu-Gi-Oh!37315. Watches37326. Sneakers37337. LEGO37348. Comics37359. Video Games373610. Funko / Designer Toys37373738Build:37393740- canonical models3741- connectors3742- sale ingestion3743- listings3744- search3745- price engine3746- asset pages3747- category pages37483749## 181. PHASE 237503751Add:37523753- coins3754- luxury handbags3755- wine3756- whisky3757- cars3758- music3759- toys3760- books3761- art37623763Add:37643765- portfolio3766- alerts3767- scanner3768- RareIndex indices37693770## 182. PHASE 337713772Expand toward all collectible categories.37733774Add:37753776- AI category discovery3777- international sources3778- API3779- institutional analytics3780- historical backfills3781- research terminal37823783## 183. PHASE 437843785RareIndex Terminal.37863787Advanced screens:37883789- market screener3790- correlation matrix3791- liquidity scanner3792- volatility ranking3793- historical returns3794- collectible factor analysis3795- price anomaly scanner37963797## 184. RAREINDEX SCREENER37983799Filters:38003801- category3802- price3803- market cap3804- rarity3805- liquidity3806- 7d performance3807- 30d performance3808- 1y performance3809- transaction volume3810- population3811- listings38123813## 185. COLLECTIBLE FACTORS38143815Potential factors:38163817- scarcity3818- brand3819- nostalgia3820- age3821- liquidity3822- momentum3823- grading3824- provenance3825- celebrity relevance3826- franchise strength38273828Research relationships without presenting causality unless supported.38293830## 186. CORRELATION ENGINE38313832Calculate collectible category correlation.38333834Example matrix:38353836```3837 Cards Watches LEGO Games Art3838Cards 1.003839Watches 0.21 1.003840LEGO 0.38 0.14 1.003841Games 0.61 0.09 0.42 1.003842Art 0.08 0.37 0.10 0.05 1.003843```38443845## 187. BENCHMARKING38463847Allow comparison against:38483849- S&P 5003850- NASDAQ3851- gold3852- Bitcoin3853- inflation3854- real estate indices38553856Clearly explain differences in liquidity and methodology.38573858## 188. DATA SCIENCE38593860Research models:38613862- hedonic pricing3863- nearest-neighbor comps3864- gradient boosting3865- Bayesian valuation3866- time-series smoothing3867- repeat-sales indices3868- hierarchical models3869- multimodal embeddings38703871## 189. HEDONIC PRICING38723873Useful for:38743875- watches3876- cards3877- cars3878- sneakers3879- LEGO3880- games38813882Features can capture:38833884- age3885- edition3886- grade3887- rarity3888- brand3889- franchise3890- set3891- production3892- condition38933894## 190. REPEAT-SALES INDEX38953896When the same identifiable asset trades multiple times, use repeat-sales methods to reduce composition bias.38973898## 191. DATA CONFIDENCE38993900Every RareIndex statistic should have:39013902- sample size3903- confidence3904- last update39053906Example:39073908```3909RareIndex Value39103911$8,45039123913Confidence: High3914Sales Used: 373915Last Updated: 4 minutes ago3916```39173918## 192. DO NOT INVENT DATA39193920Absolute rule.39213922Never fabricate:39233924- sale prices3925- production counts3926- grading populations3927- market caps3928- auctions3929- listing availability39303931When data is missing:39323933Data unavailable39343935is better than hallucination.39363937## 193. OBSERVABILITY39383939Use:39403941- structured logs3942- traces3943- metrics3944- error reporting39453946Track:39473948- crawl latency3949- parsing errors3950- DB latency3951- AI cost3952- connector health3953- queue lag3954- valuation failures39553956## 194. SECURITY39573958Use:39593960- strict secrets management3961- server-side API credentials3962- encryption in transit3963- encryption at rest where appropriate3964- rate limits3965- abuse prevention3966- input validation39673968Never expose:39693970- Firecrawl keys3971- Scrapfly keys3972- AI keys3973- database credentials39743975## 195. REPOSITORY STRUCTURE39763977Suggested:39783979```3980rareindex/3981├── apps/3982│ ├── web/3983│ ├── api/3984│ └── admin/3985│3986├── packages/3987│ ├── database/3988│ ├── taxonomy/3989│ ├── valuation/3990│ ├── search/3991│ ├── indices/3992│ ├── ai/3993│ ├── connectors/3994│ └── shared/3995│3996├── workers/3997│ ├── crawler/3998│ ├── normalizer/3999│ ├── entity-resolution/4000│ ├── valuation/4001│ ├── image-processing/4002│ └── indices/4003│4004├── connectors/4005│ ├── firecrawl/4006│ ├── scrapfly/4007│ ├── api/4008│ ├── feeds/4009│ └── registry.json4010│4011├── data/4012│ ├── taxonomy/4013│ └── fixtures/4014│4015├── docs/4016├── scripts/4017└── CLAUDE.md4018```40194020## 196. ENGINEERING RULES FOR CLAUDE CODE40214022When implementing RareIndex:402340241. Inspect the existing repository first.40252. Never overwrite working functionality unnecessarily.40263. Prefer reusable abstractions.40274. Avoid monolithic files.40285. Keep connector logic isolated.40296. Keep source-specific logic outside the canonical domain model.40307. Add tests for every connector.40318. Add migrations for DB changes.40329. Keep TypeScript strict.403310. Validate external payloads.403411. Use Zod or equivalent schemas.403512. Log extraction failures.403613. Never swallow exceptions silently.403714. Build responsive UI from the beginning.403815. Optimize database indexes.403916. Avoid premature microservices unless scale requires them.404017. Document major architectural decisions.404118. Never hardcode credentials.404219. Never invent fake production data.404320. Preserve traceability from every normalized datapoint to its source.40444045## 197. CONNECTOR IMPLEMENTATION RULE40464047Every new marketplace should require creating only:40484049- connector metadata4050- extraction schema4051- normalization adapter4052- test fixtures40534054The rest of the ingestion pipeline should automatically work.40554056## 198. FIRECRAWL → SCRAPFLY ROUTER40574058Implement a connector orchestration service.40594060Pseudo-flow:40614062```ts4063async function fetchCollectiblePage(url, source) {4064 const apiResult = await tryOfficialApi(source, url)40654066 if (apiResult.success) return apiResult40674068 const firecrawl = await tryFirecrawl(url)40694070 if (4071 firecrawl.success &&4072 firecrawl.qualityScore >= MIN_QUALITY4073 ) {4074 return firecrawl4075 }40764077 const scrapfly = await tryScrapfly(url)40784079 if (4080 scrapfly.success &&4081 scrapfly.qualityScore >= MIN_QUALITY4082 ) {4083 return scrapfly4084 }40854086 return {4087 success: false,4088 requiresReview: true4089 }4090}4091```40924093## 199. EXTRACTION QUALITY40944095Quality score based on expected fields.40964097Example:40984099```4100Title 20%4101Price 20%4102Status 15%4103Date 10%4104Images 10%4105Description 5%4106Identifiers 10%4107Category 5%4108Currency 5%4109```41104111## 200. RAREINDEX ULTIMATE GOAL41124113RareIndex should eventually represent the complete global collectible economy as structured, queryable market data.41144115A user should be able to type almost any collectible object in the world and immediately see:41164117- what it is4118- what edition it is4119- how rare it is4120- its history4121- its latest sales4122- its current listings4123- what it is worth4124- how liquid it is4125- how its value has changed4126- where it is currently available4127- how it compares with similar objects4128- whether its market is gaining or losing momentum41294130RareIndex must not merely aggregate listings.41314132It must structure the collectible economy.41334134The long-term objective is:41354136One canonical asset graph containing every collectible, every important variation, every observable listing, every verified historical sale, and every meaningful market signal that can legally and reliably be obtained.41374138RareIndex.io should become the default destination whenever someone asks:41394140"What is this collectible worth?"41414142or:41434144"What is happening in the collectibles market?"41454146## 201. PRODUCT PRINCIPLE41474148When choosing between:41494150- more superficial features41514152and41534154- better data quality,41554156always prioritize data quality.41574158When choosing between:41594160- displaying a number41614162and41634164- admitting insufficient evidence,41654166admit insufficient evidence.41674168When choosing between:41694170- a generic marketplace41714172and41734174- a collectible intelligence platform,41754176always build the intelligence platform.41774178RareIndex should feel less like eBay and more like a professional market-data terminal built specifically for collectors.41794180## 202. FINAL MANDATE FOR CLAUDE CODE41814182Build RareIndex incrementally but architect it from day one for massive expansion.41834184Do not reduce the project to the initial ten categories.41854186Those categories are only the launch wedge.41874188The architecture must assume that RareIndex will eventually contain:41894190- millions of collectible models4191- tens or hundreds of millions of listings4192- hundreds of millions of historical observations4193- thousands of data sources4194- hundreds of category families4195- global currencies4196- multilingual descriptions4197- billions of images or image references4198- continuous price updates41994200Every technical decision should be evaluated against that end state.42014202The finished platform should feel unprecedented in scope.42034204RareIndex is the global data layer for collectible assets.4205