SPB Git forge
28commits 1branches 0releases
7.7 MBsize
maindefault branch
10 days agolast push
Python 66.3% TypeScript 22.7% JavaScript 8.6% HTML 1.4% CSS 0.7%
13.1 KB

# Seed registry — Wikidata harvest

Generated by scripts/seed_wikidata.py on 2026-09-13T07:17:29+00:00. 32368 companies, 13209 public (40.8 %), 12781 with a stock exchange, 10969 with a ticker, 4364 with an employee count, 5294 without an industry mapping (16.4 %), 206 countries.

Files: one NDJSON per UN region (wikidata-<region>.ndjson), one JSON object per line — see docs/SEEDS.md for the schema, the diversification rules and how to add companies. scripts/seed_edgar.py rewrites the files in place with SEC data; run it after every assemble.

# Tiers

Tier Companies
1 (global) 324
2 (major) 2159
3 (notable) 8633
4 (long tail) 21252

# Regions

Region Companies
Europe 11795
Asia 10334
Americas 8032
other 990
Africa 641
Oceania 576

# Countries

Code Country Companies Share
US United States 6285 19.4 %
JP Japan 3382 10.4 %
DE Germany 2310 7.1 %
GB United Kingdom 1548 4.8 %
CN China 1374 4.2 %
?? unknown 990 3.1 %
MY Malaysia 869 2.7 %
KR South Korea 846 2.6 %
IT Italy 844 2.6 %
RU Russia 751 2.3 %
ID Indonesia 731 2.3 %
CA Canada 723 2.2 %
IL Israel 696 2.2 %
ES Spain 551 1.7 %
CH Switzerland 545 1.7 %
FR France 533 1.6 %
SE Sweden 495 1.5 %
AU Australia 473 1.5 %
NL Netherlands 441 1.4 %
IN India 436 1.3 %
PL Poland 423 1.3 %
NO Norway 391 1.2 %
BR Brazil 388 1.2 %
TW Taiwan 326 1.0 %
FI Finland 300 0.9 %
AT Austria 284 0.9 %
DK Denmark 283 0.9 %
BE Belgium 280 0.9 %
UA Ukraine 252 0.8 %
CZ Czechia 208 0.6 %
TR Türkiye 185 0.6 %
SA Saudi Arabia 181 0.6 %
TH Thailand 130 0.4 %
NP Nepal 127 0.4 %
MX Mexico 126 0.4 %
IR Iran 113 0.3 %
RO Romania 111 0.3 %
BY Belarus 111 0.3 %
AR Argentina 111 0.3 %
ZA South Africa 108 0.3 %
PT Portugal 104 0.3 %
IE Ireland 94 0.3 %
CL Chile 92 0.3 %
GR Greece 89 0.3 %
PH Philippines 84 0.3 %
NZ New Zealand 81 0.3 %
SG Singapore 78 0.2 %
EE Estonia 78 0.2 %
AE United Arab Emirates 77 0.2 %
HK Hong Kong 77 0.2 %
HR Croatia 72 0.2 %
HU Hungary 72 0.2 %
LT Lithuania 69 0.2 %
NG Nigeria 67 0.2 %
LV Latvia 65 0.2 %
PK Pakistan 62 0.2 %
EG Egypt 61 0.2 %
LU Luxembourg 59 0.2 %
RS Serbia 59 0.2 %
SK Slovakia 57 0.2 %
CO Colombia 53 0.2 %
SI Slovenia 48 0.1 %
VN Vietnam 47 0.1 %
KZ Kazakhstan 45 0.1 %
BG Bulgaria 45 0.1 %
MA Morocco 45 0.1 %
VE Venezuela 45 0.1 %
AZ Azerbaijan 44 0.1 %
LK Sri Lanka 43 0.1 %
IS Iceland 38 0.1 %
TN Tunisia 36 0.1 %
BD Bangladesh 35 0.1 %
UZ Uzbekistan 34 0.1 %
AM Armenia 33 0.1 %
PE Peru 31 0.1 %
DZ Algeria 29 0.1 %
MD Moldova 27 0.1 %
MT Malta 26 0.1 %
KE Kenya 25 0.1 %
BM Bermuda 24 0.1 %
AL Albania 23 0.1 %
CY Cyprus 22 0.1 %
QA Qatar 22 0.1 %
GE Georgia 20 0.1 %
JO Jordan 20 0.1 %
GH Ghana 20 0.1 %
BA Bosnia and Herzegovina 20 0.1 %
SY Syria 19 0.1 %
KW Kuwait 19 0.1 %
LY Libya 17 0.1 %
BO Bolivia 16 0.0 %
BH Bahrain 16 0.0 %
CD DR Congo 16 0.0 %
UG Uganda 16 0.0 %
AO Angola 15 0.0 %
UY Uruguay 15 0.0 %
MN Mongolia 15 0.0 %
ME Montenegro 14 0.0 %
TZ Tanzania 14 0.0 %
DO Dominican Republic 14 0.0 %
IQ Iraq 13 0.0 %
SD Sudan 13 0.0 %
CM Cameroon 13 0.0 %
KY Cayman Islands 12 0.0 %
LB Lebanon 12 0.0 %
NA Namibia 12 0.0 %
KH Cambodia 12 0.0 %
FO Faroe Islands 11 0.0 %
GL Greenland 11 0.0 %
MM Myanmar 11 0.0 %
OM Oman 10 0.0 %
AF Afghanistan 10 0.0 %
JE Jersey 8 0.0 %
LI Liechtenstein 8 0.0 %
MK North Macedonia 8 0.0 %
CV Cabo Verde 8 0.0 %
PS Palestine 8 0.0 %
GA Gabon 8 0.0 %
TM Turkmenistan 7 0.0 %
XK Kosovo 7 0.0 %
RW Rwanda 7 0.0 %
TJ Tajikistan 7 0.0 %
BW Botswana 7 0.0 %
NE Niger 7 0.0 %
CR Costa Rica 7 0.0 %
KP North Korea 6 0.0 %
ET Ethiopia 6 0.0 %
JM Jamaica 6 0.0 %
CU Cuba 6 0.0 %
MZ Mozambique 6 0.0 %
GG Guernsey 6 0.0 %
SR Suriname 6 0.0 %
SO Somalia 6 0.0 %
MV Maldives 6 0.0 %
HT Haiti 6 0.0 %
MC Monaco 6 0.0 %
EC Ecuador 6 0.0 %
SM San Marino 6 0.0 %
CW Curaçao 5 0.0 %
ZW Zimbabwe 5 0.0 %
TT Trinidad and Tobago 5 0.0 %
BS Bahamas 5 0.0 %
ZM Zambia 5 0.0 %
GQ Equatorial Guinea 5 0.0 %
ML Mali 5 0.0 %
HN Honduras 5 0.0 %
IM Isle of Man 4 0.0 %
PA Panama 4 0.0 %
SC Seychelles 4 0.0 %
VA Vatican City 4 0.0 %
MU Mauritius 4 0.0 %
BN Brunei 4 0.0 %
FJ Fiji 4 0.0 %
MG Madagascar 4 0.0 %
LA Laos 4 0.0 %
BT Bhutan 4 0.0 %
AD Andorra 4 0.0 %
CI Côte d'Ivoire 4 0.0 %
MR Mauritania 4 0.0 %
CG Republic of the Congo 4 0.0 %
KG Kyrgyzstan 4 0.0 %
SN Senegal 4 0.0 %
GT Guatemala 4 0.0 %
TL Timor-Leste 4 0.0 %
BJ Benin 4 0.0 %
GI Gibraltar 3 0.0 %
TG Togo 3 0.0 %
PG Papua New Guinea 3 0.0 %
YE Yemen 3 0.0 %
DJ Djibouti 3 0.0 %
MH Marshall Islands 3 0.0 %
WS Samoa 3 0.0 %
BZ Belize 3 0.0 %
MW Malawi 3 0.0 %
AW Aruba 3 0.0 %
ER Eritrea 2 0.0 %
KI Kiribati 2 0.0 %
ST Sao Tome and Principe 2 0.0 %
KM Comoros 2 0.0 %
TO Tonga 2 0.0 %
NI Nicaragua 2 0.0 %
SZ Eswatini 2 0.0 %
BI Burundi 2 0.0 %
VC Saint Vincent and the Grenadines 2 0.0 %
PR Puerto Rico 2 0.0 %
PY Paraguay 2 0.0 %
GM Gambia 2 0.0 %
AG Antigua and Barbuda 1 0.0 %
NR Nauru 1 0.0 %
BF Burkina Faso 1 0.0 %
MO Macao 1 0.0 %
VU Vanuatu 1 0.0 %
CK Cook Islands 1 0.0 %
SB Solomon Islands 1 0.0 %
SX Sint Maarten 1 0.0 %
TC Turks and Caicos Islands 1 0.0 %
PW Palau 1 0.0 %
CF Central African Republic 1 0.0 %
GY Guyana 1 0.0 %
FK Falkland Islands 1 0.0 %
BB Barbados 1 0.0 %
SL Sierra Leone 1 0.0 %
SH Saint Helena 1 0.0 %
GN Guinea 1 0.0 %
GW Guinea-Bissau 1 0.0 %
SV El Salvador 1 0.0 %

# Stock exchanges (primary listing kept per company)

Exchange Companies
Tokyo Stock Exchange 1956
Nasdaq 1569
New York Stock Exchange 1562
Bursa Malaysia 780
Indonesia Stock Exchange 630
Hong Kong Stock Exchange 620
Tel Aviv Stock Exchange 532
London Stock Exchange 477
Korea Exchange (Stock Market) 368
Australian Securities Exchange 294
Toronto Stock Exchange 288
Shenzhen Stock Exchange 276
Shanghai Stock Exchange 275
Warsaw Stock Exchange 234
OTC Markets Group 222
São Paulo Stock Exchange 220
National Stock Exchange of India 162
Saudi Stock Exchange 152
Korean Stock Exchange 141
Oslo Stock Exchange 126
Moscow Exchange 117
Taiwan Stock Exchange 115
Nepal Stock Exchange 105
Frankfurt Stock Exchange 103
Euronext Paris 98
Nasdaq Copenhagen A/S 84
Stock Exchange of Thailand 80
Nasdaq Helsinki Ltd 72
Nasdaq Stockholm AB 61
Italian Stock Exchange 49
Tehran Stock Exchange 48
KOSDAQ 47
Madrid Stock Exchange 40
BME Scaleup 40
Swiss Stock Exchange 36
Santiago Stock Exchange 32
Colombo Stock Exchange 28
Tokyo Stock Exchange-Tokyo Pro Market 28
Euronext Brussels 27
Zagreb Stock Exchange 26

# Top-level industries (a company counts once per top-level sector)

Industry Companies
Media 4707
Consumer Goods 3164
Financial Services 3081
Transportation 2957
Technology 2409
Manufacturing 2114
Retail 1539
Energy 1321
Automotive 1111
Healthcare 987
Aerospace & Defense 826
Telecommunications 792
Mining & Metals 765
Construction 664
Professional Services 533
Real Estate 432
Chemicals 413
Hospitality 308
Materials 263
Agriculture 262
Utilities 251
Travel & Tourism 210
Education 173

# All industries

Slug Companies
food-beverage 1971
media 1943
entertainment 1885
manufacturing 1722
financial-services 1672
retail 1539
transportation 1255
airlines 1232
technology 1198
automotive 1111
gaming 1017
banking 826
telecommunications 792
mining 765
consumer-goods 758
construction 664
energy 647
oil-gas 610
aerospace-defense 575
software 561
apparel 542
asset-management 536
pharmaceuticals 445
real-estate 432
professional-services 430
chemicals 413
industrial-machinery 388
insurance 387
logistics 372
hospitality 308
healthcare 307
internet 302
defense 297
materials 263
agriculture 262
utilities 251
travel 210
biotechnology 208
shipping 200
education 173
semiconductors 161
e-commerce 153
renewables 114
consulting 109
fintech 84
cloud-infrastructure 75
medical-devices 74
cybersecurity 73
artificial-intelligence 59
robotics 43
payments 37

# Harvest report — 2026-09-13

  • Pipeline: scripts/seed_wikidata.py all --target N (candidates → dissolved → select → details → assemble), then scripts/seed_edgar.py, then catlas seed. Every SPARQL result is cached under data/seed/wikidata/sparql/; per-stage counters in data/seed/harvest-stats.json.
  • Candidates: 51,286 unique items with a website from 44 P31 classes × sitelink bands (≥ 3), 250 stock exchanges scanned in 13 P414 queries (13,541 currently listed), employees ≥ 500 / revenue bands per class, plus country and industry boosts. First seen per band: class 39,684, listed 7,664, revenue 1,748, employees 1,723, industry-boost 354, country-boost 103, ticker 10.
  • Dissolved check (P576 / P582, 171 queries of 300 QIDs): 3,580 of 51,286 candidates excluded.
  • Prefilter: 89 generic / invalid websites dropped, 1,639 duplicate registrable domains (highest sitelinks kept), 45,978 kept (12,935 listed).
  • Selection (target 33,000; caps US ≤ 35%, other countries ≤ 12%, unknown country ≤ 3%, narrow classes 2–5 %): country minimums 2,160, then 11,964 listed companies, then 18,876 by sitelinks ≥ 3; 12,791 listed companies selected in total.
  • Non-company exclusion: 652 items removed — 515 for a non-company P31 class (museums, libraries, universities / schools, government agencies, NGOs / charities / foundations / nonprofits, religious organisations, political parties, trade unions, hospitals, sports clubs, YouTube channels; top: nonprofit organization 170, government agency 40, university 30, museum 27, learned society 20, public university 20, non-governmental organization 19, charitable organization 18, association football club 15, educational institution 14, hospital 13, library 11) and 137 for a description matching museum / university / school / ministry / agency / charity / foundation / association / club / church / channel with no ticker, exchange, employee count or revenue. Items with a current listing or a ticker are always kept (listed football clubs). List: data/seed/dropped.json.
  • Assemble: 33,000 selected companies with details + 0 from the industry top-up (every top-level industry ≥ 60); 0 subsidiaries sharing their parent's domain and 0 duplicate domains dropped; 1,458 related_domain_conflict notes → 32,368 companies.
  • Tiers by importance quantile (1% / 6.67% / 26.67%): tier 1 = ranks 1–324, tier 2 → 2,483, tier 3 → 11,116, tier 4 = rest.
  • Country minimums: all met (JP 3382, DE 2310, GB 1548, CN 1374, KR 846, IT 844, ID 731, CA 723 …).
  • EDGAR (2026-09-13): 920 companies newly matched to a CIK (ticker, then exact normalised name), 2,543 already had one → 3,463 of 32,368 with a SEC CIK; 1,319 rows enriched, 202 industries from SIC (5,092 still without an industry mapping), 816 submissions JSON read.