SPB Git
spboucher.ai

spb/wpai0001_uqo

Public

Tier-1/2 runs (dev + confirmatory, amendments A1-A2), frozen Tier-1 analysis, paper v1.0 draft (Tier-2 confirmatory paragraph pending)

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Simon-Pierre Boucher committed (Nov 9, 2026) parent 043b146 Browse files

14 changed files +19,967 −3

14 changed files
Unified Split
modified docs/DECISION_LOG.md +4 −0
@@ -44,3 +44,7 @@ All entries are dated; "before freeze" refers to the confirmatory freeze (PREREG
44 PREREGISTRATION before the development results were read (eligibility = own-vector sufficiency ≥ 0.5; 44 PREREGISTRATION before the development results were read (eligibility = own-vector sufficiency ≥ 0.5;
45 selected condition = best dev condition; contrast = selected minus best control on confirmatory queries). 45 selected condition = best dev condition; contrast = selected minus best control on confirmatory queries).
46 PREREGISTRATION.md sha256 at Tier-1 freeze: 85c5db69657144e6d6afecfb4fc346c2345d09455fb6134bee615567e5c705ad 46 PREREGISTRATION.md sha256 at Tier-1 freeze: 85c5db69657144e6d6afecfb4fc346c2345d09455fb6134bee615567e5c705ad
47+- **D12 (2026-11-09, amendment A1 before the Tier-1 confirmatory run).** Shuffled-query donor state reclassified
48+ from null control to mechanism diagnostic (it carries the task identity); both analyses reported.
49+- **D13 (2026-11-09, amendment A2).** Tier-1/2 confirmatory runs load the development localization (layers,
50+ vectors) instead of re-localizing on confirmatory queries; first confirmatory run invalidated and re-run.
modified docs/EXPERIMENT_LOG.md +4 −0
@@ -83,3 +83,7 @@ mechanism unchanged (ablation 0.086 → rescue 1.000, sham 0.115; reverse 0.965)
83 83
84 | 2026-11-09 | `graft_tier0_confirmatory_0c2257f6803e` (MPS, PREREGISTRATION v1.0, seed base 90 000) | **completed** | `experiments/summaries/graft_tier0_confirmatory_0c2257f6803e/{results.json,CONFIRMATORY.md,confirmatory.json}` | primary: 9/9 pairs lower bound > SESOI, mean Δ_T^adj 0.875 (sd 0.042, min 0.776) → H2 SUPPORTED; H4 NOT SUPPORTED (one pair control 0.946 < 0.95; others ≥ 0.985); Holm: subspace k8 vs random +0.850, adapter vs base +0.472, weight L0 block vs shuffled +0.556 (retention 0.720), all rejected at Holm; H5 seen 0.941 / unseen 0.768 (ratio 0.816 ≥ 0.8) SUPPORTED; adapter cache 0.702 / 0.000 | 84 | 2026-11-09 | `graft_tier0_confirmatory_0c2257f6803e` (MPS, PREREGISTRATION v1.0, seed base 90 000) | **completed** | `experiments/summaries/graft_tier0_confirmatory_0c2257f6803e/{results.json,CONFIRMATORY.md,confirmatory.json}` | primary: 9/9 pairs lower bound > SESOI, mean Δ_T^adj 0.875 (sd 0.042, min 0.776) → H2 SUPPORTED; H4 NOT SUPPORTED (one pair control 0.946 < 0.95; others ≥ 0.985); Holm: subspace k8 vs random +0.850, adapter vs base +0.472, weight L0 block vs shuffled +0.556 (retention 0.720), all rejected at Holm; H5 seen 0.941 / unseen 0.768 (ratio 0.816 ≥ 0.8) SUPPORTED; adapter cache 0.702 / 0.000 |
85 | 2026-11-09 | `eval_persistent` on the confirmatory run (fresh process, seed base 95 000) | completed | `.../persistent/fresh_process_eval.json` | saved adapter: target 0.344 [0.317, 0.372] vs base 0.115; control 0.979 | 85 | 2026-11-09 | `eval_persistent` on the confirmatory run (fresh process, seed base 95 000) | completed | `.../persistent/fresh_process_eval.json` | saved adapter: target 0.344 [0.317, 0.372] vs base 0.115; control 0.979 |
86+| 2026-11-09 | `tier1_taskvector_e105e3d91386` (MLX laptop, dev split, 4 pairs, k = 8, 10 vector sets) | completed (1 649 s) | `experiments/summaries/tier1_taskvector_e105e3d91386/results.json` | within-model sufficiency: antonym 0.84–0.88 (L14–L25), capital 0.82–1.00 (L14–L25), addthree only in Llama (0.80, L14), morph none; cross-model best (dev): antonym 0.66–0.81 in all 4 pairs vs best null control 0.38–0.56; capital 0.73 (1.5B→3B, Procrustes L28), 0.50 (Llama→Qwen3B, CCA L18), 0.18 (3B→1.5B), 0.05 (3B→Llama); shuffled-query donor state transfers antonym as well as the matched query (→ amendment A1, D12) |
87+| 2026-11-09 | `tier1_taskvector_eb5d091bf5ed` (MLX on M3U96b, Tier 2: Qwen2.5-7B ↔ Qwen2.5-3B, Qwen2.5-7B → Llama-3.2-3B, dev split) | completed (2 528 s) | `experiments/summaries/tier1_taskvector_eb5d091bf5ed/results.json` (pulled from the node) | Qwen-7B within-model: antonym 0.91 (L16), capital 1.00 (L11), morph 0.03, add-three 0.00; dev transfer: antonym 0.84 both Qwen directions (controls 0.53/0.59), capital 0.91 (3B→7B; unrelated-task control 0.77) / 0.14 (7B→3B); 7B→Llama antonym 0.38 vs control 0.34 (no transfer) |
88+| 2026-11-09 | `tier1_taskvector_confirmatory_82a78041c0ce` | **invalidated** | manifest | re-localized on confirmatory queries (A2/D13); no number used |
89+| 2026-11-09 | `tier1_taskvector_confirmatory_625c54bd186f` (laptop, confirmatory split, dev-frozen localization) | completed | `experiments/summaries/tier1_taskvector_confirmatory_625c54bd186f/{results.json,TIER1_CONFIRMATORY.md}` | H6 per pair (frozen rule, amended controls): Qwen3B→1.5B not supported (antonym +0.16 [0.00, 0.34], capital +0.09); 1.5B→3B partial (capital +0.36 [0.14, 0.59] ✔, antonym +0.28 [0.09, 0.47]); Llama→Qwen3B partial (antonym +0.50 [0.31, 0.69] ✔, capital +0.18 [0.05, 0.36]); Qwen3B→Llama not supported (antonym +0.25 [0.09, 0.41], capital −0.05); add-three/morph not eligible or 0 |
modified docs/PREREGISTRATION.md +16 −0
@@ -130,3 +130,19 @@ script's conditions.
130 "partial" if for one; "not supported" otherwise. Also reported: gain vs recipient zero-shot, recipient few-shot 130 "partial" if for one; "not supported" otherwise. Also reported: gain vs recipient zero-shot, recipient few-shot
131 (prompting ceiling), recipient own vector (within-model ceiling), held-out NLL change and cross-task accuracy. 131 (prompting ceiling), recipient own vector (within-model ceiling), held-out NLL change and cross-task accuracy.
132 - Tier 2 (Qwen2.5-7B pairs, run on M3U96b) follows the same rule. 132 - Tier 2 (Qwen2.5-7B pairs, run on M3U96b) follows the same rule.
133+
134+### Amendment A1 to the Tier-1 rule (2026-11-09, recorded BEFORE the Tier-1 confirmatory run; D12)
135+The first development pair showed that the "mapped donor few-shot state of a *shuffled* query" condition is not a
136+null control: the recipient keeps its own query in context, and the donor state carries the task identity, so it
137+transfers the task exactly like the matched-query state (antonym, qwen3b→qwen1.5b: 0.72 vs 0.72 on dev). It is
138+reclassified as a **mechanism diagnostic** (task identity vs query content). The null-control set for the H6
139+contrast is therefore: norm-matched random vector, unrelated-task vector, sham-map vector (random orthogonal map),
140+and mapped donor **zero-shot** state (same map, no task information). The analysis reports both the pre-amendment
141+(shuffled query included) and the amended contrast.
142+
143+### Amendment A2 (2026-11-09, procedural; D13)
144+The first confirmatory Tier-1 run (`tier1_taskvector_confirmatory_82a78041c0ce`) re-localized the recipient's
145+best layer on the confirmatory queries, so some development-selected conditions did not exist in it. As the rule
146+intended, localization (layers, vectors) is frozen from the development split; the run is marked *invalidated*
147+in the registry and re-executed with `--split confirmatory` loading the development localization caches. No
148+numbers from the invalidated run are used.
added docs/review_enrolment/_constraints_WP-AI-0001.md +8 −0
@@ -0,0 +1,8 @@
1+## Paper-specific constraints (binding for every stage of this review)
2+- **Enrolment.** WP-AI-0001 was built autonomously on 2026-11-09 (sprints 0–7 in one session) and enrolled the same day for the full pipeline (Stages A–G) under the standing instructions of the earlier waves: Stages C–G run autonomously; every authorization request is treated as authorised EXCEPT paid API spend (0 USD); the review branch is pushed after every commit; `main` is never touched; one paper at a time; ≤ 7 concurrent subagents.
3+- **Genre.** Mechanistic-interpretability / machine-learning methods paper with a preregistered confirmatory test: can a causally localized subsystem ("organ", a metaphor) be transplanted from a donor language model into a recipient that lacks the capability, without training? Tier 0 = toy decoder transformers (0.80 M params, 4 layers) trained from scratch on an invented operator micro-world (OPSEQ, scratchpad trace, modulus 11), donor = all 8 operators, recipient = operator Ω excluded; localization by interchange interventions; six transplant families (activation, subspace, steering, adapter, weight, persistent) against a control battery (sham map, norm-matched random, shuffled item/layer, unrelated-skill donor) and conventional-learning references (supervised adapter, distillation); PREREGISTRATION v1.0 frozen before the confirmatory run (`graft_tier0_confirmatory_0c2257f6803e`, seed base 90 000); Tier 1 = Qwen2.5-1.5B/3B-Instruct and Llama-3.2-3B-Instruct in bf16 under MLX, task vectors (few-shot − zero-shot last-token state) localized within model and transferred through maps fitted on format-matched task-free prompts; Tier 2 = Qwen2.5-7B pairs on M3U96b. Judge in particular: whether the Tier-0 capability (per-step operator map once the trace is visible) supports the paper's claims; whether "causally identified" is earned (interchange + ablation + rescue + sham); the annihilation proposition (regression-fitted maps remove recipient-unpredictable directions) — its hypotheses, proof and the approximate case; the preregistration (what was frozen, the one failed criterion H4 retention ≥ 0.95, Holm family); the control-adjusted estimand against a sham map that itself destroys the control stratum; same- vs different-initialization pairs (seed = init seed); the donor-in-the-loop nature of the primary graft vs the weaker donor-free variants; rule-vs-cache; the strength of the conventional-learning references; Tier-1 selection on the dev split and the confirmatory split; the MLX backend (no per-head hooks; no Transformers equivalence test); verbs vs descriptive/causal evidence. Referee E: full REFORMS checklist.
4+- **Data and compute.** All Tier-0 data are synthetic and regenerated from seeds (split hashes in `experiments/manifests/*.json`); `experiments/registry/runs.jsonl` lists every run; `experiments/summaries/<run>/results.json` + `CONFIRMATORY.md`; per-item outputs and trained models under `artifacts/` are git-ignored (regenerable: `scripts/train_models.py` ≈ 13 min MPS; `scripts/run_transplant.py` ≈ 3 min). Tier-1/2 need Apple Silicon + mlx_lm + the bf16 checkpoints (HF cache on the laptop and M3U96a/b; Qwen2.5-7B on M3U96b). Stage B referees do not run inference: lightweight checks on `experiments/summaries/` only. Stages D–F may re-run Tier-0 experiments on any node with torch (M4M64a) or the laptop, and MLX inference on M3U96a/b replicas (`~/wpai0001_review/`), one GPU job per node.
5+- **No paid API call (0 USD).** None is needed. Crossref/OpenAlex/arXiv lookups are free and allowed.
6+- **Blinding (addition to COMMON.md).** No prior external review exists. `docs/MANDATE.md` and `CLAUDE.md` are blinded by COMMON.md (they are the author's instructions); `docs/{RESEARCH_GAP,PREREGISTRATION,EXPERIMENT_PLAN,COMPUTE_BUDGET,RISK_REGISTER,REPRODUCIBILITY,EXPERIMENT_LOG,DECISION_LOG,TASKS}.md`, `literature/`, `experiments/` are the author's design/audit records: readable.
7+- **Numbers.** `paper/tables/*.tex` are generated by `scripts/build_tables.py` and `paper/figures/*.pdf` by `scripts/build_figures.py` from `experiments/summaries/<run>/results.json` (`paper/figures/FIGURE_PROVENANCE.md` names the run per figure); confirmatory decisions by `scripts/confirmatory_analysis.py` → `CONFIRMATORY.md` — spot-check the paper against these.
8+- Single-author paper (Boucher). Never touch the author's checkout `ia/wp-ai-0001` nor `M3U96b:~/wpai0001`.
added docs/review_enrolment/_ctx.json +7 −0
@@ -0,0 +1,7 @@
1+{
2+ "num": "AI-0001",
3+ "thesis": "in a controlled micro-world (toy decoder transformers trained from scratch on an invented operator language, donor = all 8 operators, recipient = operator Ω excluded), a causally localized subsystem (the post-layer-0 residual row at the read position, identified by interchange interventions, ablation and rescue) can be transplanted at inference time by a donor-in-the-loop activation graft through an orthogonal Procrustes map fitted on task-free rows, lifting the recipient from chance to 0.966 on held-out Ω programs (preregistered confirmatory run, control-adjusted +0.875, 9/9 pairs above the SESOI, control stratum 0.992, one pair below the 0.95 retention criterion), carrying the rule to unseen operands, needing 8 of 128 dimensions and surviving width/depth/stride-2 mismatches; regression-fitted maps (ridge, CCA) annihilate the capability (Proposition 1), donor-free adapters cache, weight grafts cost retention, steering vectors transfer nothing, and conventional learning on the same items is perfect; on open-weight models (Qwen2.5-1.5B/3B, Llama-3.2-3B; Qwen2.5-7B on a node) task vectors are causally sufficient within a model for some tasks and cross-model transfer is reported as measured under a frozen selection rule",
4+ "node": "Tier-0 experiments (PyTorch MPS, ≈ 3 min per transplant run, ≈ 13 min for the 17-model matrix) run on the laptop or on M4M64a (torch 2.12 available; `~/wpai0001_review/` replica via rsync of the worktree, never the author's checkout); Tier-1/2 MLX inference on M3U96a/M3U96b replicas (`~/wpai0001_review/`; checkpoints in the HF cache: Qwen2.5-1.5B/3B, Llama-3.2-3B on both, Qwen2.5-7B on M3U96b; mlx_lm 0.31.3), ONE GPU job per node; detached nohup + log + done-marker, pull back only `experiments/summaries/*` and `experiments/manifests/*` (≤ 20 MB) and commit per package",
5+ "rules": "BINDING (peer_reviews/WP-AI-0001/_constraints.md): 0 USD — no paid LLM/API call (none needed); the frozen PREREGISTRATION text (v1.0 + Tier-1 rule) is never rewritten (dated amendments only in DECISION_LOG); trained models and runs are never deleted (new runs get new ids); never touch the author's checkout ia/wp-ai-0001 nor M3U96b:~/wpai0001",
6+ "ar": "AR-AI0001-1"
7+}
\ No newline at end of file
added docs/review_enrolment/_stage_params.json +13 −0
@@ -0,0 +1,13 @@
1+{
2+ "node": "laptop or M4M64a for Tier 0 (torch); M3U96a/M3U96b for MLX Tier 1/2",
3+ "nodedir": "~/wpai0001_review",
4+ "cache": "HF hub cache on the nodes (bf16 checkpoints); artifacts/models/matrix_v1 regenerable in ≈ 13 min",
5+ "noderules": "Compute: Tier-0 re-runs (`scripts/train_models.py`, `scripts/run_transplant.py`, `scripts/eval_persistent.py`, `scripts/confirmatory_analysis.py`) take minutes on MPS: run them on the laptop (`nice -n 10`) or on M4M64a (`rsync -a --exclude artifacts --exclude .git <worktree>/ M4M64a:~/wpai0001_review/`; torch 2.12.1 present); Tier-1/2 MLX runs (`scripts/run_tier1.py`) on M3U96a or M3U96b replicas with the checkpoints in their HF cache, ONE GPU job per node (`mld scan` first; never M1M32; never the author's `~/wpai0001`); detached via nohup + log + done-marker, poll every 60–120 s, pull back only `experiments/summaries/<run>/` and `experiments/manifests/<run>.json` and commit per package; every new run gets a new run id (never overwrite); the frozen preregistration is never rewritten. 0 USD.",
6+ "lrules": "Batch L (text, bibliography, tables/figures regeneration from committed results, sub-minute checks): laptop allowed (`python3 -I`, `nice -n 10`); anything > 10 min goes to a node replica as for batch N. 0 USD.",
7+ "gen": "paper tables are generated by `scripts/build_tables.py` and figures by `scripts/build_figures.py --run <run id>` from `experiments/summaries/<run>/results.json` (provenance in `paper/figures/FIGURE_PROVENANCE.md`); confirmatory decisions by `scripts/confirmatory_analysis.py` (Tier 0) and `scripts/tier1_analysis.py` (Tier 1/2); claims mapped in `docs/CLAIM_EVIDENCE.md`",
8+ "exhibit_paths": "scripts/*.py (generators and fixes), src/wp_ai_0001/** (fixes with tests), tests/**, experiments/{registry,manifests,summaries}/** (new runs only; never rewriting existing runs), paper/tables/*.tex, paper/figures/*, paper/main.tex ONLY for \\input lines and the exhibit preamble, docs/CLAIM_EVIDENCE.md, README.md exhibit map — PLUS the author's figure mandate of 2026-11-09 (improvements/_FIGURE_MANDATE_2026-11-09.md, binding): one 'cartography' system-map figure (donor → localization → map → graft → evaluation, with the models/nodes/backends used) placed early, every figure legendary-grade (vector, validated palette, uncertainty, units, grayscale-safe, self-contained captions), audited in colour and grayscale",
9+ "writing_paths": "paper/sections/*.tex, paper/appendix/*.tex prose and proofs, the title/subtitle/abstract/version macros of paper/main.tex (\\WPversion → 1.1), paper/references.bib (Stage D additions per improvements/WP-AI-0001/literature_additions.md; verified entries only), README.md prose, docs/{EXPERIMENT_LOG,DECISION_LOG}.md (dated entries only; PREREGISTRATION never rewritten), improvements/WP-AI-0001/response_to_referees.md",
10+ "thesis": "TO FILL after Stage D from improvements/WP-AI-0001/implemented_changes.md",
11+ "verify_numbers": "TO FILL after Stage D",
12+ "repo": "wpai0001_uqo.git"
13+}
\ No newline at end of file
added docs/review_enrolment/enroll_wpai0001.py +34 −0
@@ -0,0 +1,34 @@
1+#!/usr/bin/env python3
2+"""Enrol WP-AI-0001 in the UQO-WP-REVIEW pipeline: registry entry, blinded record, status file, constraints.
3+Computes pages / n_refs / git head at run time. Idempotent (replaces an existing WP-AI-0001 entry)."""
4+import json, os, re, subprocess, datetime
5+ROOT=os.path.expanduser('~/Desktop/UQO/Recherche/Recherche-UQO'); REV=f'{ROOT}/UQO-WP-REVIEW'
6+PID='WP-AI-0001'; PATH='ia/wp-ai-0001'; SRC=f'{ROOT}/{PATH}'
7+def sh(c): return subprocess.check_output(c,shell=True,text=True).strip()
8+head=sh(f'git -C {SRC} rev-parse --short HEAD'); dirty=int(sh(f'git -C {SRC} status --porcelain | wc -l'))
9+pages=int(sh(f'pdfinfo {SRC}/paper/main.pdf | awk \'/^Pages/{{print $2}}\''))
10+nrefs=len(re.findall(r'^@\w+\{', open(f'{SRC}/paper/references.bib').read(), re.M))
11+tex=open(f'{SRC}/paper/main.tex').read()
12+ver=re.search(r'\\newcommand\{\\WPversion\}\{(.*?)\}',tex).group(1); date=re.search(r'\\newcommand\{\\WPdate\}\{(.*?)\}',tex).group(1); jel=re.search(r'\\newcommand\{\\WPjel\}\{(.*?)\}',tex).group(1)
13+title=re.search(r'\\newcommand\{\\WPtitle\}\{(.*?)\}',tex).group(1); sub=re.search(r'\\newcommand\{\\WPsubtitle\}\{(.*?)\}',tex).group(1)
14+now=datetime.datetime.now().astimezone().isoformat(timespec='seconds')
15+readme=open(f'{SRC}/README.md').read(); m=re.search(r'\*\*TL;DR\*\*\s*—\s*(.*?)\n\n',readme,re.S); tldr=re.sub(r'\s*\n>\s*',' ',m.group(1)).strip() if m else ''
16+entry={"id":PID,"number":None,"series":"UQO","alt_ids":["wp-ai-0001","AI-0001"],"title":title,"short_title":"Neural Organ Transplant","subtitle":sub,
17+ "authors":["Simon-Pierre Boucher"],"discipline":"ai","paper_type":"computational","path":PATH,"git_remote":"gitsrv:srv/git/wpai0001_uqo.git","git_head":head,"git_dirty_files":dirty,"git_tags":[],
18+ "baseline_tag":"review-baseline-20261103","review_branch":"review-20261103","worktree":f"UQO-WP-REVIEW/worktrees/{PID}",
19+ "manuscript":{"main_tex":"paper/main.tex","pdf":"paper/main.pdf","pages":pages,"pdf_mtime":datetime.date.today().isoformat(),"engine":"pdflatex (paper/.latexmkrc)","bib":["paper/references.bib"],"n_refs":nrefs,"bib_system":"natbib","version_macro":ver,"date_macro":date,"jel":jel},
20+ "code":{"languages":["python","shell"],"entrypoints":sorted(os.listdir(f'{SRC}/scripts')),"env_files":["pyproject.toml"],"has_makefile":False},
21+ "data":{"summary":"synthetic micro-world splits regenerated from seeds (hashes in manifests); Tier-1 task lists in src; open-weight checkpoints from the HF hub (not committed)","data_dir_mb":0.0,"data_n_files":1,"data_gitignored":True,"raw_preserved":"n/a (synthetic)","sources":"to be completed by Referee D (Stage B)"},
22+ "compute_home":"laptop (M5 Max, MPS + MLX); Tier-2 pairs on M3U96b (~/wpai0001)","status":"complete",
23+ "dissemination":{"ssrn_id":None,"ssrn_status":"not on SSRN","target_journals":[],"submitted":False},
24+ "known_limitations":["Tier-0 capability is a per-step map once the trace is visible; donor-in-the-loop graft; conventional learning perfect on the same items; Tier-1 three models, four tasks"],
25+ "readme_tldr":tldr,"prior_reviews":[],"review_status":{"stage":"0","gate_passed":None,"last_update":now},"checksums_file":f"UQO-WP-REVIEW/manuscripts/{PID}/original/SHA256SUMS","in_scope":True}
26+reg=json.load(open(f'{REV}/registry/working_papers.json'))
27+reg['papers']=[p for p in reg['papers'] if p['id']!=PID]+[entry]; reg['n_in_scope']=sum(1 for p in reg['papers'] if p.get('in_scope')); reg['generated_update']=now
28+json.dump(reg,open(f'{REV}/registry/working_papers.json','w'),indent=1,ensure_ascii=False)
29+# blinded record = entry without review/status/known_limitations/prior_reviews
30+rec={k:v for k,v in entry.items() if k not in ('review_status','status','known_limitations','prior_reviews','in_scope','git_remote','git_dirty_files','git_tags','baseline_tag','review_branch','checksums_file','alt_ids','short_title','readme_tldr')}
31+os.makedirs(f'{REV}/peer_reviews/_briefs/records',exist_ok=True); json.dump(rec,open(f'{REV}/peer_reviews/_briefs/records/{PID}.json','w'),indent=1,ensure_ascii=False)
32+st={"id":PID,"path":PATH,"stage":"0","gate_passed":[],"timestamp":now,"blocking_items":[],"engine_unavailable":[],"api_budget_usd":{"ceiling":0,"spent":0},"notes":[f"{now}: enrolled by the author for the full pipeline (Stages A–G), standing instructions: C–G autonomous, 0 USD, review branch pushed, main untouched, one paper at a time, ≤ 7 concurrent subagents."],"authorization_pending":[],"authorizations":{}}
33+json.dump(st,open(f'{REV}/status/{PID}.json','w'),indent=1)
34+print('enrolled',PID,'head',head,'pages',pages,'refs',nrefs,'version',ver)
added experiments/manifests/tier1_taskvector_confirmatory_625c54bd186f.json +81 −0
@@ -0,0 +1,81 @@
1+{
2+ "config": {
3+ "k": 8,
4+ "localization": "dev-frozen (A2)",
5+ "pairs": [
6+ "qwen3b:qwen1.5b",
7+ "qwen1.5b:qwen3b",
8+ "llama3b:qwen3b",
9+ "qwen3b:llama3b"
10+ ],
11+ "quick": false,
12+ "split": "confirmatory",
13+ "task_seed": 0
14+ },
15+ "created_utc": "2026-11-09T08:44:05+00:00",
16+ "data_hashes": {
17+ "addthree": {
18+ "hash": "cd3d9a8ce6bdbdd9",
19+ "n_queries": 35
20+ },
21+ "antonym": {
22+ "hash": "fd3396e4fae62697",
23+ "n_queries": 32
24+ },
25+ "capital": {
26+ "hash": "e19a1f86c4dae78e",
27+ "n_queries": 22
28+ },
29+ "morph": {
30+ "hash": "09bcd55b41ce2ba7",
31+ "n_queries": 40
32+ }
33+ },
34+ "experiment_id": "tier1_taskvector_confirmatory",
35+ "git": {
36+ "branch": "main",
37+ "commit": "043b146ef4ae8b081c2c6f0246c4c609b04db4c7",
38+ "dirty": true
39+ },
40+ "hardware": {
41+ "chip": "Apple M5 Max",
42+ "cpu_count": 18,
43+ "hostname_hash": "9ad7358c662e",
44+ "machine": "arm64",
45+ "memory_gb": 48.0,
46+ "platform": "macOS-27.0-arm64-arm-64bit-Mach-O",
47+ "torch_cuda": false,
48+ "torch_mps": true
49+ },
50+ "history": [
51+ {
52+ "note": "",
53+ "status": "running",
54+ "utc": "2026-11-09T08:44:08+00:00"
55+ },
56+ {
57+ "note": "",
58+ "status": "completed",
59+ "utc": "2026-11-09T09:06:53+00:00"
60+ }
61+ ],
62+ "interpretation": "",
63+ "libraries": {
64+ "mlx": "?",
65+ "mlx_lm": "0.31.3",
66+ "numpy": "2.4.4",
67+ "pydantic": "2.13.4",
68+ "python": "3.14.4",
69+ "safetensors": "0.7.0",
70+ "scipy": "1.17.1",
71+ "torch": "2.12.0",
72+ "transformers": "5.8.1"
73+ },
74+ "outputs": {
75+ "results": "experiments/summaries/tier1_taskvector_confirmatory_625c54bd186f/results.json"
76+ },
77+ "run_id": "tier1_taskvector_confirmatory_625c54bd186f",
78+ "seeds": {},
79+ "status": "completed",
80+ "warnings": []
81+}
\ No newline at end of file
added experiments/manifests/tier1_taskvector_confirmatory_82a78041c0ce.json +61 −0
@@ -0,0 +1,61 @@
1+{
2+ "config": {
3+ "k": 8,
4+ "pairs": [
5+ "qwen3b:qwen1.5b",
6+ "qwen1.5b:qwen3b",
7+ "llama3b:qwen3b",
8+ "qwen3b:llama3b"
9+ ],
10+ "quick": false,
11+ "split": "confirmatory",
12+ "task_seed": 0
13+ },
14+ "created_utc": "2026-11-09T08:42:55+00:00",
15+ "data_hashes": {},
16+ "experiment_id": "tier1_taskvector_confirmatory",
17+ "git": {
18+ "branch": "main",
19+ "commit": "043b146ef4ae8b081c2c6f0246c4c609b04db4c7",
20+ "dirty": true
21+ },
22+ "hardware": {
23+ "chip": "Apple M5 Max",
24+ "cpu_count": 18,
25+ "hostname_hash": "9ad7358c662e",
26+ "machine": "arm64",
27+ "memory_gb": 48.0,
28+ "platform": "macOS-27.0-arm64-arm-64bit-Mach-O",
29+ "torch_cuda": false,
30+ "torch_mps": true
31+ },
32+ "history": [
33+ {
34+ "note": "",
35+ "status": "running",
36+ "utc": "2026-11-09T08:42:58+00:00"
37+ },
38+ {
39+ "note": "first confirmatory attempt re-localized on confirmatory queries (A2/D13); a relaunch under the same id was killed; superseded by the A2 run id",
40+ "status": "invalidated",
41+ "utc": "2026-11-09T08:55:00+00:00"
42+ }
43+ ],
44+ "interpretation": "",
45+ "libraries": {
46+ "mlx": "?",
47+ "mlx_lm": "0.31.3",
48+ "numpy": "2.4.4",
49+ "pydantic": "2.13.4",
50+ "python": "3.14.4",
51+ "safetensors": "0.7.0",
52+ "scipy": "1.17.1",
53+ "torch": "2.12.0",
54+ "transformers": "5.8.1"
55+ },
56+ "outputs": {},
57+ "run_id": "tier1_taskvector_confirmatory_82a78041c0ce",
58+ "seeds": {},
59+ "status": "invalidated",
60+ "warnings": []
61+}
\ No newline at end of file
modified experiments/manifests/tier1_taskvector_e105e3d91386.json +27 −3
@@ -12,7 +12,24 @@
12 "task_seed": 0 12 "task_seed": 0
13 }, 13 },
14 "created_utc": "2026-11-09T07:46:30+00:00", 14 "created_utc": "2026-11-09T07:46:30+00:00",
15− "data_hashes": {}, 15+ "data_hashes": {
16+ "addthree": {
17+ "hash": "e2d74cd2fbf01431",
18+ "n_queries": 35
19+ },
20+ "antonym": {
21+ "hash": "6f74ac11f9505135",
22+ "n_queries": 32
23+ },
24+ "capital": {
25+ "hash": "78ba5b39d43d42d5",
26+ "n_queries": 22
27+ },
28+ "morph": {
29+ "hash": "df15df1dd69d1028",
30+ "n_queries": 40
31+ }
32+ },
16 "experiment_id": "tier1_taskvector", 33 "experiment_id": "tier1_taskvector",
17 "git": { 34 "git": {
18 "branch": "main", 35 "branch": "main",
@@ -34,6 +51,11 @@
34 "note": "", 51 "note": "",
35 "status": "running", 52 "status": "running",
36 "utc": "2026-11-09T07:46:33+00:00" 53 "utc": "2026-11-09T07:46:33+00:00"
54+ },
55+ {
56+ "note": "",
57+ "status": "completed",
58+ "utc": "2026-11-09T08:14:02+00:00"
37 } 59 }
38 ], 60 ],
39 "interpretation": "", 61 "interpretation": "",
@@ -48,9 +70,11 @@
48 "torch": "2.12.0", 70 "torch": "2.12.0",
49 "transformers": "5.8.1" 71 "transformers": "5.8.1"
50 }, 72 },
51− "outputs": {}, 73+ "outputs": {
74+ "results": "experiments/summaries/tier1_taskvector_e105e3d91386/results.json"
75+ },
52 "run_id": "tier1_taskvector_e105e3d91386", 76 "run_id": "tier1_taskvector_e105e3d91386",
53 "seeds": {}, 77 "seeds": {},
54− "status": "running", 78+ "status": "completed",
55 "warnings": [] 79 "warnings": []
56 } 80 }
\ No newline at end of file
added experiments/manifests/tier1_taskvector_eb5d091bf5ed.json +77 −0
@@ -0,0 +1,77 @@
1+{
2+ "config": {
3+ "k": 8,
4+ "pairs": [
5+ "qwen7b:qwen3b",
6+ "qwen3b:qwen7b",
7+ "qwen7b:llama3b"
8+ ],
9+ "quick": false,
10+ "split": "dev",
11+ "task_seed": 0
12+ },
13+ "created_utc": "2026-11-09T07:54:32+00:00",
14+ "data_hashes": {
15+ "addthree": {
16+ "hash": "e2d74cd2fbf01431",
17+ "n_queries": 35
18+ },
19+ "antonym": {
20+ "hash": "6f74ac11f9505135",
21+ "n_queries": 32
22+ },
23+ "capital": {
24+ "hash": "78ba5b39d43d42d5",
25+ "n_queries": 22
26+ },
27+ "morph": {
28+ "hash": "df15df1dd69d1028",
29+ "n_queries": 40
30+ }
31+ },
32+ "experiment_id": "tier1_taskvector",
33+ "git": {
34+ "branch": null,
35+ "commit": null,
36+ "dirty": null
37+ },
38+ "hardware": {
39+ "chip": "Apple M3 Ultra",
40+ "cpu_count": 28,
41+ "hostname_hash": "1f59c4ad75ba",
42+ "machine": "arm64",
43+ "memory_gb": 96.0,
44+ "platform": "macOS-26.4-arm64-arm-64bit-Mach-O"
45+ },
46+ "history": [
47+ {
48+ "note": "",
49+ "status": "running",
50+ "utc": "2026-11-09T07:54:32+00:00"
51+ },
52+ {
53+ "note": "",
54+ "status": "completed",
55+ "utc": "2026-11-09T08:36:41+00:00"
56+ }
57+ ],
58+ "interpretation": "",
59+ "libraries": {
60+ "mlx": "?",
61+ "mlx_lm": "0.31.3",
62+ "numpy": "2.4.4",
63+ "pydantic": "2.13.4",
64+ "python": "3.14.4",
65+ "safetensors": "0.7.0",
66+ "scipy": "1.17.1",
67+ "torch": null,
68+ "transformers": "5.10.2"
69+ },
70+ "outputs": {
71+ "results": "experiments/summaries/tier1_taskvector_eb5d091bf5ed/results.json"
72+ },
73+ "run_id": "tier1_taskvector_eb5d091bf5ed",
74+ "seeds": {},
75+ "status": "completed",
76+ "warnings": []
77+}
\ No newline at end of file
modified experiments/registry/runs.jsonl +12 −0
@@ -23,3 +23,15 @@
23 {"experiment_id": "graft_tier0_confirmatory", "results": "experiments/summaries/graft_tier0_confirmatory_0c2257f6803e/results.json", "run_id": "graft_tier0_confirmatory_0c2257f6803e", "status": "completed", "utc": "2026-11-09T07:44:03+00:00"} 23 {"experiment_id": "graft_tier0_confirmatory", "results": "experiments/summaries/graft_tier0_confirmatory_0c2257f6803e/results.json", "run_id": "graft_tier0_confirmatory_0c2257f6803e", "status": "completed", "utc": "2026-11-09T07:44:03+00:00"}
24 {"error": "ValueError(\"invalid literal for int() with base 10: 'rocrustes'\")", "experiment_id": "tier1_taskvector", "run_id": "tier1_taskvector_e105e3d91386", "status": "failed", "utc": "2026-11-09T07:45:09+00:00"} 24 {"error": "ValueError(\"invalid literal for int() with base 10: 'rocrustes'\")", "experiment_id": "tier1_taskvector", "run_id": "tier1_taskvector_e105e3d91386", "status": "failed", "utc": "2026-11-09T07:45:09+00:00"}
25 {"config_hash": "e105e3d91386", "experiment_id": "tier1_taskvector", "run_id": "tier1_taskvector_e105e3d91386", "status": "planned", "utc": "2026-11-09T07:46:33+00:00"} 25 {"config_hash": "e105e3d91386", "experiment_id": "tier1_taskvector", "run_id": "tier1_taskvector_e105e3d91386", "status": "planned", "utc": "2026-11-09T07:46:33+00:00"}
26+{"experiment_id": "tier1_taskvector", "run_id": "tier1_taskvector_e105e3d91386", "status": "completed", "utc": "2026-11-09T08:14:02+00:00"}
27+{"config_hash": "82a78041c0ce", "experiment_id": "tier1_taskvector_confirmatory", "run_id": "tier1_taskvector_confirmatory_82a78041c0ce", "status": "planned", "utc": "2026-11-09T08:15:06+00:00"}
28+{"config_hash": "eb5d091bf5ed", "experiment_id": "tier1_taskvector", "run_id": "tier1_taskvector_eb5d091bf5ed", "status": "planned", "utc": "2026-11-09T07:50:22+00:00"}
29+{"error": "ModuleNotFoundError(\"No module named 'torch'\")", "experiment_id": "tier1_taskvector", "run_id": "tier1_taskvector_eb5d091bf5ed", "status": "failed", "utc": "2026-11-09T07:50:22+00:00"}
30+{"config_hash": "eb5d091bf5ed", "experiment_id": "tier1_taskvector", "run_id": "tier1_taskvector_eb5d091bf5ed", "status": "planned", "utc": "2026-11-09T07:51:06+00:00"}
31+{"config_hash": "eb5d091bf5ed", "experiment_id": "tier1_taskvector", "run_id": "tier1_taskvector_eb5d091bf5ed", "status": "planned", "utc": "2026-11-09T07:54:32+00:00"}
32+{"experiment_id": "tier1_taskvector", "run_id": "tier1_taskvector_eb5d091bf5ed", "status": "completed", "utc": "2026-11-09T08:36:41+00:00"}
33+{"experiment_id": "tier1_taskvector_confirmatory", "run_id": "tier1_taskvector_confirmatory_82a78041c0ce", "status": "completed", "utc": "2026-11-09T08:41:48+00:00"}
34+{"utc": "2026-11-09T08:50:00+00:00", "run_id": "tier1_taskvector_confirmatory_82a78041c0ce", "experiment_id": "tier1_taskvector_confirmatory", "status": "invalidated", "note": "layers not frozen from dev (A2/D13)"}
35+{"config_hash": "82a78041c0ce", "experiment_id": "tier1_taskvector_confirmatory", "run_id": "tier1_taskvector_confirmatory_82a78041c0ce", "status": "planned", "utc": "2026-11-09T08:42:58+00:00"}
36+{"config_hash": "625c54bd186f", "experiment_id": "tier1_taskvector_confirmatory", "run_id": "tier1_taskvector_confirmatory_625c54bd186f", "status": "planned", "utc": "2026-11-09T08:44:08+00:00"}
37+{"experiment_id": "tier1_taskvector_confirmatory", "run_id": "tier1_taskvector_confirmatory_625c54bd186f", "status": "completed", "utc": "2026-11-09T09:06:53+00:00"}
added experiments/summaries/tier1_taskvector_confirmatory_625c54bd186f/TIER1_CONFIRMATORY.md +26 −0
@@ -0,0 +1,26 @@
1+# Tier-1/2 confirmatory analysis — dev `tier1_taskvector_e105e3d91386`, confirmatory `tier1_taskvector_confirmatory_625c54bd186f`
2+
3+| pair | task | eligible (own vector dev) | selected condition (dev acc) | conf: zero / few / own / selected / best control | selected − best control [95% CI] |
4+|---|---|---|---|---|---|
5+| qwen3b->qwen1.5b | antonym | yes (0.88) | replace_donor_fewshot|procrustes|L16 (0.72) | 0.19 / 0.94 / 0.91 / **0.59** / 0.44 (random_orth|L19|a1.0) | +0.16 [+0.00, +0.34]; pre-A1 control 0.69; shuffled-query diag. 0.69 |
6+| qwen3b->qwen1.5b | capital | yes (0.86) | ridge|L22|a1.0 (0.18) | 0.00 / 1.00 / 0.82 / **0.09** / 0.00 (random_orth|L19|a1.0) | +0.09 [+0.00, +0.23]; pre-A1 control 0.00; shuffled-query diag. 0.00 |
7+| qwen3b->qwen1.5b | morph | no (0.00) | procrustes|L2|a1.0 (0.00) | 0.00 / 0.30 / 0.00 / **0.00** / 0.00 (random_orth|L2|a1.0) | +0.00 [+0.00, +0.00]; pre-A1 control 0.00; shuffled-query diag. 0.00 |
8+| qwen3b->qwen1.5b | addthree | no (0.00) | procrustes|L2|a1.0 (0.00) | 0.00 / 0.86 / 0.00 / **0.00** / 0.00 (random_orth|L2|a1.0) | +0.00 [+0.00, +0.00]; pre-A1 control 0.00; shuffled-query diag. 0.00 |
9+| **qwen3b->qwen1.5b** | | | | | **H6 not supported (0 task(s))** |
10+| qwen1.5b->qwen3b | antonym | yes (0.88) | procrustes_rescaled|L21|a1.0 (0.75) | 0.09 / 0.94 / 0.91 / **0.69** / 0.41 (ctl_unrelated_task_vector(capital)|L25) | +0.28 [+0.09, +0.47]; pre-A1 control 0.81; shuffled-query diag. 0.81 |
11+| qwen1.5b->qwen3b | capital | yes (0.82) | procrustes|L28|a1.0 (0.73) | 0.14 / 1.00 / 0.82 / **0.55** / 0.18 (ctl_unrelated_task_vector(antonym)|L28) | +0.36 [+0.14, +0.59] ✔; pre-A1 control 0.27; shuffled-query diag. 0.27 |
12+| qwen1.5b->qwen3b | morph | no (0.00) | procrustes|L2|a1.0 (0.00) | 0.00 / 0.40 / 0.00 / **0.00** / 0.00 (random_orth|L2|a1.0) | +0.00 [+0.00, +0.00]; pre-A1 control 0.00; shuffled-query diag. 0.00 |
13+| qwen1.5b->qwen3b | addthree | no (0.00) | procrustes|L2|a1.0 (0.00) | 0.00 / 1.00 / 0.00 / **0.00** / 0.00 (random_orth|L2|a1.0) | +0.00 [+0.00, +0.00]; pre-A1 control 0.00; shuffled-query diag. 0.00 |
14+| **qwen1.5b->qwen3b** | | | | | **H6 partial (1 task(s))** |
15+| llama3b->qwen3b | antonym | yes (0.88) | cca|L25|a1.0 (0.81) | 0.09 / 0.94 / 0.91 / **0.81** / 0.31 (ctl_unrelated_task_vector(capital)|L25) | +0.50 [+0.31, +0.69] ✔; pre-A1 control 0.81; shuffled-query diag. 0.81 |
16+| llama3b->qwen3b | capital | yes (0.82) | cca|L18|a1.0 (0.50) | 0.14 / 1.00 / 0.82 / **0.64** / 0.45 (ctl_replace_donor_zeroshot|sham_map|L18) | +0.18 [+0.05, +0.36]; pre-A1 control 0.45; shuffled-query diag. 0.41 |
17+| llama3b->qwen3b | morph | no (0.00) | procrustes|L2|a1.0 (0.00) | 0.00 / 0.40 / 0.00 / **0.00** / 0.00 (random_orth|L2|a1.0) | +0.00 [+0.00, +0.00]; pre-A1 control 0.00; shuffled-query diag. 0.00 |
18+| llama3b->qwen3b | addthree | no (0.00) | procrustes|L2|a1.0 (0.00) | 0.00 / 1.00 / 0.00 / **0.00** / 0.00 (random_orth|L2|a1.0) | +0.00 [+0.00, +0.00]; pre-A1 control 0.00; shuffled-query diag. 0.00 |
19+| **llama3b->qwen3b** | | | | | **H6 partial (1 task(s))** |
20+| qwen3b->llama3b | antonym | yes (0.84) | procrustes|L14|a1.0 (0.66) | 0.06 / 0.91 / 0.84 / **0.59** / 0.34 (ctl_unrelated_task_vector(capital)|L19) | +0.25 [+0.09, +0.41]; pre-A1 control 0.38; shuffled-query diag. 0.38 |
21+| qwen3b->llama3b | capital | yes (1.00) | procrustes|L14|a1.0 (0.05) | 0.09 / 1.00 / 1.00 / **0.09** / 0.14 (ctl_unrelated_task_vector(antonym)|L14) | -0.05 [-0.18, +0.09]; pre-A1 control 0.14; shuffled-query diag. 0.09 |
22+| qwen3b->llama3b | morph | no (0.00) | procrustes|L2|a1.0 (0.00) | 0.00 / 0.28 / 0.00 / **0.00** / 0.00 (random_orth|L2|a1.0) | +0.00 [+0.00, +0.00]; pre-A1 control 0.00; shuffled-query diag. 0.00 |
23+| qwen3b->llama3b | addthree | yes (0.80) | procrustes|L2|a1.0 (0.00) | 0.00 / 1.00 / 0.69 / **0.00** / 0.00 (random_orth|L2|a1.0) | +0.00 [+0.00, +0.00]; pre-A1 control 0.00; shuffled-query diag. 0.00 |
24+| **qwen3b->llama3b** | | | | | **H6 not supported (0 task(s))** |
25+
26+Note: CIs are exact paired item bootstraps (2 000 draws) on per-item correctness stored in the confirmatory results.
added experiments/summaries/tier1_taskvector_confirmatory_625c54bd186f/results.json +19597 −0
@@ -0,0 +1,35102 @@
1+{
2+ "tasks": {
3+ "antonym": {
4+ "n_queries": 32,
5+ "hash": "fd3396e4fae62697"
6+ },
7+ "capital": {
8+ "n_queries": 22,
9+ "hash": "e19a1f86c4dae78e"
10+ },
11+ "morph": {
12+ "n_queries": 40,
13+ "hash": "09bcd55b41ce2ba7"
14+ },
15+ "addthree": {
16+ "n_queries": 35,
17+ "hash": "cd3d9a8ce6bdbdd9"
18+ }
19+ },
20+ "models": {
21+ "llama3b": {
22+ "repo": "mlx-community/Llama-3.2-3B-Instruct-bf16",
23+ "family": "Llama-3.2",
24+ "license": "Llama 3.2 Community License",
25+ "n_layers": 28,
26+ "hidden": 3072,
27+ "precision": "bf16",
28+ "localization": {
29+ "layers": [
30+ 2,
31+ 5,
32+ 8,
33+ 11,
34+ 14,
35+ 16,
36+ 19,
37+ 22,
38+ 25
39+ ],
40+ "tasks": {
41+ "antonym": {
42+ "zero_shot": 0.15625,
43+ "few_shot": 0.875,
44+ "sufficiency_by_layer": {
45+ "2": 0.1875,
46+ "5": 0.15625,
47+ "8": 0.3125,
48+ "11": 0.78125,
49+ "14": 0.84375,
50+ "16": 0.75,
51+ "19": 0.59375,
52+ "22": 0.40625,
53+ "25": 0.25
54+ },
55+ "best_layer": 14,
56+ "necessity_fewshot_minus_direction": 0.90625,
57+ "random_vector_same_norm_at_best": 0.0625,
58+ "vector_norm": 10.605620384216309
59+ },
60+ "capital": {
61+ "zero_shot": 0.0,
62+ "few_shot": 1.0,
63+ "sufficiency_by_layer": {
64+ "2": 0.13636363636363635,
65+ "5": 0.045454545454545456,
66+ "8": 0.045454545454545456,
67+ "11": 0.0,
68+ "14": 1.0,
69+ "16": 1.0,
70+ "19": 1.0,
71+ "22": 0.9090909090909091,
72+ "25": 0.9090909090909091
73+ },
74+ "best_layer": 14,
75+ "necessity_fewshot_minus_direction": 1.0,
76+ "random_vector_same_norm_at_best": 0.0,
77+ "vector_norm": 11.205497741699219
78+ },
79+ "morph": {
80+ "zero_shot": 0.0,
81+ "few_shot": 0.35,
82+ "sufficiency_by_layer": {
83+ "2": 0.0,
84+ "5": 0.0,
85+ "8": 0.0,
86+ "11": 0.0,
87+ "14": 0.0,
88+ "16": 0.0,
89+ "19": 0.0,
90+ "22": 0.0,
91+ "25": 0.0
92+ },
93+ "best_layer": 2,
94+ "necessity_fewshot_minus_direction": 0.35,
95+ "random_vector_same_norm_at_best": 0.0,
96+ "vector_norm": 2.0388922691345215
97+ },
98+ "addthree": {
99+ "zero_shot": 0.0,
100+ "few_shot": 1.0,
101+ "sufficiency_by_layer": {
102+ "2": 0.0,
103+ "5": 0.0,
104+ "8": 0.0,
105+ "11": 0.0,
106+ "14": 0.8,
107+ "16": 0.0,
108+ "19": 0.0,
109+ "22": 0.0,
110+ "25": 0.0
111+ },
112+ "best_layer": 14,
113+ "necessity_fewshot_minus_direction": 1.0,
114+ "random_vector_same_norm_at_best": 0.0,
115+ "vector_norm": 12.959115982055664
116+ }
117+ }
118+ }
119+ },
120+ "qwen1.5b": {
121+ "repo": "mlx-community/Qwen2.5-1.5B-Instruct-bf16",
122+ "family": "Qwen2.5",
123+ "license": "Apache-2.0",
124+ "n_layers": 28,
125+ "hidden": 1536,
126+ "precision": "bf16",
127+ "localization": {
128+ "layers": [
129+ 2,
130+ 5,
131+ 8,
132+ 11,
133+ 14,
134+ 16,
135+ 19,
136+ 22,
137+ 25
138+ ],
139+ "tasks": {
140+ "antonym": {
141+ "zero_shot": 0.21875,
142+ "few_shot": 1.0,
143+ "sufficiency_by_layer": {
144+ "2": 0.15625,
145+ "5": 0.125,
146+ "8": 0.375,
147+ "11": 0.3125,
148+ "14": 0.75,
149+ "16": 0.875,
150+ "19": 0.84375,
151+ "22": 0.5625,
152+ "25": 0.5
153+ },
154+ "best_layer": 16,
155+ "necessity_fewshot_minus_direction": 1.0,
156+ "random_vector_same_norm_at_best": 0.46875,
157+ "vector_norm": 38.643898010253906
158+ },
159+ "capital": {
160+ "zero_shot": 0.0,
161+ "few_shot": 1.0,
162+ "sufficiency_by_layer": {
163+ "2": 0.045454545454545456,
164+ "5": 0.045454545454545456,
165+ "8": 0.045454545454545456,
166+ "11": 0.09090909090909091,
167+ "14": 0.18181818181818182,
168+ "16": 0.6818181818181818,
169+ "19": 0.5909090909090909,
170+ "22": 0.8636363636363636,
171+ "25": 0.7272727272727273
172+ },
173+ "best_layer": 22,
174+ "necessity_fewshot_minus_direction": 1.0,
175+ "random_vector_same_norm_at_best": 0.0,
176+ "vector_norm": 75.94140625
177+ },
178+ "morph": {
179+ "zero_shot": 0.0,
180+ "few_shot": 0.325,
181+ "sufficiency_by_layer": {
182+ "2": 0.0,
183+ "5": 0.0,
184+ "8": 0.0,
185+ "11": 0.0,
186+ "14": 0.0,
187+ "16": 0.0,
188+ "19": 0.0,
189+ "22": 0.0,
190+ "25": 0.0
191+ },
192+ "best_layer": 2,
193+ "necessity_fewshot_minus_direction": 0.325,
194+ "random_vector_same_norm_at_best": 0.0,
195+ "vector_norm": 12.061471939086914
196+ },
197+ "addthree": {
198+ "zero_shot": 0.0,
199+ "few_shot": 0.8571428571428571,
200+ "sufficiency_by_layer": {
201+ "2": 0.0,
202+ "5": 0.0,
203+ "8": 0.0,
204+ "11": 0.0,
205+ "14": 0.0,
206+ "16": 0.0,
207+ "19": 0.0,
208+ "22": 0.0,
209+ "25": 0.0
210+ },
211+ "best_layer": 2,
212+ "necessity_fewshot_minus_direction": 0.8571428571428571,
213+ "random_vector_same_norm_at_best": 0.0,
214+ "vector_norm": 12.514005661010742
215+ }
216+ }
217+ }
218+ },
219+ "qwen3b": {
220+ "repo": "mlx-community/Qwen2.5-3B-Instruct-bf16",
221+ "family": "Qwen2.5",
222+ "license": "Qwen Research License",
223+ "n_layers": 36,
224+ "hidden": 2048,
225+ "precision": "bf16",
226+ "localization": {
227+ "layers": [
228+ 2,
229+ 6,
230+ 10,
231+ 14,
232+ 18,
233+ 21,
234+ 25,
235+ 29,
236+ 33
237+ ],
238+ "tasks": {
239+ "antonym": {
240+ "zero_shot": 0.25,
241+ "few_shot": 0.9375,
242+ "sufficiency_by_layer": {
243+ "2": 0.3125,
244+ "6": 0.28125,
245+ "10": 0.34375,
246+ "14": 0.4375,
247+ "18": 0.46875,
248+ "21": 0.84375,
249+ "25": 0.875,
250+ "29": 0.875,
251+ "33": 0.3125
252+ },
253+ "best_layer": 25,
254+ "necessity_fewshot_minus_direction": 0.96875,
255+ "random_vector_same_norm_at_best": 0.0625,
256+ "vector_norm": 57.1178092956543
257+ },
258+ "capital": {
259+ "zero_shot": 0.0,
260+ "few_shot": 1.0,
261+ "sufficiency_by_layer": {
262+ "2": 0.0,
263+ "6": 0.0,
264+ "10": 0.0,
265+ "14": 0.13636363636363635,
266+ "18": 0.5,
267+ "21": 0.0,
268+ "25": 0.8181818181818182,
269+ "29": 0.8181818181818182,
270+ "33": 0.7727272727272727
271+ },
272+ "best_layer": 25,
273+ "necessity_fewshot_minus_direction": 1.0,
274+ "random_vector_same_norm_at_best": 0.0,
275+ "vector_norm": 56.586326599121094
276+ },
277+ "morph": {
278+ "zero_shot": 0.0,
279+ "few_shot": 0.4,
280+ "sufficiency_by_layer": {
281+ "2": 0.0,
282+ "6": 0.0,
283+ "10": 0.0,
284+ "14": 0.0,
285+ "18": 0.0,
286+ "21": 0.0,
287+ "25": 0.0,
288+ "29": 0.0,
289+ "33": 0.0
290+ },
291+ "best_layer": 2,
292+ "necessity_fewshot_minus_direction": 0.4,
293+ "random_vector_same_norm_at_best": 0.0,
294+ "vector_norm": 6.1436028480529785
295+ },
296+ "addthree": {
297+ "zero_shot": 0.0,
298+ "few_shot": 1.0,
299+ "sufficiency_by_layer": {
300+ "2": 0.0,
301+ "6": 0.0,
302+ "10": 0.0,
303+ "14": 0.0,
304+ "18": 0.0,
305+ "21": 0.0,
306+ "25": 0.0,
307+ "29": 0.0,
308+ "33": 0.0
309+ },
310+ "best_layer": 2,
311+ "necessity_fewshot_minus_direction": 1.0,
312+ "random_vector_same_norm_at_best": 0.0,
313+ "vector_norm": 5.985179901123047
314+ }
315+ }
316+ }
317+ }
318+ },
319+ "pairs": {
320+ "qwen3b->qwen1.5b": {
321+ "donor": "qwen3b",
322+ "recipient": "qwen1.5b",
323+ "tasks": {
324+ "antonym": {
325+ "recipient_zero": 0.1875,
326+ "recipient_few": 0.9375,
327+ "recipient_own_vector": 0.90625,
328+ "donor_layer": 25,
329+ "conditions": {
330+ "procrustes|L16|a1.0": {
331+ "accuracy": 0.5625,
332+ "gain_vs_zero": {
333+ "estimate": 0.375,
334+ "low": 0.21875,
335+ "high": 0.53125,
336+ "level": 0.95,
337+ "n_items": 32,
338+ "n_clusters": 32,
339+ "n_boot": 2000
340+ },
341+ "mapped_norm": 30.50225257873535,
342+ "outputs_sample": [
343+ " sad\n",
344+ " leave\n",
345+ " dim\n",
346+ " calm\n",
347+ " under\n"
348+ ],
349+ "correct": [
350+ 1.0,
351+ 0.0,
352+ 1.0,
353+ 0.0,
354+ 1.0,
355+ 0.0,
356+ 0.0,
357+ 1.0,
358+ 1.0,
359+ 1.0,
360+ 1.0,
361+ 0.0,
362+ 1.0,
363+ 0.0,
364+ 0.0,
365+ 1.0,
366+ 1.0,
367+ 1.0,
368+ 1.0,
369+ 1.0,
370+ 0.0,
371+ 0.0,
372+ 0.0,
373+ 1.0,
374+ 1.0,
375+ 0.0,
376+ 0.0,
377+ 1.0,
378+ 1.0,
379+ 0.0,
380+ 1.0,
381+ 0.0
382+ ]
383+ },
384+ "procrustes|L16|a2.0": {
385+ "accuracy": 0.53125,
386+ "gain_vs_zero": {
387+ "estimate": 0.34375,
388+ "low": 0.1875,
389+ "high": 0.5,
390+ "level": 0.95,
391+ "n_items": 32,
392+ "n_clusters": 32,
393+ "n_boot": 2000
394+ },
395+ "mapped_norm": 30.50225257873535,
396+ "outputs_sample": [
397+ " sad\n",
398+ " leave\n",
399+ " dim\n",
400+ " excited\n",
401+ " under\n"
402+ ],
403+ "correct": [
404+ 1.0,
405+ 0.0,
406+ 1.0,
407+ 0.0,
408+ 1.0,
409+ 0.0,
410+ 0.0,
411+ 1.0,
412+ 1.0,
413+ 1.0,
414+ 1.0,
415+ 1.0,
416+ 0.0,
417+ 0.0,
418+ 1.0,
419+ 0.0,
420+ 0.0,
421+ 1.0,
422+ 1.0,
423+ 1.0,
424+ 0.0,
425+ 0.0,
426+ 0.0,
427+ 1.0,
428+ 1.0,
429+ 0.0,
430+ 0.0,
431+ 1.0,
432+ 1.0,
433+ 0.0,
434+ 1.0,
435+ 0.0
436+ ]
437+ },
438+ "procrustes_rescaled|L16|a1.0": {
439+ "accuracy": 0.53125,
440+ "gain_vs_zero": {
441+ "estimate": 0.34375,
442+ "low": 0.15625,
443+ "high": 0.53125,
444+ "level": 0.95,
445+ "n_items": 32,
446+ "n_clusters": 32,
447+ "n_boot": 2000
448+ },
449+ "mapped_norm": 38.643898010253906,
450+ "outputs_sample": [
451+ " sad\n",
452+ " leave\n",
453+ " dim\n",
454+ " calm\n",
455+ " under\n"
456+ ],
457+ "correct": [
458+ 1.0,
459+ 0.0,
460+ 1.0,
461+ 0.0,
462+ 1.0,
463+ 0.0,
464+ 0.0,
465+ 1.0,
466+ 1.0,
467+ 1.0,
468+ 1.0,
469+ 0.0,
470+ 1.0,
471+ 0.0,
472+ 0.0,
473+ 1.0,
474+ 1.0,
475+ 1.0,
476+ 1.0,
477+ 1.0,
478+ 0.0,
479+ 0.0,
480+ 0.0,
481+ 1.0,
482+ 1.0,
483+ 0.0,
484+ 0.0,
485+ 0.0,
486+ 1.0,
487+ 0.0,
488+ 1.0,
489+ 0.0
490+ ]
491+ },
492+ "ridge|L16|a1.0": {
493+ "accuracy": 0.53125,
494+ "gain_vs_zero": {
495+ "estimate": 0.34375,
496+ "low": 0.1875,
497+ "high": 0.5,
498+ "level": 0.95,
499+ "n_items": 32,
500+ "n_clusters": 32,
501+ "n_boot": 2000
502+ },
503+ "mapped_norm": 34.40007019042969,
504+ "outputs_sample": [
505+ " sad\n",
506+ " depart\n",
507+ " dark\n",
508+ " peaceful\n",
509+ " under\n"
510+ ],
511+ "correct": [
512+ 1.0,
513+ 1.0,
514+ 1.0,
515+ 0.0,
516+ 1.0,
517+ 0.0,
518+ 0.0,
519+ 1.0,
520+ 0.0,
521+ 1.0,
522+ 1.0,
523+ 0.0,
524+ 0.0,
525+ 1.0,
526+ 0.0,
527+ 1.0,
528+ 0.0,
529+ 1.0,
530+ 1.0,
531+ 1.0,
532+ 0.0,
533+ 0.0,
534+ 0.0,
535+ 1.0,
536+ 1.0,
537+ 0.0,
538+ 0.0,
539+ 1.0,
540+ 1.0,
541+ 0.0,
542+ 1.0,
543+ 0.0
544+ ]
545+ },
546+ "ridge|L16|a2.0": {
547+ "accuracy": 0.25,
548+ "gain_vs_zero": {
549+ "estimate": 0.0625,
550+ "low": -0.125,
551+ "high": 0.25,
552+ "level": 0.95,
553+ "n_items": 32,
554+ "n_clusters": 32,
555+ "n_boot": 2000
556+ },
557+ "mapped_norm": 34.40007019042969,
558+ "outputs_sample": [
559+ " happy\n",
560+ " abandon\n",
561+ " warm\n",
562+ " proud\n\n",
563+ " under\n"
564+ ],
565+ "correct": [
566+ 0.0,
567+ 0.0,
568+ 0.0,
569+ 0.0,
570+ 1.0,
571+ 0.0,
572+ 0.0,
573+ 1.0,
574+ 0.0,
575+ 1.0,
576+ 1.0,
577+ 0.0,
578+ 0.0,
579+ 0.0,
580+ 1.0,
581+ 0.0,
582+ 0.0,
583+ 0.0,
584+ 0.0,
585+ 1.0,
586+ 1.0,
587+ 0.0,
588+ 0.0,
589+ 0.0,
590+ 0.0,
591+ 0.0,
592+ 0.0,
593+ 0.0,
594+ 1.0,
595+ 0.0,
596+ 0.0,
597+ 0.0
598+ ]
599+ },
600+ "ridge_rescaled|L16|a1.0": {
601+ "accuracy": 0.4375,
602+ "gain_vs_zero": {
603+ "estimate": 0.25,
604+ "low": 0.09375,
605+ "high": 0.40625,
606+ "level": 0.95,
607+ "n_items": 32,
608+ "n_clusters": 32,
609+ "n_boot": 2000
610+ },
611+ "mapped_norm": 38.643898010253906,
612+ "outputs_sample": [
613+ " sad\n",
614+ " leave\n",
615+ " bright\n",
616+ " peaceful\n",
617+ " over\n"
618+ ],
619+ "correct": [
620+ 1.0,
621+ 0.0,
622+ 0.0,
623+ 0.0,
624+ 0.0,
625+ 0.0,
626+ 0.0,
627+ 1.0,
628+ 0.0,
629+ 1.0,
630+ 1.0,
631+ 0.0,
632+ 0.0,
633+ 1.0,
634+ 0.0,
635+ 1.0,
636+ 0.0,
637+ 1.0,
638+ 1.0,
639+ 1.0,
640+ 0.0,
641+ 0.0,
642+ 0.0,
643+ 1.0,
644+ 1.0,
645+ 0.0,
646+ 0.0,
647+ 1.0,
648+ 1.0,
649+ 0.0,
650+ 1.0,
651+ 0.0
652+ ]
653+ },
654+ "cca|L16|a1.0": {
655+ "accuracy": 0.375,
656+ "gain_vs_zero": {
657+ "estimate": 0.1875,
658+ "low": 0.03125,
659+ "high": 0.34375,
660+ "level": 0.95,
661+ "n_items": 32,
662+ "n_clusters": 32,
663+ "n_boot": 2000
664+ },
665+ "mapped_norm": 37.07581329345703,
666+ "outputs_sample": [
667+ " sad\n",
668+ " arrive\n",
669+ " bright\n",
670+ " peaceful\n",
671+ " over\n"
672+ ],
673+ "correct": [
674+ 1.0,
675+ 0.0,
676+ 0.0,
677+ 0.0,
678+ 0.0,
679+ 0.0,
680+ 0.0,
681+ 1.0,
682+ 0.0,
683+ 0.0,
684+ 1.0,
685+ 0.0,
686+ 0.0,
687+ 1.0,
688+ 0.0,
689+ 1.0,
690+ 0.0,
691+ 1.0,
692+ 1.0,
693+ 1.0,
694+ 0.0,
695+ 0.0,
696+ 0.0,
697+ 1.0,
698+ 1.0,
699+ 0.0,
700+ 0.0,
701+ 0.0,
702+ 1.0,
703+ 0.0,
704+ 1.0,
705+ 0.0
706+ ]
707+ },
708+ "cca|L16|a2.0": {
709+ "accuracy": 0.125,
710+ "gain_vs_zero": {
711+ "estimate": -0.0625,
712+ "low": -0.21875,
713+ "high": 0.0625,
714+ "level": 0.95,
715+ "n_items": 32,
716+ "n_clusters": 32,
717+ "n_boot": 2000
718+ },
719+ "mapped_norm": 37.07581329345703,
720+ "outputs_sample": [
721+ " happy\n",
722+ " abandon\n",
723+ " happy\n",
724+ " happy\n",
725+ " over\n"
726+ ],
727+ "correct": [
728+ 0.0,
729+ 0.0,
730+ 0.0,
731+ 0.0,
732+ 0.0,
733+ 0.0,
734+ 0.0,
735+ 1.0,
736+ 0.0,
737+ 0.0,
738+ 1.0,
739+ 0.0,
740+ 0.0,
741+ 0.0,
742+ 0.0,
743+ 0.0,
744+ 0.0,
745+ 0.0,
746+ 0.0,
747+ 1.0,
748+ 0.0,
749+ 0.0,
750+ 0.0,
751+ 0.0,
752+ 0.0,
753+ 0.0,
754+ 0.0,
755+ 0.0,
756+ 1.0,
757+ 0.0,
758+ 0.0,
759+ 0.0
760+ ]
761+ },
762+ "random_orth|L16|a1.0": {
763+ "accuracy": 0.125,
764+ "gain_vs_zero": {
765+ "estimate": -0.0625,
766+ "low": -0.1875,
767+ "high": 0.03125,
768+ "level": 0.95,
769+ "n_items": 32,
770+ "n_clusters": 32,
771+ "n_boot": 2000
772+ },
773+ "mapped_norm": 30.70629119873047,
774+ "outputs_sample": [
775+ " 1\n",
776+ " arrive\n",
777+ " bright\n",
778+ " calm\n",
779+ " 1\n"
780+ ],
781+ "correct": [
782+ 0.0,
783+ 0.0,
784+ 0.0,
785+ 0.0,
786+ 0.0,
787+ 0.0,
788+ 0.0,
789+ 0.0,
790+ 0.0,
791+ 0.0,
792+ 0.0,
793+ 0.0,
794+ 0.0,
795+ 0.0,
796+ 0.0,
797+ 0.0,
798+ 0.0,
799+ 1.0,
800+ 0.0,
801+ 1.0,
802+ 0.0,
803+ 0.0,
804+ 0.0,
805+ 0.0,
806+ 1.0,
807+ 0.0,
808+ 0.0,
809+ 1.0,
810+ 0.0,
811+ 0.0,
812+ 0.0,
813+ 0.0
814+ ]
815+ },
816+ "random_orth|L16|a2.0": {
817+ "accuracy": 0.03125,
818+ "gain_vs_zero": {
819+ "estimate": -0.15625,
820+ "low": -0.28125,
821+ "high": -0.0625,
822+ "level": 0.95,
823+ "n_items": 32,
824+ "n_clusters": 32,
825+ "n_boot": 2000
826+ },
827+ "mapped_norm": 30.70629119873047,
828+ "outputs_sample": [
829+ " happy\n",
830+ " arrive\n",
831+ " bright\n",
832+ " calm\n",
833+ " over\n"
834+ ],
835+ "correct": [
836+ 0.0,
837+ 0.0,
838+ 0.0,
839+ 0.0,
840+ 0.0,
841+ 0.0,
842+ 0.0,
843+ 0.0,
844+ 0.0,
845+ 0.0,
846+ 0.0,
847+ 0.0,
848+ 0.0,
849+ 0.0,
850+ 0.0,
851+ 0.0,
852+ 0.0,
853+ 1.0,
854+ 0.0,
855+ 0.0,
856+ 0.0,
857+ 0.0,
858+ 0.0,
859+ 0.0,
860+ 0.0,
861+ 0.0,
862+ 0.0,
863+ 0.0,
864+ 0.0,
865+ 0.0,
866+ 0.0,
867+ 0.0
868+ ]
869+ },
870+ "replace_donor_fewshot|procrustes|L16": {
871+ "accuracy": 0.59375,
872+ "gain_vs_zero": {
873+ "estimate": 0.40625,
874+ "low": 0.25,
875+ "high": 0.5625,
876+ "level": 0.95,
877+ "n_items": 32,
878+ "n_clusters": 32,
879+ "n_boot": 2000
880+ },
881+ "outputs_sample": [
882+ " sad\n",
883+ " leave\n",
884+ " dim\n",
885+ " calm\n",
886+ " under\n"
887+ ],
888+ "correct": [
889+ 1.0,
890+ 0.0,
891+ 1.0,
892+ 0.0,
893+ 1.0,
894+ 0.0,
895+ 0.0,
896+ 1.0,
897+ 1.0,
898+ 1.0,
899+ 1.0,
900+ 0.0,
901+ 1.0,
902+ 1.0,
903+ 0.0,
904+ 1.0,
905+ 1.0,
906+ 1.0,
907+ 1.0,
908+ 1.0,
909+ 0.0,
910+ 0.0,
911+ 0.0,
912+ 1.0,
913+ 1.0,
914+ 0.0,
915+ 0.0,
916+ 1.0,
917+ 1.0,
918+ 0.0,
919+ 1.0,
920+ 0.0
921+ ]
922+ },
923+ "ctl_replace_donor_zeroshot|procrustes|L16": {
924+ "accuracy": 0.25,
925+ "gain_vs_zero": {
926+ "estimate": 0.0625,
927+ "low": -0.09375,
928+ "high": 0.21875,
929+ "level": 0.95,
930+ "n_items": 32,
931+ "n_clusters": 32,
932+ "n_boot": 2000
933+ },
934+ "outputs_sample": [
935+ " sad\n",
936+ " 0\n",
937+ " 10000",
938+ " \"calm\"\n",
939+ " 1\n"
940+ ],
941+ "correct": [
942+ 1.0,
943+ 0.0,
944+ 0.0,
945+ 0.0,
946+ 0.0,
947+ 0.0,
948+ 0.0,
949+ 0.0,
950+ 0.0,
951+ 0.0,
952+ 0.0,
953+ 0.0,
954+ 0.0,
955+ 0.0,
956+ 0.0,
957+ 1.0,
958+ 1.0,
959+ 0.0,
960+ 1.0,
961+ 1.0,
962+ 0.0,
963+ 0.0,
964+ 0.0,
965+ 0.0,
966+ 1.0,
967+ 0.0,
968+ 0.0,
969+ 1.0,
970+ 1.0,
971+ 0.0,
972+ 0.0,
973+ 0.0
974+ ]
975+ },
976+ "ctl_replace_donor_fewshot_shuffled_query|procrustes|L16": {
977+ "accuracy": 0.59375,
978+ "gain_vs_zero": {
979+ "estimate": 0.40625,
980+ "low": 0.25,
981+ "high": 0.5625,
982+ "level": 0.95,
983+ "n_items": 32,
984+ "n_clusters": 32,
985+ "n_boot": 2000
986+ },
987+ "outputs_sample": [
988+ " sad\n",
989+ " leave\n",
990+ " dim\n",
991+ " calm\n",
992+ " under\n"
993+ ],
994+ "correct": [
995+ 1.0,
996+ 0.0,
997+ 1.0,
998+ 0.0,
999+ 1.0,
1000+ 0.0,
1001+ 0.0,
1002+ 1.0,
1003+ 1.0,
1004+ 1.0,
1005+ 1.0,
1006+ 0.0,
1007+ 1.0,
1008+ 0.0,
1009+ 0.0,
1010+ 1.0,
1011+ 1.0,
1012+ 1.0,
1013+ 1.0,
1014+ 1.0,
1015+ 1.0,
1016+ 0.0,
1017+ 0.0,
1018+ 1.0,
1019+ 1.0,
1020+ 0.0,
1021+ 0.0,
1022+ 1.0,
1023+ 1.0,
1024+ 0.0,
1025+ 1.0,
1026+ 0.0
1027+ ]
1028+ },
1029+ "replace_donor_fewshot|ridge|L16": {
1030+ "accuracy": 0.65625,
1031+ "gain_vs_zero": {
1032+ "estimate": 0.46875,
1033+ "low": 0.28125,
1034+ "high": 0.625,
1035+ "level": 0.95,
1036+ "n_items": 32,
1037+ "n_clusters": 32,
1038+ "n_boot": 2000
1039+ },
1040+ "outputs_sample": [
1041+ " sad\n",
1042+ " depart\n",
1043+ " bright\n",
1044+ " calm\n",
1045+ " under\n"
1046+ ],
1047+ "correct": [
1048+ 1.0,
1049+ 1.0,
1050+ 0.0,
1051+ 0.0,
1052+ 1.0,
1053+ 0.0,
1054+ 0.0,
1055+ 1.0,
1056+ 1.0,
1057+ 1.0,
1058+ 1.0,
1059+ 1.0,
1060+ 0.0,
1061+ 1.0,
1062+ 1.0,
1063+ 1.0,
1064+ 1.0,
1065+ 1.0,
1066+ 1.0,
1067+ 1.0,
1068+ 1.0,
1069+ 0.0,
1070+ 0.0,
1071+ 1.0,
1072+ 1.0,
1073+ 0.0,
1074+ 0.0,
1075+ 1.0,
1076+ 1.0,
1077+ 0.0,
1078+ 1.0,
1079+ 0.0
1080+ ]
1081+ },
1082+ "ctl_replace_donor_zeroshot|ridge|L16": {
1083+ "accuracy": 0.21875,
1084+ "gain_vs_zero": {
1085+ "estimate": 0.03125,
1086+ "low": -0.09375,
1087+ "high": 0.15625,
1088+ "level": 0.95,
1089+ "n_items": 32,
1090+ "n_clusters": 32,
1091+ "n_boot": 2000
1092+ },
1093+ "outputs_sample": [
1094+ " sad\n",
1095+ " 0\n",
1096+ " 1\n\n",
1097+ " calm\n",
1098+ " 1\n"
1099+ ],
1100+ "correct": [
1101+ 1.0,
1102+ 0.0,
1103+ 0.0,
1104+ 0.0,
1105+ 0.0,
1106+ 0.0,
1107+ 0.0,
1108+ 0.0,
1109+ 0.0,
1110+ 0.0,
1111+ 0.0,
1112+ 0.0,
1113+ 0.0,
1114+ 1.0,
1115+ 0.0,
1116+ 0.0,
1117+ 1.0,
1118+ 1.0,
1119+ 1.0,
1120+ 0.0,
1121+ 0.0,
1122+ 0.0,
1123+ 0.0,
1124+ 0.0,
1125+ 1.0,
1126+ 0.0,
1127+ 0.0,
1128+ 0.0,
1129+ 1.0,
1130+ 0.0,
1131+ 0.0,
1132+ 0.0
1133+ ]
1134+ },
1135+ "ctl_replace_donor_fewshot_shuffled_query|ridge|L16": {
1136+ "accuracy": 0.59375,
1137+ "gain_vs_zero": {
1138+ "estimate": 0.40625,
1139+ "low": 0.21875,
1140+ "high": 0.59375,
1141+ "level": 0.95,
1142+ "n_items": 32,
1143+ "n_clusters": 32,
1144+ "n_boot": 2000
1145+ },
1146+ "outputs_sample": [
1147+ " sad\n",
1148+ " leave\n",
1149+ " dark\n",
1150+ " calm\n",
1151+ " under\n"
1152+ ],
1153+ "correct": [
1154+ 1.0,
1155+ 0.0,
1156+ 1.0,
1157+ 0.0,
1158+ 1.0,
1159+ 0.0,
1160+ 0.0,
1161+ 0.0,
1162+ 1.0,
1163+ 1.0,
1164+ 1.0,
1165+ 0.0,
1166+ 0.0,
1167+ 1.0,
1168+ 1.0,
1169+ 1.0,
1170+ 1.0,
1171+ 1.0,
1172+ 1.0,
1173+ 1.0,
1174+ 1.0,
1175+ 0.0,
1176+ 0.0,
1177+ 1.0,
1178+ 1.0,
1179+ 0.0,
1180+ 1.0,
1181+ 0.0,
1182+ 1.0,
1183+ 0.0,
1184+ 1.0,
1185+ 0.0
1186+ ]
1187+ },
1188+ "ctl_replace_donor_fewshot|sham_map|L16": {
1189+ "accuracy": 0.03125,
1190+ "gain_vs_zero": {
1191+ "estimate": -0.15625,
1192+ "low": -0.3125,
1193+ "high": 0.0,
1194+ "level": 0.95,
1195+ "n_items": 32,
1196+ "n_clusters": 32,
1197+ "n_boot": 2000
1198+ },
1199+ "outputs_sample": [
1200+ " happy\n",
1201+ " 1\n",
1202+ " bright\n\n",
1203+ " calm\n",
1204+ " 1\n"
1205+ ],
1206+ "correct": [
1207+ 0.0,
1208+ 0.0,
1209+ 0.0,
1210+ 0.0,
1211+ 0.0,
1212+ 0.0,
1213+ 0.0,
1214+ 0.0,
1215+ 1.0,
1216+ 0.0,
1217+ 0.0,
1218+ 0.0,
1219+ 0.0,
1220+ 0.0,
1221+ 0.0,
1222+ 0.0,
1223+ 0.0,
1224+ 0.0,
1225+ 0.0,
1226+ 0.0,
1227+ 0.0,
1228+ 0.0,
1229+ 0.0,
1230+ 0.0,
1231+ 0.0,
1232+ 0.0,
1233+ 0.0,
1234+ 0.0,
1235+ 0.0,
1236+ 0.0,
1237+ 0.0,
1238+ 0.0
1239+ ]
1240+ },
1241+ "ctl_replace_donor_zeroshot|sham_map|L16": {
1242+ "accuracy": 0.03125,
1243+ "gain_vs_zero": {
1244+ "estimate": -0.15625,
1245+ "low": -0.3125,
1246+ "high": 0.0,
1247+ "level": 0.95,
1248+ "n_items": 32,
1249+ "n_clusters": 32,
1250+ "n_boot": 2000
1251+ },
1252+ "outputs_sample": [
1253+ " 1\n",
1254+ " 1\n",
1255+ " 100\n\n",
1256+ " 1\n",
1257+ " 1\n"
1258+ ],
1259+ "correct": [
1260+ 0.0,
1261+ 0.0,
1262+ 0.0,
1263+ 0.0,
1264+ 0.0,
1265+ 0.0,
1266+ 0.0,
1267+ 0.0,
1268+ 1.0,
1269+ 0.0,
1270+ 0.0,
1271+ 0.0,
1272+ 0.0,
1273+ 0.0,
1274+ 0.0,
1275+ 0.0,
1276+ 0.0,
1277+ 0.0,
1278+ 0.0,
1279+ 0.0,
1280+ 0.0,
1281+ 0.0,
1282+ 0.0,
1283+ 0.0,
1284+ 0.0,
1285+ 0.0,
1286+ 0.0,
1287+ 0.0,
1288+ 0.0,
1289+ 0.0,
1290+ 0.0,
1291+ 0.0
1292+ ]
1293+ },
1294+ "ctl_replace_donor_fewshot_shuffled_query|sham_map|L16": {
1295+ "accuracy": 0.03125,
1296+ "gain_vs_zero": {
1297+ "estimate": -0.15625,
1298+ "low": -0.3125,
1299+ "high": 0.0,
1300+ "level": 0.95,
1301+ "n_items": 32,
1302+ "n_clusters": 32,
1303+ "n_boot": 2000
1304+ },
1305+ "outputs_sample": [
1306+ " happy\n",
1307+ " 1\n",
1308+ " 10000",
1309+ " calm\n",
1310+ " Over is a word that can"
1311+ ],
1312+ "correct": [
1313+ 0.0,
1314+ 0.0,
1315+ 0.0,
1316+ 0.0,
1317+ 0.0,
1318+ 0.0,
1319+ 0.0,
1320+ 0.0,
1321+ 1.0,
1322+ 0.0,
1323+ 0.0,
1324+ 0.0,
1325+ 0.0,
1326+ 0.0,
1327+ 0.0,
1328+ 0.0,
1329+ 0.0,
1330+ 0.0,
1331+ 0.0,
1332+ 0.0,
1333+ 0.0,
1334+ 0.0,
1335+ 0.0,
1336+ 0.0,
1337+ 0.0,
1338+ 0.0,
1339+ 0.0,
1340+ 0.0,
1341+ 0.0,
1342+ 0.0,
1343+ 0.0,
1344+ 0.0
1345+ ]
1346+ },
1347+ "ctl_random_norm_matched|L16": {
1348+ "accuracy": 0.03125,
1349+ "gain_vs_zero": {
1350+ "estimate": -0.15625,
1351+ "low": -0.28125,
1352+ "high": -0.0625,
1353+ "level": 0.95,
1354+ "n_items": 32,
1355+ "n_clusters": 32,
1356+ "n_boot": 2000
1357+ },
1358+ "correct": [
1359+ 0.0,
1360+ 0.0,
1361+ 0.0,
1362+ 0.0,
1363+ 0.0,
1364+ 0.0,
1365+ 0.0,
1366+ 0.0,
1367+ 0.0,
1368+ 0.0,
1369+ 0.0,
1370+ 0.0,
1371+ 0.0,
1372+ 0.0,
1373+ 0.0,
1374+ 0.0,
1375+ 0.0,
1376+ 0.0,
1377+ 0.0,
1378+ 0.0,
1379+ 0.0,
1380+ 0.0,
1381+ 0.0,
1382+ 0.0,
1383+ 0.0,
1384+ 0.0,
1385+ 0.0,
1386+ 0.0,
1387+ 1.0,
1388+ 0.0,
1389+ 0.0,
1390+ 0.0
1391+ ]
1392+ },
1393+ "ctl_unrelated_task_vector(capital)|L16": {
1394+ "accuracy": 0.09375,
1395+ "gain_vs_zero": {
1396+ "estimate": -0.09375,
1397+ "low": -0.1875,
1398+ "high": 0.0,
1399+ "level": 0.95,
1400+ "n_items": 32,
1401+ "n_clusters": 32,
1402+ "n_boot": 2000
1403+ },
1404+ "correct": [
1405+ 0.0,
1406+ 0.0,
1407+ 0.0,
1408+ 0.0,
1409+ 0.0,
1410+ 0.0,
1411+ 0.0,
1412+ 0.0,
1413+ 0.0,
1414+ 0.0,
1415+ 1.0,
1416+ 0.0,
1417+ 0.0,
1418+ 0.0,
1419+ 0.0,
1420+ 0.0,
1421+ 0.0,
1422+ 0.0,
1423+ 1.0,
1424+ 0.0,
1425+ 0.0,
1426+ 0.0,
1427+ 0.0,
1428+ 0.0,
1429+ 0.0,
1430+ 0.0,
1431+ 0.0,
1432+ 1.0,
1433+ 0.0,
1434+ 0.0,
1435+ 0.0,
1436+ 0.0
1437+ ]
1438+ },
1439+ "procrustes|L19|a1.0": {
1440+ "accuracy": 0.625,
1441+ "gain_vs_zero": {
1442+ "estimate": 0.4375,
1443+ "low": 0.25,
1444+ "high": 0.59375,
1445+ "level": 0.95,
1446+ "n_items": 32,
1447+ "n_clusters": 32,
1448+ "n_boot": 2000
1449+ },
1450+ "mapped_norm": 43.63785171508789,
1451+ "outputs_sample": [
1452+ " sad\n",
1453+ " leave\n",
1454+ " dark\n",
1455+ " calm\n",
1456+ " under\n"
1457+ ],
1458+ "correct": [
1459+ 1.0,
1460+ 0.0,
1461+ 1.0,
1462+ 0.0,
1463+ 1.0,
1464+ 0.0,
1465+ 1.0,
1466+ 1.0,
1467+ 0.0,
1468+ 1.0,
1469+ 1.0,
1470+ 0.0,
1471+ 1.0,
1472+ 1.0,
1473+ 0.0,
1474+ 1.0,
1475+ 1.0,
1476+ 1.0,
1477+ 1.0,
1478+ 1.0,
1479+ 1.0,
1480+ 0.0,
1481+ 0.0,
1482+ 1.0,
1483+ 1.0,
1484+ 0.0,
1485+ 0.0,
1486+ 1.0,
1487+ 1.0,
1488+ 0.0,
1489+ 1.0,
1490+ 0.0
1491+ ]
1492+ },
1493+ "procrustes|L19|a2.0": {
1494+ "accuracy": 0.25,
1495+ "gain_vs_zero": {
1496+ "estimate": 0.0625,
1497+ "low": -0.09375,
1498+ "high": 0.1875,
1499+ "level": 0.95,
1500+ "n_items": 32,
1501+ "n_clusters": 32,
1502+ "n_boot": 2000
1503+ },
1504+ "mapped_norm": 43.63785171508789,
1505+ "outputs_sample": [
1506+ " peace\n",
1507+ " arrive\n",
1508+ " light\n",
1509+ " peace\n",
1510+ " peace\n\n"
1511+ ],
1512+ "correct": [
1513+ 0.0,
1514+ 0.0,
1515+ 0.0,
1516+ 0.0,
1517+ 0.0,
1518+ 0.0,
1519+ 0.0,
1520+ 0.0,
1521+ 1.0,
1522+ 1.0,
1523+ 1.0,
1524+ 0.0,
1525+ 0.0,
1526+ 0.0,
1527+ 0.0,
1528+ 1.0,
1529+ 0.0,
1530+ 1.0,
1531+ 0.0,
1532+ 0.0,
1533+ 0.0,
1534+ 0.0,
1535+ 0.0,
1536+ 0.0,
1537+ 0.0,
1538+ 0.0,
1539+ 0.0,
1540+ 1.0,
1541+ 1.0,
1542+ 0.0,
1543+ 1.0,
1544+ 0.0
1545+ ]
1546+ },
1547+ "procrustes_rescaled|L19|a1.0": {
1548+ "accuracy": 0.625,
1549+ "gain_vs_zero": {
1550+ "estimate": 0.4375,
1551+ "low": 0.25,
1552+ "high": 0.59375,
1553+ "level": 0.95,
1554+ "n_items": 32,
1555+ "n_clusters": 32,
1556+ "n_boot": 2000
1557+ },
1558+ "mapped_norm": 38.643898010253906,
1559+ "outputs_sample": [
1560+ " sad\n",
1561+ " leave\n",
1562+ " dark\n",
1563+ " calm\n",
1564+ " under\n"
1565+ ],
1566+ "correct": [
1567+ 1.0,
1568+ 0.0,
1569+ 1.0,
1570+ 0.0,
1571+ 1.0,
1572+ 0.0,
1573+ 1.0,
1574+ 1.0,
1575+ 0.0,
1576+ 1.0,
1577+ 1.0,
1578+ 0.0,
1579+ 1.0,
1580+ 1.0,
1581+ 0.0,
1582+ 1.0,
1583+ 1.0,
1584+ 1.0,
1585+ 1.0,
1586+ 1.0,
1587+ 1.0,
1588+ 0.0,
1589+ 0.0,
1590+ 1.0,
1591+ 1.0,
1592+ 0.0,
1593+ 0.0,
1594+ 1.0,
1595+ 1.0,
1596+ 0.0,
1597+ 1.0,
1598+ 0.0
1599+ ]
1600+ },
1601+ "ridge|L19|a1.0": {
1602+ "accuracy": 0.4375,
1603+ "gain_vs_zero": {
1604+ "estimate": 0.25,
1605+ "low": 0.0625,
1606+ "high": 0.4375,
1607+ "level": 0.95,
1608+ "n_items": 32,
1609+ "n_clusters": 32,
1610+ "n_boot": 2000
1611+ },
1612+ "mapped_norm": 46.0419921875,
1613+ "outputs_sample": [
1614+ " happy\n",
1615+ " leave\n",
1616+ " The word \"bright\" is",
1617+ " The word \"calm\"",
1618+ " under\n"
1619+ ],
1620+ "correct": [
1621+ 0.0,
1622+ 0.0,
1623+ 0.0,
1624+ 0.0,
1625+ 1.0,
1626+ 0.0,
1627+ 0.0,
1628+ 0.0,
1629+ 0.0,
1630+ 1.0,
1631+ 1.0,
1632+ 1.0,
1633+ 1.0,
1634+ 1.0,
1635+ 0.0,
1636+ 1.0,
1637+ 0.0,
1638+ 1.0,
1639+ 1.0,
1640+ 0.0,
1641+ 1.0,
1642+ 0.0,
1643+ 0.0,
1644+ 1.0,
1645+ 0.0,
1646+ 0.0,
1647+ 0.0,
1648+ 1.0,
1649+ 1.0,
1650+ 0.0,
1651+ 1.0,
1652+ 0.0
1653+ ]
1654+ },
1655+ "ridge|L19|a2.0": {
1656+ "accuracy": 0.03125,
1657+ "gain_vs_zero": {
1658+ "estimate": -0.15625,
1659+ "low": -0.28125,
1660+ "high": -0.0625,
1661+ "level": 0.95,
1662+ "n_items": 32,
1663+ "n_clusters": 32,
1664+ "n_boot": 2000
1665+ },
1666+ "mapped_norm": 46.0419921875,
1667+ "outputs_sample": [
1668+ " the output of the function will",
1669+ " visit\n",
1670+ " river\n\n",
1671+ " the calmness of the lake",
1672+ " river\n"
1673+ ],
1674+ "correct": [
1675+ 0.0,
1676+ 0.0,
1677+ 0.0,
1678+ 0.0,
1679+ 0.0,
1680+ 0.0,
1681+ 0.0,
1682+ 0.0,
1683+ 0.0,
1684+ 0.0,
1685+ 0.0,
1686+ 0.0,
1687+ 0.0,
1688+ 0.0,
1689+ 0.0,
1690+ 0.0,
1691+ 0.0,
1692+ 0.0,
1693+ 0.0,
1694+ 0.0,
1695+ 0.0,
1696+ 0.0,
1697+ 0.0,
1698+ 0.0,
1699+ 0.0,
1700+ 0.0,
1701+ 0.0,
1702+ 1.0,
1703+ 0.0,
1704+ 0.0,
1705+ 0.0,
1706+ 0.0
1707+ ]
1708+ },
1709+ "ridge_rescaled|L19|a1.0": {
1710+ "accuracy": 0.5,
1711+ "gain_vs_zero": {
1712+ "estimate": 0.3125,
1713+ "low": 0.15625,
1714+ "high": 0.46875,
1715+ "level": 0.95,
1716+ "n_items": 32,
1717+ "n_clusters": 32,
1718+ "n_boot": 2000
1719+ },
1720+ "mapped_norm": 38.643898010253906,
1721+ "outputs_sample": [
1722+ " sad\n",
1723+ " leave\n",
1724+ " The word \"bright\" is",
1725+ " The word \"calm\"",
1726+ " under\n"
1727+ ],
1728+ "correct": [
1729+ 1.0,
1730+ 0.0,
1731+ 0.0,
1732+ 0.0,
1733+ 1.0,
1734+ 0.0,
1735+ 0.0,
1736+ 0.0,
1737+ 0.0,
1738+ 1.0,
1739+ 1.0,
1740+ 0.0,
1741+ 1.0,
1742+ 1.0,
1743+ 0.0,
1744+ 1.0,
1745+ 0.0,
1746+ 1.0,
1747+ 1.0,
1748+ 1.0,
1749+ 1.0,
1750+ 0.0,
1751+ 0.0,
1752+ 1.0,
1753+ 1.0,
1754+ 0.0,
1755+ 0.0,
1756+ 1.0,
1757+ 1.0,
1758+ 0.0,
1759+ 1.0,
1760+ 0.0
1761+ ]
1762+ },
1763+ "cca|L19|a1.0": {
1764+ "accuracy": 0.34375,
1765+ "gain_vs_zero": {
1766+ "estimate": 0.15625,
1767+ "low": -0.03125,
1768+ "high": 0.34375,
1769+ "level": 0.95,
1770+ "n_items": 32,
1771+ "n_clusters": 32,
1772+ "n_boot": 2000
1773+ },
1774+ "mapped_norm": 50.8996467590332,
1775+ "outputs_sample": [
1776+ " happy\n",
1777+ " leave\n",
1778+ " The word \"bright\" is",
1779+ " the calmness of the lake",
1780+ " under\n"
1781+ ],
1782+ "correct": [
1783+ 0.0,
1784+ 0.0,
1785+ 0.0,
1786+ 0.0,
1787+ 1.0,
1788+ 0.0,
1789+ 0.0,
1790+ 0.0,
1791+ 0.0,
1792+ 1.0,
1793+ 1.0,
1794+ 0.0,
1795+ 0.0,
1796+ 1.0,
1797+ 0.0,
1798+ 1.0,
1799+ 0.0,
1800+ 1.0,
1801+ 0.0,
1802+ 0.0,
1803+ 1.0,
1804+ 0.0,
1805+ 0.0,
1806+ 1.0,
1807+ 0.0,
1808+ 0.0,
1809+ 0.0,
1810+ 1.0,
1811+ 1.0,
1812+ 0.0,
1813+ 1.0,
1814+ 0.0
1815+ ]
1816+ },
1817+ "cca|L19|a2.0": {
1818+ "accuracy": 0.0,
1819+ "gain_vs_zero": {
1820+ "estimate": -0.1875,
1821+ "low": -0.3125,
1822+ "high": -0.0625,
1823+ "level": 0.95,
1824+ "n_items": 32,
1825+ "n_clusters": 32,
1826+ "n_boot": 2000
1827+ },
1828+ "mapped_norm": 50.8996467590332,
1829+ "outputs_sample": [
1830+ " the happy man was walking down",
1831+ " the time when the last person",
1832+ " the sun is bright. \n\n",
1833+ " the calmness of the lake",
1834+ " the\n"
1835+ ],
1836+ "correct": [
1837+ 0.0,
1838+ 0.0,
1839+ 0.0,
1840+ 0.0,
1841+ 0.0,
1842+ 0.0,
1843+ 0.0,
1844+ 0.0,
1845+ 0.0,
1846+ 0.0,
1847+ 0.0,
1848+ 0.0,
1849+ 0.0,
1850+ 0.0,
1851+ 0.0,
1852+ 0.0,
1853+ 0.0,
1854+ 0.0,
1855+ 0.0,
1856+ 0.0,
1857+ 0.0,
1858+ 0.0,
1859+ 0.0,
1860+ 0.0,
1861+ 0.0,
1862+ 0.0,
1863+ 0.0,
1864+ 0.0,
1865+ 0.0,
1866+ 0.0,
1867+ 0.0,
1868+ 0.0
1869+ ]
1870+ },
1871+ "random_orth|L19|a1.0": {
1872+ "accuracy": 0.4375,
1873+ "gain_vs_zero": {
1874+ "estimate": 0.25,
1875+ "low": 0.09375,
1876+ "high": 0.4375,
1877+ "level": 0.95,
1878+ "n_items": 32,
1879+ "n_clusters": 32,
1880+ "n_boot": 2000
1881+ },
1882+ "mapped_norm": 44.325138092041016,
1883+ "outputs_sample": [
1884+ " sad\n",
1885+ " depart\n",
1886+ " dark\n",
1887+ " 1\n",
1888+ " under\n"
1889+ ],
1890+ "correct": [
1891+ 1.0,
1892+ 1.0,
1893+ 1.0,
1894+ 0.0,
1895+ 1.0,
1896+ 0.0,
1897+ 0.0,
1898+ 0.0,
1899+ 0.0,
1900+ 1.0,
1901+ 1.0,
1902+ 0.0,
1903+ 0.0,
1904+ 0.0,
1905+ 0.0,
1906+ 0.0,
1907+ 0.0,
1908+ 1.0,
1909+ 0.0,
1910+ 1.0,
1911+ 1.0,
1912+ 0.0,
1913+ 0.0,
1914+ 1.0,
1915+ 1.0,
1916+ 0.0,
1917+ 0.0,
1918+ 1.0,
1919+ 1.0,
1920+ 0.0,
1921+ 1.0,
1922+ 0.0
1923+ ]
1924+ },
1925+ "random_orth|L19|a2.0": {
1926+ "accuracy": 0.0625,
1927+ "gain_vs_zero": {
1928+ "estimate": -0.125,
1929+ "low": -0.25,
1930+ "high": -0.03125,
1931+ "level": 0.95,
1932+ "n_items": 32,
1933+ "n_clusters": 32,
1934+ "n_boot": 2000
1935+ },
1936+ "mapped_norm": 44.325138092041016,
1937+ "outputs_sample": [
1938+ " happy\n",
1939+ " arrive\n",
1940+ " bright\n",
1941+ " 1\n",
1942+ " over\n"
1943+ ],
1944+ "correct": [
1945+ 0.0,
1946+ 0.0,
1947+ 0.0,
1948+ 0.0,
1949+ 0.0,
1950+ 0.0,
1951+ 0.0,
1952+ 0.0,
1953+ 0.0,
1954+ 0.0,
1955+ 0.0,
1956+ 0.0,
1957+ 0.0,
1958+ 0.0,
1959+ 0.0,
1960+ 0.0,
1961+ 0.0,
1962+ 1.0,
1963+ 0.0,
1964+ 0.0,
1965+ 0.0,
1966+ 0.0,
1967+ 0.0,
1968+ 0.0,
1969+ 0.0,
1970+ 0.0,
1971+ 0.0,
1972+ 0.0,
1973+ 1.0,
1974+ 0.0,
1975+ 0.0,
1976+ 0.0
1977+ ]
1978+ },
1979+ "replace_donor_fewshot|procrustes|L19": {
1980+ "accuracy": 0.625,
1981+ "gain_vs_zero": {
1982+ "estimate": 0.4375,
1983+ "low": 0.25,
1984+ "high": 0.625,
1985+ "level": 0.95,
1986+ "n_items": 32,
1987+ "n_clusters": 32,
1988+ "n_boot": 2000
1989+ },
1990+ "outputs_sample": [
1991+ " sad\n",
1992+ " arrival\n",
1993+ " dark\n",
1994+ " calm\n",
1995+ " under\n"
1996+ ],
1997+ "correct": [
1998+ 1.0,
1999+ 0.0,
2000+ 1.0,
2001+ 0.0,
2002+ 1.0,
2003+ 0.0,
2004+ 0.0,
2005+ 1.0,
2006+ 1.0,
2007+ 1.0,
2008+ 1.0,
2009+ 0.0,
2010+ 0.0,
2011+ 1.0,
2012+ 1.0,
2013+ 1.0,
2014+ 1.0,
2015+ 1.0,
2016+ 0.0,
2017+ 1.0,
2018+ 1.0,
2019+ 0.0,
2020+ 0.0,
2021+ 1.0,
2022+ 1.0,
2023+ 0.0,
2024+ 0.0,
2025+ 1.0,
2026+ 1.0,
2027+ 1.0,
2028+ 1.0,
2029+ 0.0
2030+ ]
2031+ },
2032+ "ctl_replace_donor_zeroshot|procrustes|L19": {
2033+ "accuracy": 0.21875,
2034+ "gain_vs_zero": {
2035+ "estimate": 0.03125,
2036+ "low": -0.09375,
2037+ "high": 0.15625,
2038+ "level": 0.95,
2039+ "n_items": 32,
2040+ "n_clusters": 32,
2041+ "n_boot": 2000
2042+ },
2043+ "outputs_sample": [
2044+ " sad\n",
2045+ " 0\n",
2046+ " The word \"bright\" is",
2047+ " calm\n",
2048+ " 1\n"
2049+ ],
2050+ "correct": [
2051+ 1.0,
2052+ 0.0,
2053+ 0.0,
2054+ 0.0,
2055+ 0.0,
2056+ 0.0,
2057+ 0.0,
2058+ 0.0,
2059+ 0.0,
2060+ 0.0,
2061+ 1.0,
2062+ 0.0,
2063+ 0.0,
2064+ 0.0,
2065+ 0.0,
2066+ 1.0,
2067+ 0.0,
2068+ 0.0,
2069+ 1.0,
2070+ 1.0,
2071+ 0.0,
2072+ 0.0,
2073+ 0.0,
2074+ 0.0,
2075+ 1.0,
2076+ 0.0,
2077+ 0.0,
2078+ 0.0,
2079+ 1.0,
2080+ 0.0,
2081+ 0.0,
2082+ 0.0
2083+ ]
2084+ },
2085+ "ctl_replace_donor_fewshot_shuffled_query|procrustes|L19": {
2086+ "accuracy": 0.6875,
2087+ "gain_vs_zero": {
2088+ "estimate": 0.5,
2089+ "low": 0.3429687500000014,
2090+ "high": 0.65625,
2091+ "level": 0.95,
2092+ "n_items": 32,
2093+ "n_clusters": 32,
2094+ "n_boot": 2000
2095+ },
2096+ "outputs_sample": [
2097+ " sad\n",
2098+ " sun\n",
2099+ " dim\n",
2100+ " anger\n",
2101+ " under\n"
2102+ ],
2103+ "correct": [
2104+ 1.0,
2105+ 0.0,
2106+ 1.0,
2107+ 0.0,
2108+ 1.0,
2109+ 0.0,
2110+ 0.0,
2111+ 1.0,
2112+ 1.0,
2113+ 1.0,
2114+ 1.0,
2115+ 1.0,
2116+ 1.0,
2117+ 1.0,
2118+ 1.0,
2119+ 1.0,
2120+ 1.0,
2121+ 1.0,
2122+ 1.0,
2123+ 1.0,
2124+ 1.0,
2125+ 0.0,
2126+ 0.0,
2127+ 1.0,
2128+ 1.0,
2129+ 0.0,
2130+ 0.0,
2131+ 1.0,
2132+ 1.0,
2133+ 0.0,
2134+ 1.0,
2135+ 0.0
2136+ ]
2137+ },
2138+ "replace_donor_fewshot|ridge|L19": {
2139+ "accuracy": 0.40625,
2140+ "gain_vs_zero": {
2141+ "estimate": 0.21875,
2142+ "low": 0.0,
2143+ "high": 0.4375,
2144+ "level": 0.95,
2145+ "n_items": 32,
2146+ "n_clusters": 32,
2147+ "n_boot": 2000
2148+ },
2149+ "outputs_sample": [
2150+ " The number of happy strings of",
2151+ " the time when the last person",
2152+ " the brightness of the light source",
2153+ " calm\n",
2154+ " 1\n"
2155+ ],
2156+ "correct": [
2157+ 0.0,
2158+ 0.0,
2159+ 0.0,
2160+ 0.0,
2161+ 0.0,
2162+ 0.0,
2163+ 0.0,
2164+ 0.0,
2165+ 1.0,
2166+ 1.0,
2167+ 0.0,
2168+ 0.0,
2169+ 0.0,
2170+ 1.0,
2171+ 1.0,
2172+ 1.0,
2173+ 0.0,
2174+ 0.0,
2175+ 0.0,
2176+ 1.0,
2177+ 1.0,
2178+ 1.0,
2179+ 0.0,
2180+ 1.0,
2181+ 1.0,
2182+ 0.0,
2183+ 0.0,
2184+ 1.0,
2185+ 1.0,
2186+ 0.0,
2187+ 1.0,
2188+ 0.0
2189+ ]
2190+ },
2191+ "ctl_replace_donor_zeroshot|ridge|L19": {
2192+ "accuracy": 0.0625,
2193+ "gain_vs_zero": {
2194+ "estimate": -0.125,
2195+ "low": -0.28125,
2196+ "high": 0.0007812499999957367,
2197+ "level": 0.95,
2198+ "n_items": 32,
2199+ "n_clusters": 32,
2200+ "n_boot": 2000
2201+ },
2202+ "outputs_sample": [
2203+ " sad\n",
2204+ " 1\n",
2205+ " \"Bright\"\n",
2206+ " calm\n",
2207+ " 1\n"
2208+ ],
2209+ "correct": [
2210+ 1.0,
2211+ 0.0,
2212+ 0.0,
2213+ 0.0,
2214+ 0.0,
2215+ 0.0,
2216+ 0.0,
2217+ 0.0,
2218+ 0.0,
2219+ 0.0,
2220+ 0.0,
2221+ 0.0,
2222+ 0.0,
2223+ 0.0,
2224+ 0.0,
2225+ 0.0,
2226+ 0.0,
2227+ 0.0,
2228+ 0.0,
2229+ 0.0,
2230+ 0.0,
2231+ 0.0,
2232+ 0.0,
2233+ 0.0,
2234+ 1.0,
2235+ 0.0,
2236+ 0.0,
2237+ 0.0,
2238+ 0.0,
2239+ 0.0,
2240+ 0.0,
2241+ 0.0
2242+ ]
2243+ },
2244+ "ctl_replace_donor_fewshot_shuffled_query|ridge|L19": {
2245+ "accuracy": 0.21875,
2246+ "gain_vs_zero": {
2247+ "estimate": 0.03125,
2248+ "low": -0.125,
2249+ "high": 0.1875,
2250+ "level": 0.95,
2251+ "n_items": 32,
2252+ "n_clusters": 32,
2253+ "n_boot": 2000
2254+ },
2255+ "outputs_sample": [
2256+ " the happy man is smiling\n",
2257+ " The time when the last person",
2258+ " The word \"bright\" is",
2259+ " 1\n",
2260+ " The word \"over\" is"
2261+ ],
2262+ "correct": [
2263+ 0.0,
2264+ 0.0,
2265+ 0.0,
2266+ 0.0,
2267+ 0.0,
2268+ 0.0,
2269+ 0.0,
2270+ 0.0,
2271+ 1.0,
2272+ 0.0,
2273+ 1.0,
2274+ 0.0,
2275+ 0.0,
2276+ 1.0,
2277+ 0.0,
2278+ 0.0,
2279+ 0.0,
2280+ 0.0,
2281+ 0.0,
2282+ 1.0,
2283+ 0.0,
2284+ 0.0,
2285+ 0.0,
2286+ 1.0,
2287+ 1.0,
2288+ 0.0,
2289+ 0.0,
2290+ 0.0,
2291+ 1.0,
2292+ 0.0,
2293+ 0.0,
2294+ 0.0
2295+ ]
2296+ },
2297+ "ctl_replace_donor_fewshot|sham_map|L19": {
2298+ "accuracy": 0.03125,
2299+ "gain_vs_zero": {
2300+ "estimate": -0.15625,
2301+ "low": -0.3125,
2302+ "high": 0.0,
2303+ "level": 0.95,
2304+ "n_items": 32,
2305+ "n_clusters": 32,
2306+ "n_boot": 2000
2307+ },
2308+ "outputs_sample": [
2309+ " 1\n",
2310+ " 0\n",
2311+ " 1\n",
2312+ " 1\n",
2313+ " 1\n"
2314+ ],
2315+ "correct": [
2316+ 0.0,
2317+ 0.0,
2318+ 0.0,
2319+ 0.0,
2320+ 0.0,
2321+ 0.0,
2322+ 0.0,
2323+ 0.0,
2324+ 1.0,
2325+ 0.0,
2326+ 0.0,
2327+ 0.0,
2328+ 0.0,
2329+ 0.0,
2330+ 0.0,
2331+ 0.0,
2332+ 0.0,
2333+ 0.0,
2334+ 0.0,
2335+ 0.0,
2336+ 0.0,
2337+ 0.0,
2338+ 0.0,
2339+ 0.0,
2340+ 0.0,
2341+ 0.0,
2342+ 0.0,
2343+ 0.0,
2344+ 0.0,
2345+ 0.0,
2346+ 0.0,
2347+ 0.0
2348+ ]
2349+ },
2350+ "ctl_replace_donor_zeroshot|sham_map|L19": {
2351+ "accuracy": 0.0,
2352+ "gain_vs_zero": {
2353+ "estimate": -0.1875,
2354+ "low": -0.3125,
2355+ "high": -0.0625,
2356+ "level": 0.95,
2357+ "n_items": 32,
2358+ "n_clusters": 32,
2359+ "n_boot": 2000
2360+ },
2361+ "outputs_sample": [
2362+ " 1\n",
2363+ " 1\n",
2364+ " 10000",
2365+ " 1\n",
2366+ " 1\n"
2367+ ],
2368+ "correct": [
2369+ 0.0,
2370+ 0.0,
2371+ 0.0,
2372+ 0.0,
2373+ 0.0,
2374+ 0.0,
2375+ 0.0,
2376+ 0.0,
2377+ 0.0,
2378+ 0.0,
2379+ 0.0,
2380+ 0.0,
2381+ 0.0,
2382+ 0.0,
2383+ 0.0,
2384+ 0.0,
2385+ 0.0,
2386+ 0.0,
2387+ 0.0,
2388+ 0.0,
2389+ 0.0,
2390+ 0.0,
2391+ 0.0,
2392+ 0.0,
2393+ 0.0,
2394+ 0.0,
2395+ 0.0,
2396+ 0.0,
2397+ 0.0,
2398+ 0.0,
2399+ 0.0,
2400+ 0.0
2401+ ]
2402+ },
2403+ "ctl_replace_donor_fewshot_shuffled_query|sham_map|L19": {
2404+ "accuracy": 0.0,
2405+ "gain_vs_zero": {
2406+ "estimate": -0.1875,
2407+ "low": -0.3125,
2408+ "high": -0.0625,
2409+ "level": 0.95,
2410+ "n_items": 32,
2411+ "n_clusters": 32,
2412+ "n_boot": 2000
2413+ },
2414+ "outputs_sample": [
2415+ " 1\n",
2416+ " 1\n",
2417+ " 1\n",
2418+ " 1\n",
2419+ " 1\n"
2420+ ],
2421+ "correct": [
2422+ 0.0,
2423+ 0.0,
2424+ 0.0,
2425+ 0.0,
2426+ 0.0,
2427+ 0.0,
2428+ 0.0,
2429+ 0.0,
2430+ 0.0,
2431+ 0.0,
2432+ 0.0,
2433+ 0.0,
2434+ 0.0,
2435+ 0.0,
2436+ 0.0,
2437+ 0.0,
2438+ 0.0,
2439+ 0.0,
2440+ 0.0,
2441+ 0.0,
2442+ 0.0,
2443+ 0.0,
2444+ 0.0,
2445+ 0.0,
2446+ 0.0,
2447+ 0.0,
2448+ 0.0,
2449+ 0.0,
2450+ 0.0,
2451+ 0.0,
2452+ 0.0,
2453+ 0.0
2454+ ]
2455+ },
2456+ "ctl_random_norm_matched|L19": {
2457+ "accuracy": 0.03125,
2458+ "gain_vs_zero": {
2459+ "estimate": -0.15625,
2460+ "low": -0.28125,
2461+ "high": -0.0625,
2462+ "level": 0.95,
2463+ "n_items": 32,
2464+ "n_clusters": 32,
2465+ "n_boot": 2000
2466+ },
2467+ "correct": [
2468+ 0.0,
2469+ 0.0,
2470+ 0.0,
2471+ 0.0,
2472+ 0.0,
2473+ 0.0,
2474+ 0.0,
2475+ 0.0,
2476+ 0.0,
2477+ 0.0,
2478+ 0.0,
2479+ 0.0,
2480+ 0.0,
2481+ 0.0,
2482+ 0.0,
2483+ 0.0,
2484+ 0.0,
2485+ 1.0,
2486+ 0.0,
2487+ 0.0,
2488+ 0.0,
2489+ 0.0,
2490+ 0.0,
2491+ 0.0,
2492+ 0.0,
2493+ 0.0,
2494+ 0.0,
2495+ 0.0,
2496+ 0.0,
2497+ 0.0,
2498+ 0.0,
2499+ 0.0
2500+ ]
2501+ },
2502+ "ctl_unrelated_task_vector(capital)|L19": {
2503+ "accuracy": 0.1875,
2504+ "gain_vs_zero": {
2505+ "estimate": 0.0,
2506+ "low": -0.1875,
2507+ "high": 0.15625,
2508+ "level": 0.95,
2509+ "n_items": 32,
2510+ "n_clusters": 32,
2511+ "n_boot": 2000
2512+ },
2513+ "correct": [
2514+ 0.0,
2515+ 0.0,
2516+ 0.0,
2517+ 0.0,
2518+ 0.0,
2519+ 0.0,
2520+ 0.0,
2521+ 0.0,
2522+ 0.0,
2523+ 0.0,
2524+ 0.0,
2525+ 0.0,
2526+ 0.0,
2527+ 1.0,
2528+ 0.0,
2529+ 1.0,
2530+ 0.0,
2531+ 1.0,
2532+ 0.0,
2533+ 1.0,
2534+ 0.0,
2535+ 0.0,
2536+ 0.0,
2537+ 0.0,
2538+ 0.0,
2539+ 0.0,
2540+ 0.0,
2541+ 0.0,
2542+ 1.0,
2543+ 0.0,
2544+ 1.0,
2545+ 0.0
2546+ ]
2547+ }
2548+ },
2549+ "items": {
2550+ "zero": [
2551+ 0.0,
2552+ 0.0,
2553+ 0.0,
2554+ 0.0,
2555+ 0.0,
2556+ 0.0,
2557+ 0.0,
2558+ 0.0,
2559+ 0.0,
2560+ 0.0,
2561+ 1.0,
2562+ 0.0,
2563+ 0.0,
2564+ 0.0,
2565+ 0.0,
2566+ 0.0,
2567+ 0.0,
2568+ 1.0,
2569+ 1.0,
2570+ 0.0,
2571+ 0.0,
2572+ 0.0,
2573+ 0.0,
2574+ 0.0,
2575+ 1.0,
2576+ 0.0,
2577+ 0.0,
2578+ 1.0,
2579+ 1.0,
2580+ 0.0,
2581+ 0.0,
2582+ 0.0
2583+ ],
2584+ "few": [
2585+ 1.0,
2586+ 1.0,
2587+ 1.0,
2588+ 0.0,
2589+ 1.0,
2590+ 1.0,
2591+ 1.0,
2592+ 1.0,
2593+ 1.0,
2594+ 1.0,
2595+ 1.0,
2596+ 1.0,
2597+ 1.0,
2598+ 1.0,
2599+ 1.0,
2600+ 1.0,
2601+ 1.0,
2602+ 1.0,
2603+ 1.0,
2604+ 1.0,
2605+ 1.0,
2606+ 1.0,
2607+ 1.0,
2608+ 1.0,
2609+ 1.0,
2610+ 0.0,
2611+ 1.0,
2612+ 1.0,
2613+ 1.0,
2614+ 1.0,
2615+ 1.0,
2616+ 1.0
2617+ ],
2618+ "own": [
2619+ 1.0,
2620+ 1.0,
2621+ 1.0,
2622+ 0.0,
2623+ 1.0,
2624+ 0.0,
2625+ 1.0,
2626+ 1.0,
2627+ 1.0,
2628+ 1.0,
2629+ 1.0,
2630+ 1.0,
2631+ 1.0,
2632+ 1.0,
2633+ 1.0,
2634+ 1.0,
2635+ 1.0,
2636+ 1.0,
2637+ 1.0,
2638+ 1.0,
2639+ 1.0,
2640+ 1.0,
2641+ 1.0,
2642+ 1.0,
2643+ 1.0,
2644+ 0.0,
2645+ 1.0,
2646+ 1.0,
2647+ 1.0,
2648+ 1.0,
2649+ 1.0,
2650+ 1.0
2651+ ]
2652+ }
2653+ },
2654+ "capital": {
2655+ "recipient_zero": 0.0,
2656+ "recipient_few": 1.0,
2657+ "recipient_own_vector": 0.8181818181818182,
2658+ "donor_layer": 25,
2659+ "conditions": {
2660+ "procrustes|L19|a1.0": {
2661+ "accuracy": 0.0,
2662+ "gain_vs_zero": {
2663+ "estimate": 0.0,
2664+ "low": 0.0,
2665+ "high": 0.0,
2666+ "level": 0.95,
2667+ "n_items": 22,
2668+ "n_clusters": 22,
2669+ "n_boot": 2000
2670+ },
2671+ "mapped_norm": 42.90782928466797,
2672+ "outputs_sample": [
2673+ " Colombia\n",
2674+ " Sweden\n",
2675+ " Spain\n\n",
2676+ " Turkey is a country located in",
2677+ " Japan is a country located in"
2678+ ],
2679+ "correct": [
2680+ 0.0,
2681+ 0.0,
2682+ 0.0,
2683+ 0.0,
2684+ 0.0,
2685+ 0.0,
2686+ 0.0,
2687+ 0.0,
2688+ 0.0,
2689+ 0.0,
2690+ 0.0,
2691+ 0.0,
2692+ 0.0,
2693+ 0.0,
2694+ 0.0,
2695+ 0.0,
2696+ 0.0,
2697+ 0.0,
2698+ 0.0,
2699+ 0.0,
2700+ 0.0,
2701+ 0.0
2702+ ]
2703+ },
2704+ "procrustes|L19|a2.0": {
2705+ "accuracy": 0.0,
2706+ "gain_vs_zero": {
2707+ "estimate": 0.0,
2708+ "low": 0.0,
2709+ "high": 0.0,
2710+ "level": 0.95,
2711+ "n_items": 22,
2712+ "n_clusters": 22,
2713+ "n_boot": 2000
2714+ },
2715+ "mapped_norm": 42.90782928466797,
2716+ "outputs_sample": [
2717+ " Venezuela is a country located in",
2718+ " Finland is a country located in",
2719+ " Morocco is a country located in",
2720+ " Turkey is a country located in",
2721+ " Japan is a country located in"
2722+ ],
2723+ "correct": [
2724+ 0.0,
2725+ 0.0,
2726+ 0.0,
2727+ 0.0,
2728+ 0.0,
2729+ 0.0,
2730+ 0.0,
2731+ 0.0,
2732+ 0.0,
2733+ 0.0,
2734+ 0.0,
2735+ 0.0,
2736+ 0.0,
2737+ 0.0,
2738+ 0.0,
2739+ 0.0,
2740+ 0.0,
2741+ 0.0,
2742+ 0.0,
2743+ 0.0,
2744+ 0.0,
2745+ 0.0
2746+ ]
2747+ },
2748+ "procrustes_rescaled|L19|a1.0": {
2749+ "accuracy": 0.0,
2750+ "gain_vs_zero": {
2751+ "estimate": 0.0,
2752+ "low": 0.0,
2753+ "high": 0.0,
2754+ "level": 0.95,
2755+ "n_items": 22,
2756+ "n_clusters": 22,
2757+ "n_boot": 2000
2758+ },
2759+ "mapped_norm": 75.94140625,
2760+ "outputs_sample": [
2761+ " Peru\n",
2762+ " Finland is a country located in",
2763+ " Morocco is a country located in",
2764+ " Turkey is a country located in",
2765+ " Japan is a country located in"
2766+ ],
2767+ "correct": [
2768+ 0.0,
2769+ 0.0,
2770+ 0.0,
2771+ 0.0,
2772+ 0.0,
2773+ 0.0,
2774+ 0.0,
2775+ 0.0,
2776+ 0.0,
2777+ 0.0,
2778+ 0.0,
2779+ 0.0,
2780+ 0.0,
2781+ 0.0,
2782+ 0.0,
2783+ 0.0,
2784+ 0.0,
2785+ 0.0,
2786+ 0.0,
2787+ 0.0,
2788+ 0.0,
2789+ 0.0
2790+ ]
2791+ },
2792+ "ridge|L19|a1.0": {
2793+ "accuracy": 0.0,
2794+ "gain_vs_zero": {
2795+ "estimate": 0.0,
2796+ "low": 0.0,
2797+ "high": 0.0,
2798+ "level": 0.95,
2799+ "n_items": 22,
2800+ "n_clusters": 22,
2801+ "n_boot": 2000
2802+ },
2803+ "mapped_norm": 47.9246711730957,
2804+ "outputs_sample": [
2805+ " Venezuela is a country located in",
2806+ " Finland is a country located in",
2807+ " Morocco is a country located in",
2808+ " Turkey is a country located in",
2809+ " Japan is a country located in"
2810+ ],
2811+ "correct": [
2812+ 0.0,
2813+ 0.0,
2814+ 0.0,
2815+ 0.0,
2816+ 0.0,
2817+ 0.0,
2818+ 0.0,
2819+ 0.0,
2820+ 0.0,
2821+ 0.0,
2822+ 0.0,
2823+ 0.0,
2824+ 0.0,
2825+ 0.0,
2826+ 0.0,
2827+ 0.0,
2828+ 0.0,
2829+ 0.0,
2830+ 0.0,
2831+ 0.0,
2832+ 0.0,
2833+ 0.0
2834+ ]
2835+ },
2836+ "ridge|L19|a2.0": {
2837+ "accuracy": 0.0,
2838+ "gain_vs_zero": {
2839+ "estimate": 0.0,
2840+ "low": 0.0,
2841+ "high": 0.0,
2842+ "level": 0.95,
2843+ "n_items": 22,
2844+ "n_clusters": 22,
2845+ "n_boot": 2000
2846+ },
2847+ "mapped_norm": 47.9246711730957,
2848+ "outputs_sample": [
2849+ " Venezuela is a country located in",
2850+ " Finland is a country located in",
2851+ " Morocco is a country located in",
2852+ " The capital of Turkey is Ankara",
2853+ " Japan is a country located in"
2854+ ],
2855+ "correct": [
2856+ 0.0,
2857+ 0.0,
2858+ 0.0,
2859+ 0.0,
2860+ 0.0,
2861+ 0.0,
2862+ 0.0,
2863+ 0.0,
2864+ 0.0,
2865+ 0.0,
2866+ 0.0,
2867+ 0.0,
2868+ 0.0,
2869+ 0.0,
2870+ 0.0,
2871+ 0.0,
2872+ 0.0,
2873+ 0.0,
2874+ 0.0,
2875+ 0.0,
2876+ 0.0,
2877+ 0.0
2878+ ]
2879+ },
2880+ "ridge_rescaled|L19|a1.0": {
2881+ "accuracy": 0.0,
2882+ "gain_vs_zero": {
2883+ "estimate": 0.0,
2884+ "low": 0.0,
2885+ "high": 0.0,
2886+ "level": 0.95,
2887+ "n_items": 22,
2888+ "n_clusters": 22,
2889+ "n_boot": 2000
2890+ },
2891+ "mapped_norm": 75.94140625,
2892+ "outputs_sample": [
2893+ " Venezuela is a country located in",
2894+ " Finland is a country located in",
2895+ " Morocco is a country located in",
2896+ " The capital of Turkey is Ankara",
2897+ " Japan is a country located in"
2898+ ],
2899+ "correct": [
2900+ 0.0,
2901+ 0.0,
2902+ 0.0,
2903+ 0.0,
2904+ 0.0,
2905+ 0.0,
2906+ 0.0,
2907+ 0.0,
2908+ 0.0,
2909+ 0.0,
2910+ 0.0,
2911+ 0.0,
2912+ 0.0,
2913+ 0.0,
2914+ 0.0,
2915+ 0.0,
2916+ 0.0,
2917+ 0.0,
2918+ 0.0,
2919+ 0.0,
2920+ 0.0,
2921+ 0.0
2922+ ]
2923+ },
2924+ "cca|L19|a1.0": {
2925+ "accuracy": 0.0,
2926+ "gain_vs_zero": {
2927+ "estimate": 0.0,
2928+ "low": 0.0,
2929+ "high": 0.0,
2930+ "level": 0.95,
2931+ "n_items": 22,
2932+ "n_clusters": 22,
2933+ "n_boot": 2000
2934+ },
2935+ "mapped_norm": 54.63546371459961,
2936+ "outputs_sample": [
2937+ " The country of Venezuela is located",
2938+ " The capital of Finland is Helsinki",
2939+ " Morocco is a country located in",
2940+ " Turkey is a country located in",
2941+ " Japan is a country located in"
2942+ ],
2943+ "correct": [
2944+ 0.0,
2945+ 0.0,
2946+ 0.0,
2947+ 0.0,
2948+ 0.0,
2949+ 0.0,
2950+ 0.0,
2951+ 0.0,
2952+ 0.0,
2953+ 0.0,
2954+ 0.0,
2955+ 0.0,
2956+ 0.0,
2957+ 0.0,
2958+ 0.0,
2959+ 0.0,
2960+ 0.0,
2961+ 0.0,
2962+ 0.0,
2963+ 0.0,
2964+ 0.0,
2965+ 0.0
2966+ ]
2967+ },
2968+ "cca|L19|a2.0": {
2969+ "accuracy": 0.0,
2970+ "gain_vs_zero": {
2971+ "estimate": 0.0,
2972+ "low": 0.0,
2973+ "high": 0.0,
2974+ "level": 0.95,
2975+ "n_items": 22,
2976+ "n_clusters": 22,
2977+ "n_boot": 2000
2978+ },
2979+ "mapped_norm": 54.63546371459961,
2980+ "outputs_sample": [
2981+ " The country of Venezuela is located",
2982+ " Finland is a country located in",
2983+ " Morocco is a country located in",
2984+ " The country of Turkey is located",
2985+ " Japan is a country located in"
2986+ ],
2987+ "correct": [
2988+ 0.0,
2989+ 0.0,
2990+ 0.0,
2991+ 0.0,
2992+ 0.0,
2993+ 0.0,
2994+ 0.0,
2995+ 0.0,
2996+ 0.0,
2997+ 0.0,
2998+ 0.0,
2999+ 0.0,
3000+ 0.0,
3001+ 0.0,
3002+ 0.0,
3003+ 0.0,
3004+ 0.0,
3005+ 0.0,
3006+ 0.0,
3007+ 0.0,
3008+ 0.0,
3009+ 0.0
3010+ ]
3011+ },
3012+ "random_orth|L19|a1.0": {
3013+ "accuracy": 0.0,
3014+ "gain_vs_zero": {
3015+ "estimate": 0.0,
3016+ "low": 0.0,
3017+ "high": 0.0,
3018+ "level": 0.95,
3019+ "n_items": 22,
3020+ "n_clusters": 22,
3021+ "n_boot": 2000
3022+ },
3023+ "mapped_norm": 44.07579040527344,
3024+ "outputs_sample": [
3025+ " Venezuela is a country located in",
3026+ " \n",
3027+ " Morocco is a country located in",
3028+ " Turkey is a country located in",
3029+ " Japan is a country located in"
3030+ ],
3031+ "correct": [
3032+ 0.0,
3033+ 0.0,
3034+ 0.0,
3035+ 0.0,
3036+ 0.0,
3037+ 0.0,
3038+ 0.0,
3039+ 0.0,
3040+ 0.0,
3041+ 0.0,
3042+ 0.0,
3043+ 0.0,
3044+ 0.0,
3045+ 0.0,
3046+ 0.0,
3047+ 0.0,
3048+ 0.0,
3049+ 0.0,
3050+ 0.0,
3051+ 0.0,
3052+ 0.0,
3053+ 0.0
3054+ ]
3055+ },
3056+ "random_orth|L19|a2.0": {
3057+ "accuracy": 0.0,
3058+ "gain_vs_zero": {
3059+ "estimate": 0.0,
3060+ "low": 0.0,
3061+ "high": 0.0,
3062+ "level": 0.95,
3063+ "n_items": 22,
3064+ "n_clusters": 22,
3065+ "n_boot": 2000
3066+ },
3067+ "mapped_norm": 44.07579040527344,
3068+ "outputs_sample": [
3069+ " What is the capital of Venezuela",
3070+ " What is the capital of Finland",
3071+ " What is the capital of Morocco",
3072+ " What is the capital of Turkey",
3073+ " What is the capital of Japan"
3074+ ],
3075+ "correct": [
3076+ 0.0,
3077+ 0.0,
3078+ 0.0,
3079+ 0.0,
3080+ 0.0,
3081+ 0.0,
3082+ 0.0,
3083+ 0.0,
3084+ 0.0,
3085+ 0.0,
3086+ 0.0,
3087+ 0.0,
3088+ 0.0,
3089+ 0.0,
3090+ 0.0,
3091+ 0.0,
3092+ 0.0,
3093+ 0.0,
3094+ 0.0,
3095+ 0.0,
3096+ 0.0,
3097+ 0.0
3098+ ]
3099+ },
3100+ "replace_donor_fewshot|procrustes|L19": {
3101+ "accuracy": 0.0,
3102+ "gain_vs_zero": {
3103+ "estimate": 0.0,
3104+ "low": 0.0,
3105+ "high": 0.0,
3106+ "level": 0.95,
3107+ "n_items": 22,
3108+ "n_clusters": 22,
3109+ "n_boot": 2000
3110+ },
3111+ "outputs_sample": [
3112+ " Venezuela is a country located in",
3113+ " Sweden\n",
3114+ " Spain\n\n",
3115+ " Turkey is a country located in",
3116+ " Japan is a country located in"
3117+ ],
3118+ "correct": [
3119+ 0.0,
3120+ 0.0,
3121+ 0.0,
3122+ 0.0,
3123+ 0.0,
3124+ 0.0,
3125+ 0.0,
3126+ 0.0,
3127+ 0.0,
3128+ 0.0,
3129+ 0.0,
3130+ 0.0,
3131+ 0.0,
3132+ 0.0,
3133+ 0.0,
3134+ 0.0,
3135+ 0.0,
3136+ 0.0,
3137+ 0.0,
3138+ 0.0,
3139+ 0.0,
3140+ 0.0
3141+ ]
3142+ },
3143+ "ctl_replace_donor_zeroshot|procrustes|L19": {
3144+ "accuracy": 0.0,
3145+ "gain_vs_zero": {
3146+ "estimate": 0.0,
3147+ "low": 0.0,
3148+ "high": 0.0,
3149+ "level": 0.95,
3150+ "n_items": 22,
3151+ "n_clusters": 22,
3152+ "n_boot": 2000
3153+ },
3154+ "outputs_sample": [
3155+ " \"Venezuela is a",
3156+ " \"Finland is a country",
3157+ " \"Morocco\" is a",
3158+ " Turkey is a country located in",
3159+ " Japan is a country located in"
3160+ ],
3161+ "correct": [
3162+ 0.0,
3163+ 0.0,
3164+ 0.0,
3165+ 0.0,
3166+ 0.0,
3167+ 0.0,
3168+ 0.0,
3169+ 0.0,
3170+ 0.0,
3171+ 0.0,
3172+ 0.0,
3173+ 0.0,
3174+ 0.0,
3175+ 0.0,
3176+ 0.0,
3177+ 0.0,
3178+ 0.0,
3179+ 0.0,
3180+ 0.0,
3181+ 0.0,
3182+ 0.0,
3183+ 0.0
3184+ ]
3185+ },
3186+ "ctl_replace_donor_fewshot_shuffled_query|procrustes|L19": {
3187+ "accuracy": 0.0,
3188+ "gain_vs_zero": {
3189+ "estimate": 0.0,
3190+ "low": 0.0,
3191+ "high": 0.0,
3192+ "level": 0.95,
3193+ "n_items": 22,
3194+ "n_clusters": 22,
3195+ "n_boot": 2000
3196+ },
3197+ "outputs_sample": [
3198+ " Argentina\n",
3199+ " Sweden\n",
3200+ " Spain\n\n",
3201+ " Turkey is a country located in",
3202+ " Japan is a country located in"
3203+ ],
3204+ "correct": [
3205+ 0.0,
3206+ 0.0,
3207+ 0.0,
3208+ 0.0,
3209+ 0.0,
3210+ 0.0,
3211+ 0.0,
3212+ 0.0,
3213+ 0.0,
3214+ 0.0,
3215+ 0.0,
3216+ 0.0,
3217+ 0.0,
3218+ 0.0,
3219+ 0.0,
3220+ 0.0,
3221+ 0.0,
3222+ 0.0,
3223+ 0.0,
3224+ 0.0,
3225+ 0.0,
3226+ 0.0
3227+ ]
3228+ },
3229+ "replace_donor_fewshot|ridge|L19": {
3230+ "accuracy": 0.0,
3231+ "gain_vs_zero": {
3232+ "estimate": 0.0,
3233+ "low": 0.0,
3234+ "high": 0.0,
3235+ "level": 0.95,
3236+ "n_items": 22,
3237+ "n_clusters": 22,
3238+ "n_boot": 2000
3239+ },
3240+ "outputs_sample": [
3241+ " Venezuela is a country located in",
3242+ " The capital of Finland is Helsinki",
3243+ " Morocco is a country located in",
3244+ " Turkey is a country located in",
3245+ " Japan is a country located in"
3246+ ],
3247+ "correct": [
3248+ 0.0,
3249+ 0.0,
3250+ 0.0,
3251+ 0.0,
3252+ 0.0,
3253+ 0.0,
3254+ 0.0,
3255+ 0.0,
3256+ 0.0,
3257+ 0.0,
3258+ 0.0,
3259+ 0.0,
3260+ 0.0,
3261+ 0.0,
3262+ 0.0,
3263+ 0.0,
3264+ 0.0,
3265+ 0.0,
3266+ 0.0,
3267+ 0.0,
3268+ 0.0,
3269+ 0.0
3270+ ]
3271+ },
3272+ "ctl_replace_donor_zeroshot|ridge|L19": {
3273+ "accuracy": 0.0,
3274+ "gain_vs_zero": {
3275+ "estimate": 0.0,
3276+ "low": 0.0,
3277+ "high": 0.0,
3278+ "level": 0.95,
3279+ "n_items": 22,
3280+ "n_clusters": 22,
3281+ "n_boot": 2000
3282+ },
3283+ "outputs_sample": [
3284+ " \"Venezuela is a",
3285+ " \"Finland is a country",
3286+ " \"Morocco\" is a",
3287+ " \"Turkey is a country in",
3288+ " Japan is a country located in"
3289+ ],
3290+ "correct": [
3291+ 0.0,
3292+ 0.0,
3293+ 0.0,
3294+ 0.0,
3295+ 0.0,
3296+ 0.0,
3297+ 0.0,
3298+ 0.0,
3299+ 0.0,
3300+ 0.0,
3301+ 0.0,
3302+ 0.0,
3303+ 0.0,
3304+ 0.0,
3305+ 0.0,
3306+ 0.0,
3307+ 0.0,
3308+ 0.0,
3309+ 0.0,
3310+ 0.0,
3311+ 0.0,
3312+ 0.0
3313+ ]
3314+ },
3315+ "ctl_replace_donor_fewshot_shuffled_query|ridge|L19": {
3316+ "accuracy": 0.0,
3317+ "gain_vs_zero": {
3318+ "estimate": 0.0,
3319+ "low": 0.0,
3320+ "high": 0.0,
3321+ "level": 0.95,
3322+ "n_items": 22,
3323+ "n_clusters": 22,
3324+ "n_boot": 2000
3325+ },
3326+ "outputs_sample": [
3327+ " The country of Venezuela is located",
3328+ " Finland is a country located in",
3329+ " Morocco is a country located in",
3330+ " Turkey is a country located in",
3331+ " Japan is a country located in"
3332+ ],
3333+ "correct": [
3334+ 0.0,
3335+ 0.0,
3336+ 0.0,
3337+ 0.0,
3338+ 0.0,
3339+ 0.0,
3340+ 0.0,
3341+ 0.0,
3342+ 0.0,
3343+ 0.0,
3344+ 0.0,
3345+ 0.0,
3346+ 0.0,
3347+ 0.0,
3348+ 0.0,
3349+ 0.0,
3350+ 0.0,
3351+ 0.0,
3352+ 0.0,
3353+ 0.0,
3354+ 0.0,
3355+ 0.0
3356+ ]
3357+ },
3358+ "ctl_replace_donor_fewshot|sham_map|L19": {
3359+ "accuracy": 0.0,
3360+ "gain_vs_zero": {
3361+ "estimate": 0.0,
3362+ "low": 0.0,
3363+ "high": 0.0,
3364+ "level": 0.95,
3365+ "n_items": 22,
3366+ "n_clusters": 22,
3367+ "n_boot": 2000
3368+ },
3369+ "outputs_sample": [
3370+ " 10000",
3371+ " 12345",
3372+ " 1\n",
3373+ " 10000",
3374+ " 1\n\n"
3375+ ],
3376+ "correct": [
3377+ 0.0,
3378+ 0.0,
3379+ 0.0,
3380+ 0.0,
3381+ 0.0,
3382+ 0.0,
3383+ 0.0,
3384+ 0.0,
3385+ 0.0,
3386+ 0.0,
3387+ 0.0,
3388+ 0.0,
3389+ 0.0,
3390+ 0.0,
3391+ 0.0,
3392+ 0.0,
3393+ 0.0,
3394+ 0.0,
3395+ 0.0,
3396+ 0.0,
3397+ 0.0,
3398+ 0.0
3399+ ]
3400+ },
3401+ "ctl_replace_donor_zeroshot|sham_map|L19": {
3402+ "accuracy": 0.0,
3403+ "gain_vs_zero": {
3404+ "estimate": 0.0,
3405+ "low": 0.0,
3406+ "high": 0.0,
3407+ "level": 0.95,
3408+ "n_items": 22,
3409+ "n_clusters": 22,
3410+ "n_boot": 2000
3411+ },
3412+ "outputs_sample": [
3413+ " 10000",
3414+ " 1\n\n",
3415+ " 1\n\n",
3416+ " 10000",
3417+ " 1\n\n"
3418+ ],
3419+ "correct": [
3420+ 0.0,
3421+ 0.0,
3422+ 0.0,
3423+ 0.0,
3424+ 0.0,
3425+ 0.0,
3426+ 0.0,
3427+ 0.0,
3428+ 0.0,
3429+ 0.0,
3430+ 0.0,
3431+ 0.0,
3432+ 0.0,
3433+ 0.0,
3434+ 0.0,
3435+ 0.0,
3436+ 0.0,
3437+ 0.0,
3438+ 0.0,
3439+ 0.0,
3440+ 0.0,
3441+ 0.0
3442+ ]
3443+ },
3444+ "ctl_replace_donor_fewshot_shuffled_query|sham_map|L19": {
3445+ "accuracy": 0.0,
3446+ "gain_vs_zero": {
3447+ "estimate": 0.0,
3448+ "low": 0.0,
3449+ "high": 0.0,
3450+ "level": 0.95,
3451+ "n_items": 22,
3452+ "n_clusters": 22,
3453+ "n_boot": 2000
3454+ },
3455+ "outputs_sample": [
3456+ " 10000",
3457+ " 12345",
3458+ " 1\n",
3459+ " 10000",
3460+ " Japan is a country located in"
3461+ ],
3462+ "correct": [
3463+ 0.0,
3464+ 0.0,
3465+ 0.0,
3466+ 0.0,
3467+ 0.0,
3468+ 0.0,
3469+ 0.0,
3470+ 0.0,
3471+ 0.0,
3472+ 0.0,
3473+ 0.0,
3474+ 0.0,
3475+ 0.0,
3476+ 0.0,
3477+ 0.0,
3478+ 0.0,
3479+ 0.0,
3480+ 0.0,
3481+ 0.0,
3482+ 0.0,
3483+ 0.0,
3484+ 0.0
3485+ ]
3486+ },
3487+ "ctl_random_norm_matched|L19": {
3488+ "accuracy": 0.0,
3489+ "gain_vs_zero": {
3490+ "estimate": 0.0,
3491+ "low": 0.0,
3492+ "high": 0.0,
3493+ "level": 0.95,
3494+ "n_items": 22,
3495+ "n_clusters": 22,
3496+ "n_boot": 2000
3497+ },
3498+ "correct": [
3499+ 0.0,
3500+ 0.0,
3501+ 0.0,
3502+ 0.0,
3503+ 0.0,
3504+ 0.0,
3505+ 0.0,
3506+ 0.0,
3507+ 0.0,
3508+ 0.0,
3509+ 0.0,
3510+ 0.0,
3511+ 0.0,
3512+ 0.0,
3513+ 0.0,
3514+ 0.0,
3515+ 0.0,
3516+ 0.0,
3517+ 0.0,
3518+ 0.0,
3519+ 0.0,
3520+ 0.0
3521+ ]
3522+ },
3523+ "ctl_unrelated_task_vector(antonym)|L19": {
3524+ "accuracy": 0.0,
3525+ "gain_vs_zero": {
3526+ "estimate": 0.0,
3527+ "low": 0.0,
3528+ "high": 0.0,
3529+ "level": 0.95,
3530+ "n_items": 22,
3531+ "n_clusters": 22,
3532+ "n_boot": 2000
3533+ },
3534+ "correct": [
3535+ 0.0,
3536+ 0.0,
3537+ 0.0,
3538+ 0.0,
3539+ 0.0,
3540+ 0.0,
3541+ 0.0,
3542+ 0.0,
3543+ 0.0,
3544+ 0.0,
3545+ 0.0,
3546+ 0.0,
3547+ 0.0,
3548+ 0.0,
3549+ 0.0,
3550+ 0.0,
3551+ 0.0,
3552+ 0.0,
3553+ 0.0,
3554+ 0.0,
3555+ 0.0,
3556+ 0.0
3557+ ]
3558+ },
3559+ "procrustes|L22|a1.0": {
3560+ "accuracy": 0.0,
3561+ "gain_vs_zero": {
3562+ "estimate": 0.0,
3563+ "low": 0.0,
3564+ "high": 0.0,
3565+ "level": 0.95,
3566+ "n_items": 22,
3567+ "n_clusters": 22,
3568+ "n_boot": 2000
3569+ },
3570+ "mapped_norm": 68.82747650146484,
3571+ "outputs_sample": [
3572+ " Venezuela is a country located in",
3573+ " Finland is a country located in",
3574+ " France\n\n",
3575+ " Turkey is a country located in",
3576+ " Japan is a country located in"
3577+ ],
3578+ "correct": [
3579+ 0.0,
3580+ 0.0,
3581+ 0.0,
3582+ 0.0,
3583+ 0.0,
3584+ 0.0,
3585+ 0.0,
3586+ 0.0,
3587+ 0.0,
3588+ 0.0,
3589+ 0.0,
3590+ 0.0,
3591+ 0.0,
3592+ 0.0,
3593+ 0.0,
3594+ 0.0,
3595+ 0.0,
3596+ 0.0,
3597+ 0.0,
3598+ 0.0,
3599+ 0.0,
3600+ 0.0
3601+ ]
3602+ },
3603+ "procrustes|L22|a2.0": {
3604+ "accuracy": 0.09090909090909091,
3605+ "gain_vs_zero": {
3606+ "estimate": 0.09090909090909091,
3607+ "low": 0.0,
3608+ "high": 0.22727272727272727,
3609+ "level": 0.95,
3610+ "n_items": 22,
3611+ "n_clusters": 22,
3612+ "n_boot": 2000
3613+ },
3614+ "mapped_norm": 68.82747650146484,
3615+ "outputs_sample": [
3616+ " caracas\n",
3617+ " t\n",
3618+ " tangerine\n",
3619+ " mouth\n",
3620+ " 1\n\n"
3621+ ],
3622+ "correct": [
3623+ 1.0,
3624+ 0.0,
3625+ 0.0,
3626+ 0.0,
3627+ 0.0,
3628+ 0.0,
3629+ 0.0,
3630+ 0.0,
3631+ 0.0,
3632+ 0.0,
3633+ 0.0,
3634+ 0.0,
3635+ 0.0,
3636+ 0.0,
3637+ 0.0,
3638+ 0.0,
3639+ 0.0,
3640+ 0.0,
3641+ 1.0,
3642+ 0.0,
3643+ 0.0,
3644+ 0.0
3645+ ]
3646+ },
3647+ "procrustes_rescaled|L22|a1.0": {
3648+ "accuracy": 0.0,
3649+ "gain_vs_zero": {
3650+ "estimate": 0.0,
3651+ "low": 0.0,
3652+ "high": 0.0,
3653+ "level": 0.95,
3654+ "n_items": 22,
3655+ "n_clusters": 22,
3656+ "n_boot": 2000
3657+ },
3658+ "mapped_norm": 75.94140625,
3659+ "outputs_sample": [
3660+ " Venezuela is a country located in",
3661+ " Finland is a country located in",
3662+ " France\n\n",
3663+ " Turkey is a country located in",
3664+ " Japan is a country located in"
3665+ ],
3666+ "correct": [
3667+ 0.0,
3668+ 0.0,
3669+ 0.0,
3670+ 0.0,
3671+ 0.0,
3672+ 0.0,
3673+ 0.0,
3674+ 0.0,
3675+ 0.0,
3676+ 0.0,
3677+ 0.0,
3678+ 0.0,
3679+ 0.0,
3680+ 0.0,
3681+ 0.0,
3682+ 0.0,
3683+ 0.0,
3684+ 0.0,
3685+ 0.0,
3686+ 0.0,
3687+ 0.0,
3688+ 0.0
3689+ ]
3690+ },
3691+ "ridge|L22|a1.0": {
3692+ "accuracy": 0.09090909090909091,
3693+ "gain_vs_zero": {
3694+ "estimate": 0.09090909090909091,
3695+ "low": 0.0,
3696+ "high": 0.22727272727272727,
3697+ "level": 0.95,
3698+ "n_items": 22,
3699+ "n_clusters": 22,
3700+ "n_boot": 2000
3701+ },
3702+ "mapped_norm": 92.07101440429688,
3703+ "outputs_sample": [
3704+ " The country of Venezuela is located",
3705+ " Helsinki\n",
3706+ " The capital of Morocco is Rab",
3707+ " The country of Turkey is located",
3708+ " The capital of Japan is Tokyo"
3709+ ],
3710+ "correct": [
3711+ 0.0,
3712+ 1.0,
3713+ 0.0,
3714+ 0.0,
3715+ 0.0,
3716+ 0.0,
3717+ 0.0,
3718+ 1.0,
3719+ 0.0,
3720+ 0.0,
3721+ 0.0,
3722+ 0.0,
3723+ 0.0,
3724+ 0.0,
3725+ 0.0,
3726+ 0.0,
3727+ 0.0,
3728+ 0.0,
3729+ 0.0,
3730+ 0.0,
3731+ 0.0,
3732+ 0.0
3733+ ]
3734+ },
3735+ "ridge|L22|a2.0": {
3736+ "accuracy": 0.0,
3737+ "gain_vs_zero": {
3738+ "estimate": 0.0,
3739+ "low": 0.0,
3740+ "high": 0.0,
3741+ "level": 0.95,
3742+ "n_items": 22,
3743+ "n_clusters": 22,
3744+ "n_boot": 2000
3745+ },
3746+ "mapped_norm": 92.07101440429688,
3747+ "outputs_sample": [
3748+ " New York\n",
3749+ " Finland is a country located in",
3750+ " Salat\n",
3751+ " Salat\n",
3752+ " New Zealand\n"
3753+ ],
3754+ "correct": [
3755+ 0.0,
3756+ 0.0,
3757+ 0.0,
3758+ 0.0,
3759+ 0.0,
3760+ 0.0,
3761+ 0.0,
3762+ 0.0,
3763+ 0.0,
3764+ 0.0,
3765+ 0.0,
3766+ 0.0,
3767+ 0.0,
3768+ 0.0,
3769+ 0.0,
3770+ 0.0,
3771+ 0.0,
3772+ 0.0,
3773+ 0.0,
3774+ 0.0,
3775+ 0.0,
3776+ 0.0
3777+ ]
3778+ },
3779+ "ridge_rescaled|L22|a1.0": {
3780+ "accuracy": 0.09090909090909091,
3781+ "gain_vs_zero": {
3782+ "estimate": 0.09090909090909091,
3783+ "low": 0.0,
3784+ "high": 0.22727272727272727,
3785+ "level": 0.95,
3786+ "n_items": 22,
3787+ "n_clusters": 22,
3788+ "n_boot": 2000
3789+ },
3790+ "mapped_norm": 75.94140625,
3791+ "outputs_sample": [
3792+ " The country of Venezuela is located",
3793+ " Helsinki\n",
3794+ " The capital of Morocco is Rab",
3795+ " The country of Turkey is located",
3796+ " The capital of Japan is Tokyo"
3797+ ],
3798+ "correct": [
3799+ 0.0,
3800+ 1.0,
3801+ 0.0,
3802+ 0.0,
3803+ 0.0,
3804+ 0.0,
3805+ 0.0,
3806+ 1.0,
3807+ 0.0,
3808+ 0.0,
3809+ 0.0,
3810+ 0.0,
3811+ 0.0,
3812+ 0.0,
3813+ 0.0,
3814+ 0.0,
3815+ 0.0,
3816+ 0.0,
3817+ 0.0,
3818+ 0.0,
3819+ 0.0,
3820+ 0.0
3821+ ]
3822+ },
3823+ "cca|L22|a1.0": {
3824+ "accuracy": 0.045454545454545456,
3825+ "gain_vs_zero": {
3826+ "estimate": 0.045454545454545456,
3827+ "low": 0.0,
3828+ "high": 0.13636363636363635,
3829+ "level": 0.95,
3830+ "n_items": 22,
3831+ "n_clusters": 22,
3832+ "n_boot": 2000
3833+ },
3834+ "mapped_norm": 109.1942138671875,
3835+ "outputs_sample": [
3836+ " The country of Venezuela is located",
3837+ " Helsinki\n",
3838+ " The capital of Morocco is Rab",
3839+ " The country of Turkey is located",
3840+ " The capital of Japan is Tokyo"
3841+ ],
3842+ "correct": [
3843+ 0.0,
3844+ 1.0,
3845+ 0.0,
3846+ 0.0,
3847+ 0.0,
3848+ 0.0,
3849+ 0.0,
3850+ 0.0,
3851+ 0.0,
3852+ 0.0,
3853+ 0.0,
3854+ 0.0,
3855+ 0.0,
3856+ 0.0,
3857+ 0.0,
3858+ 0.0,
3859+ 0.0,
3860+ 0.0,
3861+ 0.0,
3862+ 0.0,
3863+ 0.0,
3864+ 0.0
3865+ ]
3866+ },
3867+ "cca|L22|a2.0": {
3868+ "accuracy": 0.0,
3869+ "gain_vs_zero": {
3870+ "estimate": 0.0,
3871+ "low": 0.0,
3872+ "high": 0.0,
3873+ "level": 0.95,
3874+ "n_items": 22,
3875+ "n_clusters": 22,
3876+ "n_boot": 2000
3877+ },
3878+ "mapped_norm": 109.1942138671875,
3879+ "outputs_sample": [
3880+ " New York\n",
3881+ " New Zealand\n",
3882+ " Salat\n",
3883+ " The country of Turkey is located",
3884+ " New Zealand\n"
3885+ ],
3886+ "correct": [
3887+ 0.0,
3888+ 0.0,
3889+ 0.0,
3890+ 0.0,
3891+ 0.0,
3892+ 0.0,
3893+ 0.0,
3894+ 0.0,
3895+ 0.0,
3896+ 0.0,
3897+ 0.0,
3898+ 0.0,
3899+ 0.0,
3900+ 0.0,
3901+ 0.0,
3902+ 0.0,
3903+ 0.0,
3904+ 0.0,
3905+ 0.0,
3906+ 0.0,
3907+ 0.0,
3908+ 0.0
3909+ ]
3910+ },
3911+ "random_orth|L22|a1.0": {
3912+ "accuracy": 0.0,
3913+ "gain_vs_zero": {
3914+ "estimate": 0.0,
3915+ "low": 0.0,
3916+ "high": 0.0,
3917+ "level": 0.95,
3918+ "n_items": 22,
3919+ "n_clusters": 22,
3920+ "n_boot": 2000
3921+ },
3922+ "mapped_norm": 75.10470581054688,
3923+ "outputs_sample": [
3924+ " The country of Venezuela is located",
3925+ " The capital of Finland is Helsinki",
3926+ " The capital of Morocco is Rab",
3927+ " Turkey is a country located in",
3928+ " Japan is a country located in"
3929+ ],
3930+ "correct": [
3931+ 0.0,
3932+ 0.0,
3933+ 0.0,
3934+ 0.0,
3935+ 0.0,
3936+ 0.0,
3937+ 0.0,
3938+ 0.0,
3939+ 0.0,
3940+ 0.0,
3941+ 0.0,
3942+ 0.0,
3943+ 0.0,
3944+ 0.0,
3945+ 0.0,
3946+ 0.0,
3947+ 0.0,
3948+ 0.0,
3949+ 0.0,
3950+ 0.0,
3951+ 0.0,
3952+ 0.0
3953+ ]
3954+ },
3955+ "random_orth|L22|a2.0": {
3956+ "accuracy": 0.0,
3957+ "gain_vs_zero": {
3958+ "estimate": 0.0,
3959+ "low": 0.0,
3960+ "high": 0.0,
3961+ "level": 0.95,
3962+ "n_items": 22,
3963+ "n_clusters": 22,
3964+ "n_boot": 2000
3965+ },
3966+ "mapped_norm": 75.10470581054688,
3967+ "outputs_sample": [
3968+ " The country of Venezuela is located",
3969+ " The capital of Finland is Helsinki",
3970+ " The capital of Morocco is Rab",
3971+ " What is the capital of Turkey",
3972+ " The capital of Japan is Tokyo"
3973+ ],
3974+ "correct": [
3975+ 0.0,
3976+ 0.0,
3977+ 0.0,
3978+ 0.0,
3979+ 0.0,
3980+ 0.0,
3981+ 0.0,
3982+ 0.0,
3983+ 0.0,
3984+ 0.0,
3985+ 0.0,
3986+ 0.0,
3987+ 0.0,
3988+ 0.0,
3989+ 0.0,
3990+ 0.0,
3991+ 0.0,
3992+ 0.0,
3993+ 0.0,
3994+ 0.0,
3995+ 0.0,
3996+ 0.0
3997+ ]
3998+ },
3999+ "replace_donor_fewshot|procrustes|L22": {
4000+ "accuracy": 0.0,
4001+ "gain_vs_zero": {
4002+ "estimate": 0.0,
4003+ "low": 0.0,
4004+ "high": 0.0,
4005+ "level": 0.95,
4006+ "n_items": 22,
4007+ "n_clusters": 22,
4008+ "n_boot": 2000
4009+ },
4010+ "outputs_sample": [
4011+ " 1\n",
4012+ " 1\n",
4013+ " 1\n",
4014+ " 1\n",
4015+ " 1\n\n"
4016+ ],
4017+ "correct": [
4018+ 0.0,
4019+ 0.0,
4020+ 0.0,
4021+ 0.0,
4022+ 0.0,
4023+ 0.0,
4024+ 0.0,
4025+ 0.0,
4026+ 0.0,
4027+ 0.0,
4028+ 0.0,
4029+ 0.0,
4030+ 0.0,
4031+ 0.0,
4032+ 0.0,
4033+ 0.0,
4034+ 0.0,
4035+ 0.0,
4036+ 0.0,
4037+ 0.0,
4038+ 0.0,
4039+ 0.0
4040+ ]
4041+ },
4042+ "ctl_replace_donor_zeroshot|procrustes|L22": {
4043+ "accuracy": 0.0,
4044+ "gain_vs_zero": {
4045+ "estimate": 0.0,
4046+ "low": 0.0,
4047+ "high": 0.0,
4048+ "level": 0.95,
4049+ "n_items": 22,
4050+ "n_clusters": 22,
4051+ "n_boot": 2000
4052+ },
4053+ "outputs_sample": [
4054+ " The country of Venezuela is located",
4055+ " The capital of Finland is Helsinki",
4056+ " The capital of Morocco is Rab",
4057+ " \"Turkey is a country in",
4058+ " \"Japan\" is a country"
4059+ ],
4060+ "correct": [
4061+ 0.0,
4062+ 0.0,
4063+ 0.0,
4064+ 0.0,
4065+ 0.0,
4066+ 0.0,
4067+ 0.0,
4068+ 0.0,
4069+ 0.0,
4070+ 0.0,
4071+ 0.0,
4072+ 0.0,
4073+ 0.0,
4074+ 0.0,
4075+ 0.0,
4076+ 0.0,
4077+ 0.0,
4078+ 0.0,
4079+ 0.0,
4080+ 0.0,
4081+ 0.0,
4082+ 0.0
4083+ ]
4084+ },
4085+ "ctl_replace_donor_fewshot_shuffled_query|procrustes|L22": {
4086+ "accuracy": 0.0,
4087+ "gain_vs_zero": {
4088+ "estimate": 0.0,
4089+ "low": 0.0,
4090+ "high": 0.0,
4091+ "level": 0.95,
4092+ "n_items": 22,
4093+ "n_clusters": 22,
4094+ "n_boot": 2000
4095+ },
4096+ "outputs_sample": [
4097+ " 1\n",
4098+ " 1\n",
4099+ " The capital of Morocco is Rab",
4100+ " 10000",
4101+ " 1\n\n"
4102+ ],
4103+ "correct": [
4104+ 0.0,
4105+ 0.0,
4106+ 0.0,
4107+ 0.0,
4108+ 0.0,
4109+ 0.0,
4110+ 0.0,
4111+ 0.0,
4112+ 0.0,
4113+ 0.0,
4114+ 0.0,
4115+ 0.0,
4116+ 0.0,
4117+ 0.0,
4118+ 0.0,
4119+ 0.0,
4120+ 0.0,
4121+ 0.0,
4122+ 0.0,
4123+ 0.0,
4124+ 0.0,
4125+ 0.0
4126+ ]
4127+ },
4128+ "replace_donor_fewshot|ridge|L22": {
4129+ "accuracy": 0.0,
4130+ "gain_vs_zero": {
4131+ "estimate": 0.0,
4132+ "low": 0.0,
4133+ "high": 0.0,
4134+ "level": 0.95,
4135+ "n_items": 22,
4136+ "n_clusters": 22,
4137+ "n_boot": 2000
4138+ },
4139+ "outputs_sample": [
4140+ " The country of Venezuela is located",
4141+ " The capital of Finland is Helsinki",
4142+ " The capital of Morocco is Rab",
4143+ " 1\n",
4144+ " The capital of Japan is Tokyo"
4145+ ],
4146+ "correct": [
4147+ 0.0,
4148+ 0.0,
4149+ 0.0,
4150+ 0.0,
4151+ 0.0,
4152+ 0.0,
4153+ 0.0,
4154+ 0.0,
4155+ 0.0,
4156+ 0.0,
4157+ 0.0,
4158+ 0.0,
4159+ 0.0,
4160+ 0.0,
4161+ 0.0,
4162+ 0.0,
4163+ 0.0,
4164+ 0.0,
4165+ 0.0,
4166+ 0.0,
4167+ 0.0,
4168+ 0.0
4169+ ]
4170+ },
4171+ "ctl_replace_donor_zeroshot|ridge|L22": {
4172+ "accuracy": 0.0,
4173+ "gain_vs_zero": {
4174+ "estimate": 0.0,
4175+ "low": 0.0,
4176+ "high": 0.0,
4177+ "level": 0.95,
4178+ "n_items": 22,
4179+ "n_clusters": 22,
4180+ "n_boot": 2000
4181+ },
4182+ "outputs_sample": [
4183+ " The country of Venezuela is located",
4184+ " The capital of Finland is Helsinki",
4185+ " The capital of Morocco is Rab",
4186+ " \"Turkey is a country in",
4187+ " The capital of Japan is Tokyo"
4188+ ],
4189+ "correct": [
4190+ 0.0,
4191+ 0.0,
4192+ 0.0,
4193+ 0.0,
4194+ 0.0,
4195+ 0.0,
4196+ 0.0,
4197+ 0.0,
4198+ 0.0,
4199+ 0.0,
4200+ 0.0,
4201+ 0.0,
4202+ 0.0,
4203+ 0.0,
4204+ 0.0,
4205+ 0.0,
4206+ 0.0,
4207+ 0.0,
4208+ 0.0,
4209+ 0.0,
4210+ 0.0,
4211+ 0.0
4212+ ]
4213+ },
4214+ "ctl_replace_donor_fewshot_shuffled_query|ridge|L22": {
4215+ "accuracy": 0.0,
4216+ "gain_vs_zero": {
4217+ "estimate": 0.0,
4218+ "low": 0.0,
4219+ "high": 0.0,
4220+ "level": 0.95,
4221+ "n_items": 22,
4222+ "n_clusters": 22,
4223+ "n_boot": 2000
4224+ },
4225+ "outputs_sample": [
4226+ " The country of Venezuela is located",
4227+ " The capital of Finland is Helsinki",
4228+ " The capital of Morocco is Rab",
4229+ " The capital of Turkey is Ankara",
4230+ " The capital of Japan is Tokyo"
4231+ ],
4232+ "correct": [
4233+ 0.0,
4234+ 0.0,
4235+ 0.0,
4236+ 0.0,
4237+ 0.0,
4238+ 0.0,
4239+ 0.0,
4240+ 0.0,
4241+ 0.0,
4242+ 0.0,
4243+ 0.0,
4244+ 0.0,
4245+ 0.0,
4246+ 0.0,
4247+ 0.0,
4248+ 0.0,
4249+ 0.0,
4250+ 0.0,
4251+ 0.0,
4252+ 0.0,
4253+ 0.0,
4254+ 0.0
4255+ ]
4256+ },
4257+ "ctl_replace_donor_fewshot|sham_map|L22": {
4258+ "accuracy": 0.0,
4259+ "gain_vs_zero": {
4260+ "estimate": 0.0,
4261+ "low": 0.0,
4262+ "high": 0.0,
4263+ "level": 0.95,
4264+ "n_items": 22,
4265+ "n_clusters": 22,
4266+ "n_boot": 2000
4267+ },
4268+ "outputs_sample": [
4269+ " The country of Venezuela is located",
4270+ " 17\n",
4271+ " 1\n",
4272+ " The country of Turkey is located",
4273+ " 1\n\n"
4274+ ],
4275+ "correct": [
4276+ 0.0,
4277+ 0.0,
4278+ 0.0,
4279+ 0.0,
4280+ 0.0,
4281+ 0.0,
4282+ 0.0,
4283+ 0.0,
4284+ 0.0,
4285+ 0.0,
4286+ 0.0,
4287+ 0.0,
4288+ 0.0,
4289+ 0.0,
4290+ 0.0,
4291+ 0.0,
4292+ 0.0,
4293+ 0.0,
4294+ 0.0,
4295+ 0.0,
4296+ 0.0,
4297+ 0.0
4298+ ]
4299+ },
4300+ "ctl_replace_donor_zeroshot|sham_map|L22": {
4301+ "accuracy": 0.0,
4302+ "gain_vs_zero": {
4303+ "estimate": 0.0,
4304+ "low": 0.0,
4305+ "high": 0.0,
4306+ "level": 0.95,
4307+ "n_items": 22,
4308+ "n_clusters": 22,
4309+ "n_boot": 2000
4310+ },
4311+ "outputs_sample": [
4312+ " 10000",
4313+ " 17\n\n",
4314+ " 1\n",
4315+ " 10000",
4316+ " 1\n\n"
4317+ ],
4318+ "correct": [
4319+ 0.0,
4320+ 0.0,
4321+ 0.0,
4322+ 0.0,
4323+ 0.0,
4324+ 0.0,
4325+ 0.0,
4326+ 0.0,
4327+ 0.0,
4328+ 0.0,
4329+ 0.0,
4330+ 0.0,
4331+ 0.0,
4332+ 0.0,
4333+ 0.0,
4334+ 0.0,
4335+ 0.0,
4336+ 0.0,
4337+ 0.0,
4338+ 0.0,
4339+ 0.0,
4340+ 0.0
4341+ ]
4342+ },
4343+ "ctl_replace_donor_fewshot_shuffled_query|sham_map|L22": {
4344+ "accuracy": 0.0,
4345+ "gain_vs_zero": {
4346+ "estimate": 0.0,
4347+ "low": 0.0,
4348+ "high": 0.0,
4349+ "level": 0.95,
4350+ "n_items": 22,
4351+ "n_clusters": 22,
4352+ "n_boot": 2000
4353+ },
4354+ "outputs_sample": [
4355+ " 10000",
4356+ " 17\n",
4357+ " 1\n",
4358+ " 10000",
4359+ " 1\n\n"
4360+ ],
4361+ "correct": [
4362+ 0.0,
4363+ 0.0,
4364+ 0.0,
4365+ 0.0,
4366+ 0.0,
4367+ 0.0,
4368+ 0.0,
4369+ 0.0,
4370+ 0.0,
4371+ 0.0,
4372+ 0.0,
4373+ 0.0,
4374+ 0.0,
4375+ 0.0,
4376+ 0.0,
4377+ 0.0,
4378+ 0.0,
4379+ 0.0,
4380+ 0.0,
4381+ 0.0,
4382+ 0.0,
4383+ 0.0
4384+ ]
4385+ },
4386+ "ctl_random_norm_matched|L22": {
4387+ "accuracy": 0.0,
4388+ "gain_vs_zero": {
4389+ "estimate": 0.0,
4390+ "low": 0.0,
4391+ "high": 0.0,
4392+ "level": 0.95,
4393+ "n_items": 22,
4394+ "n_clusters": 22,
4395+ "n_boot": 2000
4396+ },
4397+ "correct": [
4398+ 0.0,
4399+ 0.0,
4400+ 0.0,
4401+ 0.0,
4402+ 0.0,
4403+ 0.0,
4404+ 0.0,
4405+ 0.0,
4406+ 0.0,
4407+ 0.0,
4408+ 0.0,
4409+ 0.0,
4410+ 0.0,
4411+ 0.0,
4412+ 0.0,
4413+ 0.0,
4414+ 0.0,
4415+ 0.0,
4416+ 0.0,
4417+ 0.0,
4418+ 0.0,
4419+ 0.0
4420+ ]
4421+ },
4422+ "ctl_unrelated_task_vector(antonym)|L22": {
4423+ "accuracy": 0.0,
4424+ "gain_vs_zero": {
4425+ "estimate": 0.0,
4426+ "low": 0.0,
4427+ "high": 0.0,
4428+ "level": 0.95,
4429+ "n_items": 22,
4430+ "n_clusters": 22,
4431+ "n_boot": 2000
4432+ },
4433+ "correct": [
4434+ 0.0,
4435+ 0.0,
4436+ 0.0,
4437+ 0.0,
4438+ 0.0,
4439+ 0.0,
4440+ 0.0,
4441+ 0.0,
4442+ 0.0,
4443+ 0.0,
4444+ 0.0,
4445+ 0.0,
4446+ 0.0,
4447+ 0.0,
4448+ 0.0,
4449+ 0.0,
4450+ 0.0,
4451+ 0.0,
4452+ 0.0,
4453+ 0.0,
4454+ 0.0,
4455+ 0.0
4456+ ]
4457+ }
4458+ },
4459+ "items": {
4460+ "zero": [
4461+ 0.0,
4462+ 0.0,
4463+ 0.0,
4464+ 0.0,
4465+ 0.0,
4466+ 0.0,
4467+ 0.0,
4468+ 0.0,
4469+ 0.0,
4470+ 0.0,
4471+ 0.0,
4472+ 0.0,
4473+ 0.0,
4474+ 0.0,
4475+ 0.0,
4476+ 0.0,
4477+ 0.0,
4478+ 0.0,
4479+ 0.0,
4480+ 0.0,
4481+ 0.0,
4482+ 0.0
4483+ ],
4484+ "few": [
4485+ 1.0,
4486+ 1.0,
4487+ 1.0,
4488+ 1.0,
4489+ 1.0,
4490+ 1.0,
4491+ 1.0,
4492+ 1.0,
4493+ 1.0,
4494+ 1.0,
4495+ 1.0,
4496+ 1.0,
4497+ 1.0,
4498+ 1.0,
4499+ 1.0,
4500+ 1.0,
4501+ 1.0,
4502+ 1.0,
4503+ 1.0,
4504+ 1.0,
4505+ 1.0,
4506+ 1.0
4507+ ],
4508+ "own": [
4509+ 1.0,
4510+ 1.0,
4511+ 1.0,
4512+ 1.0,
4513+ 1.0,
4514+ 0.0,
4515+ 1.0,
4516+ 1.0,
4517+ 0.0,
4518+ 1.0,
4519+ 1.0,
4520+ 1.0,
4521+ 1.0,
4522+ 1.0,
4523+ 0.0,
4524+ 1.0,
4525+ 1.0,
4526+ 0.0,
4527+ 1.0,
4528+ 1.0,
4529+ 1.0,
4530+ 1.0
4531+ ]
4532+ }
4533+ },
4534+ "morph": {
4535+ "recipient_zero": 0.0,
4536+ "recipient_few": 0.3,
4537+ "recipient_own_vector": 0.0,
4538+ "donor_layer": 2,
4539+ "conditions": {
4540+ "procrustes|L2|a1.0": {
4541+ "accuracy": 0.0,
4542+ "gain_vs_zero": {
4543+ "estimate": 0.0,
4544+ "low": 0.0,
4545+ "high": 0.0,
4546+ "level": 0.95,
4547+ "n_items": 40,
4548+ "n_clusters": 40,
4549+ "n_boot": 2000
4550+ },
4551+ "mapped_norm": 11.232007026672363,
4552+ "outputs_sample": [
4553+ " 10000",
4554+ " The word \"zonofab",
4555+ " \"vofisu\"\n",
4556+ " 10000",
4557+ " \"zute\" is a"
4558+ ],
4559+ "correct": [
4560+ 0.0,
4561+ 0.0,
4562+ 0.0,
4563+ 0.0,
4564+ 0.0,
4565+ 0.0,
4566+ 0.0,
4567+ 0.0,
4568+ 0.0,
4569+ 0.0,
4570+ 0.0,
4571+ 0.0,
4572+ 0.0,
4573+ 0.0,
4574+ 0.0,
4575+ 0.0,
4576+ 0.0,
4577+ 0.0,
4578+ 0.0,
4579+ 0.0,
4580+ 0.0,
4581+ 0.0,
4582+ 0.0,
4583+ 0.0,
4584+ 0.0,
4585+ 0.0,
4586+ 0.0,
4587+ 0.0,
4588+ 0.0,
4589+ 0.0,
4590+ 0.0,
4591+ 0.0,
4592+ 0.0,
4593+ 0.0,
4594+ 0.0,
4595+ 0.0,
4596+ 0.0,
4597+ 0.0,
4598+ 0.0,
4599+ 0.0
4600+ ]
4601+ },
4602+ "procrustes|L2|a2.0": {
4603+ "accuracy": 0.0,
4604+ "gain_vs_zero": {
4605+ "estimate": 0.0,
4606+ "low": 0.0,
4607+ "high": 0.0,
4608+ "level": 0.95,
4609+ "n_items": 40,
4610+ "n_clusters": 40,
4611+ "n_boot": 2000
4612+ },
4613+ "mapped_norm": 11.232007026672363,
4614+ "outputs_sample": [
4615+ " 10000",
4616+ " The word \"zonofab",
4617+ " \"vofisu\"\n",
4618+ " 10000",
4619+ " \"zute\" is a"
4620+ ],
4621+ "correct": [
4622+ 0.0,
4623+ 0.0,
4624+ 0.0,
4625+ 0.0,
4626+ 0.0,
4627+ 0.0,
4628+ 0.0,
4629+ 0.0,
4630+ 0.0,
4631+ 0.0,
4632+ 0.0,
4633+ 0.0,
4634+ 0.0,
4635+ 0.0,
4636+ 0.0,
4637+ 0.0,
4638+ 0.0,
4639+ 0.0,
4640+ 0.0,
4641+ 0.0,
4642+ 0.0,
4643+ 0.0,
4644+ 0.0,
4645+ 0.0,
4646+ 0.0,
4647+ 0.0,
4648+ 0.0,
4649+ 0.0,
4650+ 0.0,
4651+ 0.0,
4652+ 0.0,
4653+ 0.0,
4654+ 0.0,
4655+ 0.0,
4656+ 0.0,
4657+ 0.0,
4658+ 0.0,
4659+ 0.0,
4660+ 0.0,
4661+ 0.0
4662+ ]
4663+ },
4664+ "procrustes_rescaled|L2|a1.0": {
4665+ "accuracy": 0.0,
4666+ "gain_vs_zero": {
4667+ "estimate": 0.0,
4668+ "low": 0.0,
4669+ "high": 0.0,
4670+ "level": 0.95,
4671+ "n_items": 40,
4672+ "n_clusters": 40,
4673+ "n_boot": 2000
4674+ },
4675+ "mapped_norm": 12.061471939086914,
4676+ "outputs_sample": [
4677+ " 10000",
4678+ " The word \"zonofab",
4679+ " \"vofisu\"\n",
4680+ " 10000",
4681+ " \"zute\" is a"
4682+ ],
4683+ "correct": [
4684+ 0.0,
4685+ 0.0,
4686+ 0.0,
4687+ 0.0,
4688+ 0.0,
4689+ 0.0,
4690+ 0.0,
4691+ 0.0,
4692+ 0.0,
4693+ 0.0,
4694+ 0.0,
4695+ 0.0,
4696+ 0.0,
4697+ 0.0,
4698+ 0.0,
4699+ 0.0,
4700+ 0.0,
4701+ 0.0,
4702+ 0.0,
4703+ 0.0,
4704+ 0.0,
4705+ 0.0,
4706+ 0.0,
4707+ 0.0,
4708+ 0.0,
4709+ 0.0,
4710+ 0.0,
4711+ 0.0,
4712+ 0.0,
4713+ 0.0,
4714+ 0.0,
4715+ 0.0,
4716+ 0.0,
4717+ 0.0,
4718+ 0.0,
4719+ 0.0,
4720+ 0.0,
4721+ 0.0,
4722+ 0.0,
4723+ 0.0
4724+ ]
4725+ },
4726+ "ridge|L2|a1.0": {
4727+ "accuracy": 0.0,
4728+ "gain_vs_zero": {
4729+ "estimate": 0.0,
4730+ "low": 0.0,
4731+ "high": 0.0,
4732+ "level": 0.95,
4733+ "n_items": 40,
4734+ "n_clusters": 40,
4735+ "n_boot": 2000
4736+ },
4737+ "mapped_norm": 12.087592124938965,
4738+ "outputs_sample": [
4739+ " 10000",
4740+ " The word \"zonofab",
4741+ " \"vofisu\"\n",
4742+ " 10000",
4743+ " \"zute\" is a"
4744+ ],
4745+ "correct": [
4746+ 0.0,
4747+ 0.0,
4748+ 0.0,
4749+ 0.0,
4750+ 0.0,
4751+ 0.0,
4752+ 0.0,
4753+ 0.0,
4754+ 0.0,
4755+ 0.0,
4756+ 0.0,
4757+ 0.0,
4758+ 0.0,
4759+ 0.0,
4760+ 0.0,
4761+ 0.0,
4762+ 0.0,
4763+ 0.0,
4764+ 0.0,
4765+ 0.0,
4766+ 0.0,
4767+ 0.0,
4768+ 0.0,
4769+ 0.0,
4770+ 0.0,
4771+ 0.0,
4772+ 0.0,
4773+ 0.0,
4774+ 0.0,
4775+ 0.0,
4776+ 0.0,
4777+ 0.0,
4778+ 0.0,
4779+ 0.0,
4780+ 0.0,
4781+ 0.0,
4782+ 0.0,
4783+ 0.0,
4784+ 0.0,
4785+ 0.0
4786+ ]
4787+ },
4788+ "ridge|L2|a2.0": {
4789+ "accuracy": 0.0,
4790+ "gain_vs_zero": {
4791+ "estimate": 0.0,
4792+ "low": 0.0,
4793+ "high": 0.0,
4794+ "level": 0.95,
4795+ "n_items": 40,
4796+ "n_clusters": 40,
4797+ "n_boot": 2000
4798+ },
4799+ "mapped_norm": 12.087592124938965,
4800+ "outputs_sample": [
4801+ " 10000",
4802+ " 1\n",
4803+ " 1\n",
4804+ " 10000",
4805+ " \"Zute is a small"
4806+ ],
4807+ "correct": [
4808+ 0.0,
4809+ 0.0,
4810+ 0.0,
4811+ 0.0,
4812+ 0.0,
4813+ 0.0,
4814+ 0.0,
4815+ 0.0,
4816+ 0.0,
4817+ 0.0,
4818+ 0.0,
4819+ 0.0,
4820+ 0.0,
4821+ 0.0,
4822+ 0.0,
4823+ 0.0,
4824+ 0.0,
4825+ 0.0,
4826+ 0.0,
4827+ 0.0,
4828+ 0.0,
4829+ 0.0,
4830+ 0.0,
4831+ 0.0,
4832+ 0.0,
4833+ 0.0,
4834+ 0.0,
4835+ 0.0,
4836+ 0.0,
4837+ 0.0,
4838+ 0.0,
4839+ 0.0,
4840+ 0.0,
4841+ 0.0,
4842+ 0.0,
4843+ 0.0,
4844+ 0.0,
4845+ 0.0,
4846+ 0.0,
4847+ 0.0
4848+ ]
4849+ },
4850+ "ridge_rescaled|L2|a1.0": {
4851+ "accuracy": 0.0,
4852+ "gain_vs_zero": {
4853+ "estimate": 0.0,
4854+ "low": 0.0,
4855+ "high": 0.0,
4856+ "level": 0.95,
4857+ "n_items": 40,
4858+ "n_clusters": 40,
4859+ "n_boot": 2000
4860+ },
4861+ "mapped_norm": 12.061471939086914,
4862+ "outputs_sample": [
4863+ " 10000",
4864+ " The word \"zonofab",
4865+ " \"vofisu\"\n",
4866+ " 10000",
4867+ " \"zute\" is a"
4868+ ],
4869+ "correct": [
4870+ 0.0,
4871+ 0.0,
4872+ 0.0,
4873+ 0.0,
4874+ 0.0,
4875+ 0.0,
4876+ 0.0,
4877+ 0.0,
4878+ 0.0,
4879+ 0.0,
4880+ 0.0,
4881+ 0.0,
4882+ 0.0,
4883+ 0.0,
4884+ 0.0,
4885+ 0.0,
4886+ 0.0,
4887+ 0.0,
4888+ 0.0,
4889+ 0.0,
4890+ 0.0,
4891+ 0.0,
4892+ 0.0,
4893+ 0.0,
4894+ 0.0,
4895+ 0.0,
4896+ 0.0,
4897+ 0.0,
4898+ 0.0,
4899+ 0.0,
4900+ 0.0,
4901+ 0.0,
4902+ 0.0,
4903+ 0.0,
4904+ 0.0,
4905+ 0.0,
4906+ 0.0,
4907+ 0.0,
4908+ 0.0,
4909+ 0.0
4910+ ]
4911+ },
4912+ "cca|L2|a1.0": {
4913+ "accuracy": 0.0,
4914+ "gain_vs_zero": {
4915+ "estimate": 0.0,
4916+ "low": 0.0,
4917+ "high": 0.0,
4918+ "level": 0.95,
4919+ "n_items": 40,
4920+ "n_clusters": 40,
4921+ "n_boot": 2000
4922+ },
4923+ "mapped_norm": 12.566847801208496,
4924+ "outputs_sample": [
4925+ " 10000",
4926+ " The word \"zonofab",
4927+ " 1\n",
4928+ " 10000",
4929+ " \"zute\" is a"
4930+ ],
4931+ "correct": [
4932+ 0.0,
4933+ 0.0,
4934+ 0.0,
4935+ 0.0,
4936+ 0.0,
4937+ 0.0,
4938+ 0.0,
4939+ 0.0,
4940+ 0.0,
4941+ 0.0,
4942+ 0.0,
4943+ 0.0,
4944+ 0.0,
4945+ 0.0,
4946+ 0.0,
4947+ 0.0,
4948+ 0.0,
4949+ 0.0,
4950+ 0.0,
4951+ 0.0,
4952+ 0.0,
4953+ 0.0,
4954+ 0.0,
4955+ 0.0,
4956+ 0.0,
4957+ 0.0,
4958+ 0.0,
4959+ 0.0,
4960+ 0.0,
4961+ 0.0,
4962+ 0.0,
4963+ 0.0,
4964+ 0.0,
4965+ 0.0,
4966+ 0.0,
4967+ 0.0,
4968+ 0.0,
4969+ 0.0,
4970+ 0.0,
4971+ 0.0
4972+ ]
4973+ },
4974+ "cca|L2|a2.0": {
4975+ "accuracy": 0.0,
4976+ "gain_vs_zero": {
4977+ "estimate": 0.0,
4978+ "low": 0.0,
4979+ "high": 0.0,
4980+ "level": 0.95,
4981+ "n_items": 40,
4982+ "n_clusters": 40,
4983+ "n_boot": 2000
4984+ },
4985+ "mapped_norm": 12.566847801208496,
4986+ "outputs_sample": [
4987+ " 10000",
4988+ " 1\n",
4989+ " 1\n",
4990+ " 10000",
4991+ " \"zute\" is a"
4992+ ],
4993+ "correct": [
4994+ 0.0,
4995+ 0.0,
4996+ 0.0,
4997+ 0.0,
4998+ 0.0,
4999+ 0.0,
5000+ 0.0,
5001+ 0.0,
5002+ 0.0,
5003+ 0.0,
5004+ 0.0,
5005+ 0.0,
5006+ 0.0,
5007+ 0.0,
5008+ 0.0,
5009+ 0.0,
5010+ 0.0,
5011+ 0.0,
5012+ 0.0,
5013+ 0.0,
5014+ 0.0,
5015+ 0.0,
5016+ 0.0,
5017+ 0.0,
5018+ 0.0,
5019+ 0.0,
5020+ 0.0,
5021+ 0.0,
5022+ 0.0,
5023+ 0.0,
5024+ 0.0,
5025+ 0.0,
5026+ 0.0,
5027+ 0.0,
5028+ 0.0,
5029+ 0.0,
5030+ 0.0,
5031+ 0.0,
5032+ 0.0,
5033+ 0.0
5034+ ]
5035+ },
5036+ "random_orth|L2|a1.0": {
5037+ "accuracy": 0.0,
5038+ "gain_vs_zero": {
5039+ "estimate": 0.0,
5040+ "low": 0.0,
5041+ "high": 0.0,
5042+ "level": 0.95,
5043+ "n_items": 40,
5044+ "n_clusters": 40,
5045+ "n_boot": 2000
5046+ },
5047+ "mapped_norm": 10.567745208740234,
5048+ "outputs_sample": [
5049+ " 10000",
5050+ " The word \"zonofab",
5051+ " \"vofisu\"\n",
5052+ " The word \"tuken\"",
5053+ " The word \"zute\""
5054+ ],
5055+ "correct": [
5056+ 0.0,
5057+ 0.0,
5058+ 0.0,
5059+ 0.0,
5060+ 0.0,
5061+ 0.0,
5062+ 0.0,
5063+ 0.0,
5064+ 0.0,
5065+ 0.0,
5066+ 0.0,
5067+ 0.0,
5068+ 0.0,
5069+ 0.0,
5070+ 0.0,
5071+ 0.0,
5072+ 0.0,
5073+ 0.0,
5074+ 0.0,
5075+ 0.0,
5076+ 0.0,
5077+ 0.0,
5078+ 0.0,
5079+ 0.0,
5080+ 0.0,
5081+ 0.0,
5082+ 0.0,
5083+ 0.0,
5084+ 0.0,
5085+ 0.0,
5086+ 0.0,
5087+ 0.0,
5088+ 0.0,
5089+ 0.0,
5090+ 0.0,
5091+ 0.0,
5092+ 0.0,
5093+ 0.0,
5094+ 0.0,
5095+ 0.0
5096+ ]
5097+ },
5098+ "random_orth|L2|a2.0": {
5099+ "accuracy": 0.0,
5100+ "gain_vs_zero": {
5101+ "estimate": 0.0,
5102+ "low": 0.0,
5103+ "high": 0.0,
5104+ "level": 0.95,
5105+ "n_items": 40,
5106+ "n_clusters": 40,
5107+ "n_boot": 2000
5108+ },
5109+ "mapped_norm": 10.567745208740234,
5110+ "outputs_sample": [
5111+ " 10000",
5112+ " The word \"zonofab",
5113+ " \"vofisu\"\n",
5114+ " \"The quick brown fox jumps",
5115+ " \"zute\" is a"
5116+ ],
5117+ "correct": [
5118+ 0.0,
5119+ 0.0,
5120+ 0.0,
5121+ 0.0,
5122+ 0.0,
5123+ 0.0,
5124+ 0.0,
5125+ 0.0,
5126+ 0.0,
5127+ 0.0,
5128+ 0.0,
5129+ 0.0,
5130+ 0.0,
5131+ 0.0,
5132+ 0.0,
5133+ 0.0,
5134+ 0.0,
5135+ 0.0,
5136+ 0.0,
5137+ 0.0,
5138+ 0.0,
5139+ 0.0,
5140+ 0.0,
5141+ 0.0,
5142+ 0.0,
5143+ 0.0,
5144+ 0.0,
5145+ 0.0,
5146+ 0.0,
5147+ 0.0,
5148+ 0.0,
5149+ 0.0,
5150+ 0.0,
5151+ 0.0,
5152+ 0.0,
5153+ 0.0,
5154+ 0.0,
5155+ 0.0,
5156+ 0.0,
5157+ 0.0
5158+ ]
5159+ },
5160+ "replace_donor_fewshot|procrustes|L2": {
5161+ "accuracy": 0.0,
5162+ "gain_vs_zero": {
5163+ "estimate": 0.0,
5164+ "low": 0.0,
5165+ "high": 0.0,
5166+ "level": 0.95,
5167+ "n_items": 40,
5168+ "n_clusters": 40,
5169+ "n_boot": 2000
5170+ },
5171+ "outputs_sample": [
5172+ " 10000",
5173+ " The word \"zonofab",
5174+ " \"vofisu\"\n",
5175+ " \"tunke\"\n\n",
5176+ " \"zute\" is a"
5177+ ],
5178+ "correct": [
5179+ 0.0,
5180+ 0.0,
5181+ 0.0,
5182+ 0.0,
5183+ 0.0,
5184+ 0.0,
5185+ 0.0,
5186+ 0.0,
5187+ 0.0,
5188+ 0.0,
5189+ 0.0,
5190+ 0.0,
5191+ 0.0,
5192+ 0.0,
5193+ 0.0,
5194+ 0.0,
5195+ 0.0,
5196+ 0.0,
5197+ 0.0,
5198+ 0.0,
5199+ 0.0,
5200+ 0.0,
5201+ 0.0,
5202+ 0.0,
5203+ 0.0,
5204+ 0.0,
5205+ 0.0,
5206+ 0.0,
5207+ 0.0,
5208+ 0.0,
5209+ 0.0,
5210+ 0.0,
5211+ 0.0,
5212+ 0.0,
5213+ 0.0,
5214+ 0.0,
5215+ 0.0,
5216+ 0.0,
5217+ 0.0,
5218+ 0.0
5219+ ]
5220+ },
5221+ "ctl_replace_donor_zeroshot|procrustes|L2": {
5222+ "accuracy": 0.0,
5223+ "gain_vs_zero": {
5224+ "estimate": 0.0,
5225+ "low": 0.0,
5226+ "high": 0.0,
5227+ "level": 0.95,
5228+ "n_items": 40,
5229+ "n_clusters": 40,
5230+ "n_boot": 2000
5231+ },
5232+ "outputs_sample": [
5233+ " 10000",
5234+ " The word \"zonofab",
5235+ " \"vofisu\"\n",
5236+ " 10000",
5237+ " \"zute\" is a"
5238+ ],
5239+ "correct": [
5240+ 0.0,
5241+ 0.0,
5242+ 0.0,
5243+ 0.0,
5244+ 0.0,
5245+ 0.0,
5246+ 0.0,
5247+ 0.0,
5248+ 0.0,
5249+ 0.0,
5250+ 0.0,
5251+ 0.0,
5252+ 0.0,
5253+ 0.0,
5254+ 0.0,
5255+ 0.0,
5256+ 0.0,
5257+ 0.0,
5258+ 0.0,
5259+ 0.0,
5260+ 0.0,
5261+ 0.0,
5262+ 0.0,
5263+ 0.0,
5264+ 0.0,
5265+ 0.0,
5266+ 0.0,
5267+ 0.0,
5268+ 0.0,
5269+ 0.0,
5270+ 0.0,
5271+ 0.0,
5272+ 0.0,
5273+ 0.0,
5274+ 0.0,
5275+ 0.0,
5276+ 0.0,
5277+ 0.0,
5278+ 0.0,
5279+ 0.0
5280+ ]
5281+ },
5282+ "ctl_replace_donor_fewshot_shuffled_query|procrustes|L2": {
5283+ "accuracy": 0.0,
5284+ "gain_vs_zero": {
5285+ "estimate": 0.0,
5286+ "low": 0.0,
5287+ "high": 0.0,
5288+ "level": 0.95,
5289+ "n_items": 40,
5290+ "n_clusters": 40,
5291+ "n_boot": 2000
5292+ },
5293+ "outputs_sample": [
5294+ " 10000",
5295+ " The word \"zonofab",
5296+ " \"vofisu\"\n",
5297+ " \"tunke\"\n\n",
5298+ " \"zute\" is a"
5299+ ],
5300+ "correct": [
5301+ 0.0,
5302+ 0.0,
5303+ 0.0,
5304+ 0.0,
5305+ 0.0,
5306+ 0.0,
5307+ 0.0,
5308+ 0.0,
5309+ 0.0,
5310+ 0.0,
5311+ 0.0,
5312+ 0.0,
5313+ 0.0,
5314+ 0.0,
5315+ 0.0,
5316+ 0.0,
5317+ 0.0,
5318+ 0.0,
5319+ 0.0,
5320+ 0.0,
5321+ 0.0,
5322+ 0.0,
5323+ 0.0,
5324+ 0.0,
5325+ 0.0,
5326+ 0.0,
5327+ 0.0,
5328+ 0.0,
5329+ 0.0,
5330+ 0.0,
5331+ 0.0,
5332+ 0.0,
5333+ 0.0,
5334+ 0.0,
5335+ 0.0,
5336+ 0.0,
5337+ 0.0,
5338+ 0.0,
5339+ 0.0,
5340+ 0.0
5341+ ]
5342+ },
5343+ "replace_donor_fewshot|ridge|L2": {
5344+ "accuracy": 0.0,
5345+ "gain_vs_zero": {
5346+ "estimate": 0.0,
5347+ "low": 0.0,
5348+ "high": 0.0,
5349+ "level": 0.95,
5350+ "n_items": 40,
5351+ "n_clusters": 40,
5352+ "n_boot": 2000
5353+ },
5354+ "outputs_sample": [
5355+ " 10000",
5356+ " The word \"zonofab",
5357+ " 1\n",
5358+ " 10000",
5359+ " \"zute\" is a"
5360+ ],
5361+ "correct": [
5362+ 0.0,
5363+ 0.0,
5364+ 0.0,
5365+ 0.0,
5366+ 0.0,
5367+ 0.0,
5368+ 0.0,
5369+ 0.0,
5370+ 0.0,
5371+ 0.0,
5372+ 0.0,
5373+ 0.0,
5374+ 0.0,
5375+ 0.0,
5376+ 0.0,
5377+ 0.0,
5378+ 0.0,
5379+ 0.0,
5380+ 0.0,
5381+ 0.0,
5382+ 0.0,
5383+ 0.0,
5384+ 0.0,
5385+ 0.0,
5386+ 0.0,
5387+ 0.0,
5388+ 0.0,
5389+ 0.0,
5390+ 0.0,
5391+ 0.0,
5392+ 0.0,
5393+ 0.0,
5394+ 0.0,
5395+ 0.0,
5396+ 0.0,
5397+ 0.0,
5398+ 0.0,
5399+ 0.0,
5400+ 0.0,
5401+ 0.0
5402+ ]
5403+ },
5404+ "ctl_replace_donor_zeroshot|ridge|L2": {
5405+ "accuracy": 0.0,
5406+ "gain_vs_zero": {
5407+ "estimate": 0.0,
5408+ "low": 0.0,
5409+ "high": 0.0,
5410+ "level": 0.95,
5411+ "n_items": 40,
5412+ "n_clusters": 40,
5413+ "n_boot": 2000
5414+ },
5415+ "outputs_sample": [
5416+ " 10000",
5417+ " The word \"zonofab",
5418+ " \"vofisu\"\n",
5419+ " The word \"tuken\"",
5420+ " The word \"zute\""
5421+ ],
5422+ "correct": [
5423+ 0.0,
5424+ 0.0,
5425+ 0.0,
5426+ 0.0,
5427+ 0.0,
5428+ 0.0,
5429+ 0.0,
5430+ 0.0,
5431+ 0.0,
5432+ 0.0,
5433+ 0.0,
5434+ 0.0,
5435+ 0.0,
5436+ 0.0,
5437+ 0.0,
5438+ 0.0,
5439+ 0.0,
5440+ 0.0,
5441+ 0.0,
5442+ 0.0,
5443+ 0.0,
5444+ 0.0,
5445+ 0.0,
5446+ 0.0,
5447+ 0.0,
5448+ 0.0,
5449+ 0.0,
5450+ 0.0,
5451+ 0.0,
5452+ 0.0,
5453+ 0.0,
5454+ 0.0,
5455+ 0.0,
5456+ 0.0,
5457+ 0.0,
5458+ 0.0,
5459+ 0.0,
5460+ 0.0,
5461+ 0.0,
5462+ 0.0
5463+ ]
5464+ },
5465+ "ctl_replace_donor_fewshot_shuffled_query|ridge|L2": {
5466+ "accuracy": 0.0,
5467+ "gain_vs_zero": {
5468+ "estimate": 0.0,
5469+ "low": 0.0,
5470+ "high": 0.0,
5471+ "level": 0.95,
5472+ "n_items": 40,
5473+ "n_clusters": 40,
5474+ "n_boot": 2000
5475+ },
5476+ "outputs_sample": [
5477+ " 10000",
5478+ " The word \"zonofab",
5479+ " \"vofisu\"\n",
5480+ " 10000",
5481+ " \"zute\" is a"
5482+ ],
5483+ "correct": [
5484+ 0.0,
5485+ 0.0,
5486+ 0.0,
5487+ 0.0,
5488+ 0.0,
5489+ 0.0,
5490+ 0.0,
5491+ 0.0,
5492+ 0.0,
5493+ 0.0,
5494+ 0.0,
5495+ 0.0,
5496+ 0.0,
5497+ 0.0,
5498+ 0.0,
5499+ 0.0,
5500+ 0.0,
5501+ 0.0,
5502+ 0.0,
5503+ 0.0,
5504+ 0.0,
5505+ 0.0,
5506+ 0.0,
5507+ 0.0,
5508+ 0.0,
5509+ 0.0,
5510+ 0.0,
5511+ 0.0,
5512+ 0.0,
5513+ 0.0,
5514+ 0.0,
5515+ 0.0,
5516+ 0.0,
5517+ 0.0,
5518+ 0.0,
5519+ 0.0,
5520+ 0.0,
5521+ 0.0,
5522+ 0.0,
5523+ 0.0
5524+ ]
5525+ },
5526+ "ctl_replace_donor_fewshot|sham_map|L2": {
5527+ "accuracy": 0.0,
5528+ "gain_vs_zero": {
5529+ "estimate": 0.0,
5530+ "low": 0.0,
5531+ "high": 0.0,
5532+ "level": 0.95,
5533+ "n_items": 40,
5534+ "n_clusters": 40,
5535+ "n_boot": 2000
5536+ },
5537+ "outputs_sample": [
5538+ " 10000",
5539+ " The word \"zonofab",
5540+ " 1\n",
5541+ " 10000",
5542+ " \"zute\" is a"
5543+ ],
5544+ "correct": [
5545+ 0.0,
5546+ 0.0,
5547+ 0.0,
5548+ 0.0,
5549+ 0.0,
5550+ 0.0,
5551+ 0.0,
5552+ 0.0,
5553+ 0.0,
5554+ 0.0,
5555+ 0.0,
5556+ 0.0,
5557+ 0.0,
5558+ 0.0,
5559+ 0.0,
5560+ 0.0,
5561+ 0.0,
5562+ 0.0,
5563+ 0.0,
5564+ 0.0,
5565+ 0.0,
5566+ 0.0,
5567+ 0.0,
5568+ 0.0,
5569+ 0.0,
5570+ 0.0,
5571+ 0.0,
5572+ 0.0,
5573+ 0.0,
5574+ 0.0,
5575+ 0.0,
5576+ 0.0,
5577+ 0.0,
5578+ 0.0,
5579+ 0.0,
5580+ 0.0,
5581+ 0.0,
5582+ 0.0,
5583+ 0.0,
5584+ 0.0
5585+ ]
5586+ },
5587+ "ctl_replace_donor_zeroshot|sham_map|L2": {
5588+ "accuracy": 0.0,
5589+ "gain_vs_zero": {
5590+ "estimate": 0.0,
5591+ "low": 0.0,
5592+ "high": 0.0,
5593+ "level": 0.95,
5594+ "n_items": 40,
5595+ "n_clusters": 40,
5596+ "n_boot": 2000
5597+ },
5598+ "outputs_sample": [
5599+ " 10000",
5600+ " The word \"zonofab",
5601+ " 1\n",
5602+ " 1\n\n",
5603+ " The word \"zute\""
5604+ ],
5605+ "correct": [
5606+ 0.0,
5607+ 0.0,
5608+ 0.0,
5609+ 0.0,
5610+ 0.0,
5611+ 0.0,
5612+ 0.0,
5613+ 0.0,
5614+ 0.0,
5615+ 0.0,
5616+ 0.0,
5617+ 0.0,
5618+ 0.0,
5619+ 0.0,
5620+ 0.0,
5621+ 0.0,
5622+ 0.0,
5623+ 0.0,
5624+ 0.0,
5625+ 0.0,
5626+ 0.0,
5627+ 0.0,
5628+ 0.0,
5629+ 0.0,
5630+ 0.0,
5631+ 0.0,
5632+ 0.0,
5633+ 0.0,
5634+ 0.0,
5635+ 0.0,
5636+ 0.0,
5637+ 0.0,
5638+ 0.0,
5639+ 0.0,
5640+ 0.0,
5641+ 0.0,
5642+ 0.0,
5643+ 0.0,
5644+ 0.0,
5645+ 0.0
5646+ ]
5647+ },
5648+ "ctl_replace_donor_fewshot_shuffled_query|sham_map|L2": {
5649+ "accuracy": 0.0,
5650+ "gain_vs_zero": {
5651+ "estimate": 0.0,
5652+ "low": 0.0,
5653+ "high": 0.0,
5654+ "level": 0.95,
5655+ "n_items": 40,
5656+ "n_clusters": 40,
5657+ "n_boot": 2000
5658+ },
5659+ "outputs_sample": [
5660+ " 10000",
5661+ " The word \"zonofab",
5662+ " 1\n",
5663+ " \"tukenten\"\n\n",
5664+ " \"zute\" is a"
5665+ ],
5666+ "correct": [
5667+ 0.0,
5668+ 0.0,
5669+ 0.0,
5670+ 0.0,
5671+ 0.0,
5672+ 0.0,
5673+ 0.0,
5674+ 0.0,
5675+ 0.0,
5676+ 0.0,
5677+ 0.0,
5678+ 0.0,
5679+ 0.0,
5680+ 0.0,
5681+ 0.0,
5682+ 0.0,
5683+ 0.0,
5684+ 0.0,
5685+ 0.0,
5686+ 0.0,
5687+ 0.0,
5688+ 0.0,
5689+ 0.0,
5690+ 0.0,
5691+ 0.0,
5692+ 0.0,
5693+ 0.0,
5694+ 0.0,
5695+ 0.0,
5696+ 0.0,
5697+ 0.0,
5698+ 0.0,
5699+ 0.0,
5700+ 0.0,
5701+ 0.0,
5702+ 0.0,
5703+ 0.0,
5704+ 0.0,
5705+ 0.0,
5706+ 0.0
5707+ ]
5708+ },
5709+ "ctl_random_norm_matched|L2": {
5710+ "accuracy": 0.0,
5711+ "gain_vs_zero": {
5712+ "estimate": 0.0,
5713+ "low": 0.0,
5714+ "high": 0.0,
5715+ "level": 0.95,
5716+ "n_items": 40,
5717+ "n_clusters": 40,
5718+ "n_boot": 2000
5719+ },
5720+ "correct": [
5721+ 0.0,
5722+ 0.0,
5723+ 0.0,
5724+ 0.0,
5725+ 0.0,
5726+ 0.0,
5727+ 0.0,
5728+ 0.0,
5729+ 0.0,
5730+ 0.0,
5731+ 0.0,
5732+ 0.0,
5733+ 0.0,
5734+ 0.0,
5735+ 0.0,
5736+ 0.0,
5737+ 0.0,
5738+ 0.0,
5739+ 0.0,
5740+ 0.0,
5741+ 0.0,
5742+ 0.0,
5743+ 0.0,
5744+ 0.0,
5745+ 0.0,
5746+ 0.0,
5747+ 0.0,
5748+ 0.0,
5749+ 0.0,
5750+ 0.0,
5751+ 0.0,
5752+ 0.0,
5753+ 0.0,
5754+ 0.0,
5755+ 0.0,
5756+ 0.0,
5757+ 0.0,
5758+ 0.0,
5759+ 0.0,
5760+ 0.0
5761+ ]
5762+ },
5763+ "ctl_unrelated_task_vector(antonym)|L2": {
5764+ "accuracy": 0.0,
5765+ "gain_vs_zero": {
5766+ "estimate": 0.0,
5767+ "low": 0.0,
5768+ "high": 0.0,
5769+ "level": 0.95,
5770+ "n_items": 40,
5771+ "n_clusters": 40,
5772+ "n_boot": 2000
5773+ },
5774+ "correct": [
5775+ 0.0,
5776+ 0.0,
5777+ 0.0,
5778+ 0.0,
5779+ 0.0,
5780+ 0.0,
5781+ 0.0,
5782+ 0.0,
5783+ 0.0,
5784+ 0.0,
5785+ 0.0,
5786+ 0.0,
5787+ 0.0,
5788+ 0.0,
5789+ 0.0,
5790+ 0.0,
5791+ 0.0,
5792+ 0.0,
5793+ 0.0,
5794+ 0.0,
5795+ 0.0,
5796+ 0.0,
5797+ 0.0,
5798+ 0.0,
5799+ 0.0,
5800+ 0.0,
5801+ 0.0,
5802+ 0.0,
5803+ 0.0,
5804+ 0.0,
5805+ 0.0,
5806+ 0.0,
5807+ 0.0,
5808+ 0.0,
5809+ 0.0,
5810+ 0.0,
5811+ 0.0,
5812+ 0.0,
5813+ 0.0,
5814+ 0.0
5815+ ]
5816+ }
5817+ },
5818+ "items": {
5819+ "zero": [
5820+ 0.0,
5821+ 0.0,
5822+ 0.0,
5823+ 0.0,
5824+ 0.0,
5825+ 0.0,
5826+ 0.0,
5827+ 0.0,
5828+ 0.0,
5829+ 0.0,
5830+ 0.0,
5831+ 0.0,
5832+ 0.0,
5833+ 0.0,
5834+ 0.0,
5835+ 0.0,
5836+ 0.0,
5837+ 0.0,
5838+ 0.0,
5839+ 0.0,
5840+ 0.0,
5841+ 0.0,
5842+ 0.0,
5843+ 0.0,
5844+ 0.0,
5845+ 0.0,
5846+ 0.0,
5847+ 0.0,
5848+ 0.0,
5849+ 0.0,
5850+ 0.0,
5851+ 0.0,
5852+ 0.0,
5853+ 0.0,
5854+ 0.0,
5855+ 0.0,
5856+ 0.0,
5857+ 0.0,
5858+ 0.0,
5859+ 0.0
5860+ ],
5861+ "few": [
5862+ 0.0,
5863+ 1.0,
5864+ 0.0,
5865+ 0.0,
5866+ 0.0,
5867+ 1.0,
5868+ 1.0,
5869+ 0.0,
5870+ 0.0,
5871+ 0.0,
5872+ 1.0,
5873+ 1.0,
5874+ 0.0,
5875+ 0.0,
5876+ 1.0,
5877+ 0.0,
5878+ 0.0,
5879+ 0.0,
5880+ 0.0,
5881+ 0.0,
5882+ 0.0,
5883+ 1.0,
5884+ 0.0,
5885+ 1.0,
5886+ 0.0,
5887+ 0.0,
5888+ 0.0,
5889+ 0.0,
5890+ 0.0,
5891+ 1.0,
5892+ 0.0,
5893+ 1.0,
5894+ 0.0,
5895+ 0.0,
5896+ 0.0,
5897+ 0.0,
5898+ 0.0,
5899+ 1.0,
5900+ 0.0,
5901+ 1.0
5902+ ],
5903+ "own": [
5904+ 0.0,
5905+ 0.0,
5906+ 0.0,
5907+ 0.0,
5908+ 0.0,
5909+ 0.0,
5910+ 0.0,
5911+ 0.0,
5912+ 0.0,
5913+ 0.0,
5914+ 0.0,
5915+ 0.0,
5916+ 0.0,
5917+ 0.0,
5918+ 0.0,
5919+ 0.0,
5920+ 0.0,
5921+ 0.0,
5922+ 0.0,
5923+ 0.0,
5924+ 0.0,
5925+ 0.0,
5926+ 0.0,
5927+ 0.0,
5928+ 0.0,
5929+ 0.0,
5930+ 0.0,
5931+ 0.0,
5932+ 0.0,
5933+ 0.0,
5934+ 0.0,
5935+ 0.0,
5936+ 0.0,
5937+ 0.0,
5938+ 0.0,
5939+ 0.0,
5940+ 0.0,
5941+ 0.0,
5942+ 0.0,
5943+ 0.0
5944+ ]
5945+ }
5946+ },
5947+ "addthree": {
5948+ "recipient_zero": 0.0,
5949+ "recipient_few": 0.8571428571428571,
5950+ "recipient_own_vector": 0.0,
5951+ "donor_layer": 2,
5952+ "conditions": {
5953+ "procrustes|L2|a1.0": {
5954+ "accuracy": 0.0,
5955+ "gain_vs_zero": {
5956+ "estimate": 0.0,
5957+ "low": 0.0,
5958+ "high": 0.0,
5959+ "level": 0.95,
5960+ "n_items": 35,
5961+ "n_clusters": 35,
5962+ "n_boot": 2000
5963+ },
5964+ "mapped_norm": 10.94498348236084,
5965+ "outputs_sample": [
5966+ " 7\n",
5967+ " \"Fizz\"\n\n",
5968+ " \"Fizz\"\n\n",
5969+ " \"19\"\n",
5970+ " 11\n"
5971+ ],
5972+ "correct": [
5973+ 0.0,
5974+ 0.0,
5975+ 0.0,
5976+ 0.0,
5977+ 0.0,
5978+ 0.0,
5979+ 0.0,
5980+ 0.0,
5981+ 0.0,
5982+ 0.0,
5983+ 0.0,
5984+ 0.0,
5985+ 0.0,
5986+ 0.0,
5987+ 0.0,
5988+ 0.0,
5989+ 0.0,
5990+ 0.0,
5991+ 0.0,
5992+ 0.0,
5993+ 0.0,
5994+ 0.0,
5995+ 0.0,
5996+ 0.0,
5997+ 0.0,
5998+ 0.0,
5999+ 0.0,
6000+ 0.0,
6001+ 0.0,
6002+ 0.0,
6003+ 0.0,
6004+ 0.0,
6005+ 0.0,
6006+ 0.0,
6007+ 0.0
6008+ ]
6009+ },
6010+ "procrustes|L2|a2.0": {
6011+ "accuracy": 0.0,
6012+ "gain_vs_zero": {
6013+ "estimate": 0.0,
6014+ "low": 0.0,
6015+ "high": 0.0,
6016+ "level": 0.95,
6017+ "n_items": 35,
6018+ "n_clusters": 35,
6019+ "n_boot": 2000
6020+ },
6021+ "mapped_norm": 10.94498348236084,
6022+ "outputs_sample": [
6023+ " 7\n",
6024+ " 12\n",
6025+ " 1\n",
6026+ " 10\n",
6027+ " 11\n"
6028+ ],
6029+ "correct": [
6030+ 0.0,
6031+ 0.0,
6032+ 0.0,
6033+ 0.0,
6034+ 0.0,
6035+ 0.0,
6036+ 0.0,
6037+ 0.0,
6038+ 0.0,
6039+ 0.0,
6040+ 0.0,
6041+ 0.0,
6042+ 0.0,
6043+ 0.0,
6044+ 0.0,
6045+ 0.0,
6046+ 0.0,
6047+ 0.0,
6048+ 0.0,
6049+ 0.0,
6050+ 0.0,
6051+ 0.0,
6052+ 0.0,
6053+ 0.0,
6054+ 0.0,
6055+ 0.0,
6056+ 0.0,
6057+ 0.0,
6058+ 0.0,
6059+ 0.0,
6060+ 0.0,
6061+ 0.0,
6062+ 0.0,
6063+ 0.0,
6064+ 0.0
6065+ ]
6066+ },
6067+ "procrustes_rescaled|L2|a1.0": {
6068+ "accuracy": 0.0,
6069+ "gain_vs_zero": {
6070+ "estimate": 0.0,
6071+ "low": 0.0,
6072+ "high": 0.0,
6073+ "level": 0.95,
6074+ "n_items": 35,
6075+ "n_clusters": 35,
6076+ "n_boot": 2000
6077+ },
6078+ "mapped_norm": 12.514004707336426,
6079+ "outputs_sample": [
6080+ " 7\n",
6081+ " \"Fizz\"\n\n",
6082+ " \"Fizz\"\n\n",
6083+ " \"19\"\n",
6084+ " 11\n"
6085+ ],
6086+ "correct": [
6087+ 0.0,
6088+ 0.0,
6089+ 0.0,
6090+ 0.0,
6091+ 0.0,
6092+ 0.0,
6093+ 0.0,
6094+ 0.0,
6095+ 0.0,
6096+ 0.0,
6097+ 0.0,
6098+ 0.0,
6099+ 0.0,
6100+ 0.0,
6101+ 0.0,
6102+ 0.0,
6103+ 0.0,
6104+ 0.0,
6105+ 0.0,
6106+ 0.0,
6107+ 0.0,
6108+ 0.0,
6109+ 0.0,
6110+ 0.0,
6111+ 0.0,
6112+ 0.0,
6113+ 0.0,
6114+ 0.0,
6115+ 0.0,
6116+ 0.0,
6117+ 0.0,
6118+ 0.0,
6119+ 0.0,
6120+ 0.0,
6121+ 0.0
6122+ ]
6123+ },
6124+ "ridge|L2|a1.0": {
6125+ "accuracy": 0.0,
6126+ "gain_vs_zero": {
6127+ "estimate": 0.0,
6128+ "low": 0.0,
6129+ "high": 0.0,
6130+ "level": 0.95,
6131+ "n_items": 35,
6132+ "n_clusters": 35,
6133+ "n_boot": 2000
6134+ },
6135+ "mapped_norm": 11.700227737426758,
6136+ "outputs_sample": [
6137+ " 7\n",
6138+ " 12\n",
6139+ " 1\n",
6140+ " \"19\"\n",
6141+ " 11\n"
6142+ ],
6143+ "correct": [
6144+ 0.0,
6145+ 0.0,
6146+ 0.0,
6147+ 0.0,
6148+ 0.0,
6149+ 0.0,
6150+ 0.0,
6151+ 0.0,
6152+ 0.0,
6153+ 0.0,
6154+ 0.0,
6155+ 0.0,
6156+ 0.0,
6157+ 0.0,
6158+ 0.0,
6159+ 0.0,
6160+ 0.0,
6161+ 0.0,
6162+ 0.0,
6163+ 0.0,
6164+ 0.0,
6165+ 0.0,
6166+ 0.0,
6167+ 0.0,
6168+ 0.0,
6169+ 0.0,
6170+ 0.0,
6171+ 0.0,
6172+ 0.0,
6173+ 0.0,
6174+ 0.0,
6175+ 0.0,
6176+ 0.0,
6177+ 0.0,
6178+ 0.0
6179+ ]
6180+ },
6181+ "ridge|L2|a2.0": {
6182+ "accuracy": 0.0,
6183+ "gain_vs_zero": {
6184+ "estimate": 0.0,
6185+ "low": 0.0,
6186+ "high": 0.0,
6187+ "level": 0.95,
6188+ "n_items": 35,
6189+ "n_clusters": 35,
6190+ "n_boot": 2000
6191+ },
6192+ "mapped_norm": 11.700227737426758,
6193+ "outputs_sample": [
6194+ " 7\n",
6195+ " 12\n",
6196+ " 1\n",
6197+ " 10\n",
6198+ " 11\n"
6199+ ],
6200+ "correct": [
6201+ 0.0,
6202+ 0.0,
6203+ 0.0,
6204+ 0.0,
6205+ 0.0,
6206+ 0.0,
6207+ 0.0,
6208+ 0.0,
6209+ 0.0,
6210+ 0.0,
6211+ 0.0,
6212+ 0.0,
6213+ 0.0,
6214+ 0.0,
6215+ 0.0,
6216+ 0.0,
6217+ 0.0,
6218+ 0.0,
6219+ 0.0,
6220+ 0.0,
6221+ 0.0,
6222+ 0.0,
6223+ 0.0,
6224+ 0.0,
6225+ 0.0,
6226+ 0.0,
6227+ 0.0,
6228+ 0.0,
6229+ 0.0,
6230+ 0.0,
6231+ 0.0,
6232+ 0.0,
6233+ 0.0,
6234+ 0.0,
6235+ 0.0
6236+ ]
6237+ },
6238+ "ridge_rescaled|L2|a1.0": {
6239+ "accuracy": 0.0,
6240+ "gain_vs_zero": {
6241+ "estimate": 0.0,
6242+ "low": 0.0,
6243+ "high": 0.0,
6244+ "level": 0.95,
6245+ "n_items": 35,
6246+ "n_clusters": 35,
6247+ "n_boot": 2000
6248+ },
6249+ "mapped_norm": 12.514006614685059,
6250+ "outputs_sample": [
6251+ " 7\n",
6252+ " 12\n",
6253+ " 1\n",
6254+ " 1\n",
6255+ " 11\n"
6256+ ],
6257+ "correct": [
6258+ 0.0,
6259+ 0.0,
6260+ 0.0,
6261+ 0.0,
6262+ 0.0,
6263+ 0.0,
6264+ 0.0,
6265+ 0.0,
6266+ 0.0,
6267+ 0.0,
6268+ 0.0,
6269+ 0.0,
6270+ 0.0,
6271+ 0.0,
6272+ 0.0,
6273+ 0.0,
6274+ 0.0,
6275+ 0.0,
6276+ 0.0,
6277+ 0.0,
6278+ 0.0,
6279+ 0.0,
6280+ 0.0,
6281+ 0.0,
6282+ 0.0,
6283+ 0.0,
6284+ 0.0,
6285+ 0.0,
6286+ 0.0,
6287+ 0.0,
6288+ 0.0,
6289+ 0.0,
6290+ 0.0,
6291+ 0.0,
6292+ 0.0
6293+ ]
6294+ },
6295+ "cca|L2|a1.0": {
6296+ "accuracy": 0.0,
6297+ "gain_vs_zero": {
6298+ "estimate": 0.0,
6299+ "low": 0.0,
6300+ "high": 0.0,
6301+ "level": 0.95,
6302+ "n_items": 35,
6303+ "n_clusters": 35,
6304+ "n_boot": 2000
6305+ },
6306+ "mapped_norm": 13.10649299621582,
6307+ "outputs_sample": [
6308+ " 7\n",
6309+ " 12\n",
6310+ " 1\n",
6311+ " 1\n",
6312+ " 11\n"
6313+ ],
6314+ "correct": [
6315+ 0.0,
6316+ 0.0,
6317+ 0.0,
6318+ 0.0,
6319+ 0.0,
6320+ 0.0,
6321+ 0.0,
6322+ 0.0,
6323+ 0.0,
6324+ 0.0,
6325+ 0.0,
6326+ 0.0,
6327+ 0.0,
6328+ 0.0,
6329+ 0.0,
6330+ 0.0,
6331+ 0.0,
6332+ 0.0,
6333+ 0.0,
6334+ 0.0,
6335+ 0.0,
6336+ 0.0,
6337+ 0.0,
6338+ 0.0,
6339+ 0.0,
6340+ 0.0,
6341+ 0.0,
6342+ 0.0,
6343+ 0.0,
6344+ 0.0,
6345+ 0.0,
6346+ 0.0,
6347+ 0.0,
6348+ 0.0,
6349+ 0.0
6350+ ]
6351+ },
6352+ "cca|L2|a2.0": {
6353+ "accuracy": 0.0,
6354+ "gain_vs_zero": {
6355+ "estimate": 0.0,
6356+ "low": 0.0,
6357+ "high": 0.0,
6358+ "level": 0.95,
6359+ "n_items": 35,
6360+ "n_clusters": 35,
6361+ "n_boot": 2000
6362+ },
6363+ "mapped_norm": 13.10649299621582,
6364+ "outputs_sample": [
6365+ " 7\n",
6366+ " 12\n",
6367+ " 1\n",
6368+ " 1\n",
6369+ " 11\n"
6370+ ],
6371+ "correct": [
6372+ 0.0,
6373+ 0.0,
6374+ 0.0,
6375+ 0.0,
6376+ 0.0,
6377+ 0.0,
6378+ 0.0,
6379+ 0.0,
6380+ 0.0,
6381+ 0.0,
6382+ 0.0,
6383+ 0.0,
6384+ 0.0,
6385+ 0.0,
6386+ 0.0,
6387+ 0.0,
6388+ 0.0,
6389+ 0.0,
6390+ 0.0,
6391+ 0.0,
6392+ 0.0,
6393+ 0.0,
6394+ 0.0,
6395+ 0.0,
6396+ 0.0,
6397+ 0.0,
6398+ 0.0,
6399+ 0.0,
6400+ 0.0,
6401+ 0.0,
6402+ 0.0,
6403+ 0.0,
6404+ 0.0,
6405+ 0.0,
6406+ 0.0
6407+ ]
6408+ },
6409+ "random_orth|L2|a1.0": {
6410+ "accuracy": 0.0,
6411+ "gain_vs_zero": {
6412+ "estimate": 0.0,
6413+ "low": 0.0,
6414+ "high": 0.0,
6415+ "level": 0.95,
6416+ "n_items": 35,
6417+ "n_clusters": 35,
6418+ "n_boot": 2000
6419+ },
6420+ "mapped_norm": 10.298331260681152,
6421+ "outputs_sample": [
6422+ " 7\n",
6423+ " \"Fizz\"\n\n",
6424+ " \"83\"\n",
6425+ " \"19\"\n",
6426+ " 11\n"
6427+ ],
6428+ "correct": [
6429+ 0.0,
6430+ 0.0,
6431+ 0.0,
6432+ 0.0,
6433+ 0.0,
6434+ 0.0,
6435+ 0.0,
6436+ 0.0,
6437+ 0.0,
6438+ 0.0,
6439+ 0.0,
6440+ 0.0,
6441+ 0.0,
6442+ 0.0,
6443+ 0.0,
6444+ 0.0,
6445+ 0.0,
6446+ 0.0,
6447+ 0.0,
6448+ 0.0,
6449+ 0.0,
6450+ 0.0,
6451+ 0.0,
6452+ 0.0,
6453+ 0.0,
6454+ 0.0,
6455+ 0.0,
6456+ 0.0,
6457+ 0.0,
6458+ 0.0,
6459+ 0.0,
6460+ 0.0,
6461+ 0.0,
6462+ 0.0,
6463+ 0.0
6464+ ]
6465+ },
6466+ "random_orth|L2|a2.0": {
6467+ "accuracy": 0.0,
6468+ "gain_vs_zero": {
6469+ "estimate": 0.0,
6470+ "low": 0.0,
6471+ "high": 0.0,
6472+ "level": 0.95,
6473+ "n_items": 35,
6474+ "n_clusters": 35,
6475+ "n_boot": 2000
6476+ },
6477+ "mapped_norm": 10.298331260681152,
6478+ "outputs_sample": [
6479+ " 7\n",
6480+ " 12\n",
6481+ " 1\n",
6482+ " 10\n",
6483+ " 11\n"
6484+ ],
6485+ "correct": [
6486+ 0.0,
6487+ 0.0,
6488+ 0.0,
6489+ 0.0,
6490+ 0.0,
6491+ 0.0,
6492+ 0.0,
6493+ 0.0,
6494+ 0.0,
6495+ 0.0,
6496+ 0.0,
6497+ 0.0,
6498+ 0.0,
6499+ 0.0,
6500+ 0.0,
6501+ 0.0,
6502+ 0.0,
6503+ 0.0,
6504+ 0.0,
6505+ 0.0,
6506+ 0.0,
6507+ 0.0,
6508+ 0.0,
6509+ 0.0,
6510+ 0.0,
6511+ 0.0,
6512+ 0.0,
6513+ 0.0,
6514+ 0.0,
6515+ 0.0,
6516+ 0.0,
6517+ 0.0,
6518+ 0.0,
6519+ 0.0,
6520+ 0.0
6521+ ]
6522+ },
6523+ "replace_donor_fewshot|procrustes|L2": {
6524+ "accuracy": 0.0,
6525+ "gain_vs_zero": {
6526+ "estimate": 0.0,
6527+ "low": 0.0,
6528+ "high": 0.0,
6529+ "level": 0.95,
6530+ "n_items": 35,
6531+ "n_clusters": 35,
6532+ "n_boot": 2000
6533+ },
6534+ "outputs_sample": [
6535+ " 7\n",
6536+ " \"Fizz\"\n\n",
6537+ " 1\n",
6538+ " \"19\"\n",
6539+ " 11\n"
6540+ ],
6541+ "correct": [
6542+ 0.0,
6543+ 0.0,
6544+ 0.0,
6545+ 0.0,
6546+ 0.0,
6547+ 0.0,
6548+ 0.0,
6549+ 0.0,
6550+ 0.0,
6551+ 0.0,
6552+ 0.0,
6553+ 0.0,
6554+ 0.0,
6555+ 0.0,
6556+ 0.0,
6557+ 0.0,
6558+ 0.0,
6559+ 0.0,
6560+ 0.0,
6561+ 0.0,
6562+ 0.0,
6563+ 0.0,
6564+ 0.0,
6565+ 0.0,
6566+ 0.0,
6567+ 0.0,
6568+ 0.0,
6569+ 0.0,
6570+ 0.0,
6571+ 0.0,
6572+ 0.0,
6573+ 0.0,
6574+ 0.0,
6575+ 0.0,
6576+ 0.0
6577+ ]
6578+ },
6579+ "ctl_replace_donor_zeroshot|procrustes|L2": {
6580+ "accuracy": 0.0,
6581+ "gain_vs_zero": {
6582+ "estimate": 0.0,
6583+ "low": 0.0,
6584+ "high": 0.0,
6585+ "level": 0.95,
6586+ "n_items": 35,
6587+ "n_clusters": 35,
6588+ "n_boot": 2000
6589+ },
6590+ "outputs_sample": [
6591+ " 7\n",
6592+ " \"Fizz\"\n\n",
6593+ " \"Fizz\"\n\n",
6594+ " \"19\"\n",
6595+ " 11\n"
6596+ ],
6597+ "correct": [
6598+ 0.0,
6599+ 0.0,
6600+ 0.0,
6601+ 0.0,
6602+ 0.0,
6603+ 0.0,
6604+ 0.0,
6605+ 0.0,
6606+ 0.0,
6607+ 0.0,
6608+ 0.0,
6609+ 0.0,
6610+ 0.0,
6611+ 0.0,
6612+ 0.0,
6613+ 0.0,
6614+ 0.0,
6615+ 0.0,
6616+ 0.0,
6617+ 0.0,
6618+ 0.0,
6619+ 0.0,
6620+ 0.0,
6621+ 0.0,
6622+ 0.0,
6623+ 0.0,
6624+ 0.0,
6625+ 0.0,
6626+ 0.0,
6627+ 0.0,
6628+ 0.0,
6629+ 0.0,
6630+ 0.0,
6631+ 0.0,
6632+ 0.0
6633+ ]
6634+ },
6635+ "ctl_replace_donor_fewshot_shuffled_query|procrustes|L2": {
6636+ "accuracy": 0.0,
6637+ "gain_vs_zero": {
6638+ "estimate": 0.0,
6639+ "low": 0.0,
6640+ "high": 0.0,
6641+ "level": 0.95,
6642+ "n_items": 35,
6643+ "n_clusters": 35,
6644+ "n_boot": 2000
6645+ },
6646+ "outputs_sample": [
6647+ " 7\n",
6648+ " \"Fizz\"\n\n",
6649+ " 1\n",
6650+ " \"19\"\n",
6651+ " 11\n"
6652+ ],
6653+ "correct": [
6654+ 0.0,
6655+ 0.0,
6656+ 0.0,
6657+ 0.0,
6658+ 0.0,
6659+ 0.0,
6660+ 0.0,
6661+ 0.0,
6662+ 0.0,
6663+ 0.0,
6664+ 0.0,
6665+ 0.0,
6666+ 0.0,
6667+ 0.0,
6668+ 0.0,
6669+ 0.0,
6670+ 0.0,
6671+ 0.0,
6672+ 0.0,
6673+ 0.0,
6674+ 0.0,
6675+ 0.0,
6676+ 0.0,
6677+ 0.0,
6678+ 0.0,
6679+ 0.0,
6680+ 0.0,
6681+ 0.0,
6682+ 0.0,
6683+ 0.0,
6684+ 0.0,
6685+ 0.0,
6686+ 0.0,
6687+ 0.0,
6688+ 0.0
6689+ ]
6690+ },
6691+ "replace_donor_fewshot|ridge|L2": {
6692+ "accuracy": 0.0,
6693+ "gain_vs_zero": {
6694+ "estimate": 0.0,
6695+ "low": 0.0,
6696+ "high": 0.0,
6697+ "level": 0.95,
6698+ "n_items": 35,
6699+ "n_clusters": 35,
6700+ "n_boot": 2000
6701+ },
6702+ "outputs_sample": [
6703+ " 7\n",
6704+ " 12\n",
6705+ " 1\n",
6706+ " 10\n",
6707+ " 11\n"
6708+ ],
6709+ "correct": [
6710+ 0.0,
6711+ 0.0,
6712+ 0.0,
6713+ 0.0,
6714+ 0.0,
6715+ 0.0,
6716+ 0.0,
6717+ 0.0,
6718+ 0.0,
6719+ 0.0,
6720+ 0.0,
6721+ 0.0,
6722+ 0.0,
6723+ 0.0,
6724+ 0.0,
6725+ 0.0,
6726+ 0.0,
6727+ 0.0,
6728+ 0.0,
6729+ 0.0,
6730+ 0.0,
6731+ 0.0,
6732+ 0.0,
6733+ 0.0,
6734+ 0.0,
6735+ 0.0,
6736+ 0.0,
6737+ 0.0,
6738+ 0.0,
6739+ 0.0,
6740+ 0.0,
6741+ 0.0,
6742+ 0.0,
6743+ 0.0,
6744+ 0.0
6745+ ]
6746+ },
6747+ "ctl_replace_donor_zeroshot|ridge|L2": {
6748+ "accuracy": 0.0,
6749+ "gain_vs_zero": {
6750+ "estimate": 0.0,
6751+ "low": 0.0,
6752+ "high": 0.0,
6753+ "level": 0.95,
6754+ "n_items": 35,
6755+ "n_clusters": 35,
6756+ "n_boot": 2000
6757+ },
6758+ "outputs_sample": [
6759+ " 7\n",
6760+ " \"Fizz\"\n\n",
6761+ " \"Fizz\"\n\n",
6762+ " \"19\"\n",
6763+ " 11\n"
6764+ ],
6765+ "correct": [
6766+ 0.0,
6767+ 0.0,
6768+ 0.0,
6769+ 0.0,
6770+ 0.0,
6771+ 0.0,
6772+ 0.0,
6773+ 0.0,
6774+ 0.0,
6775+ 0.0,
6776+ 0.0,
6777+ 0.0,
6778+ 0.0,
6779+ 0.0,
6780+ 0.0,
6781+ 0.0,
6782+ 0.0,
6783+ 0.0,
6784+ 0.0,
6785+ 0.0,
6786+ 0.0,
6787+ 0.0,
6788+ 0.0,
6789+ 0.0,
6790+ 0.0,
6791+ 0.0,
6792+ 0.0,
6793+ 0.0,
6794+ 0.0,
6795+ 0.0,
6796+ 0.0,
6797+ 0.0,
6798+ 0.0,
6799+ 0.0,
6800+ 0.0
6801+ ]
6802+ },
6803+ "ctl_replace_donor_fewshot_shuffled_query|ridge|L2": {
6804+ "accuracy": 0.0,
6805+ "gain_vs_zero": {
6806+ "estimate": 0.0,
6807+ "low": 0.0,
6808+ "high": 0.0,
6809+ "level": 0.95,
6810+ "n_items": 35,
6811+ "n_clusters": 35,
6812+ "n_boot": 2000
6813+ },
6814+ "outputs_sample": [
6815+ " 7\n",
6816+ " 12\n",
6817+ " 1\n",
6818+ " 10\n",
6819+ " 11\n"
6820+ ],
6821+ "correct": [
6822+ 0.0,
6823+ 0.0,
6824+ 0.0,
6825+ 0.0,
6826+ 0.0,
6827+ 0.0,
6828+ 0.0,
6829+ 0.0,
6830+ 0.0,
6831+ 0.0,
6832+ 0.0,
6833+ 0.0,
6834+ 0.0,
6835+ 0.0,
6836+ 0.0,
6837+ 0.0,
6838+ 0.0,
6839+ 0.0,
6840+ 0.0,
6841+ 0.0,
6842+ 0.0,
6843+ 0.0,
6844+ 0.0,
6845+ 0.0,
6846+ 0.0,
6847+ 0.0,
6848+ 0.0,
6849+ 0.0,
6850+ 0.0,
6851+ 0.0,
6852+ 0.0,
6853+ 0.0,
6854+ 0.0,
6855+ 0.0,
6856+ 0.0
6857+ ]
6858+ },
6859+ "ctl_replace_donor_fewshot|sham_map|L2": {
6860+ "accuracy": 0.0,
6861+ "gain_vs_zero": {
6862+ "estimate": 0.0,
6863+ "low": 0.0,
6864+ "high": 0.0,
6865+ "level": 0.95,
6866+ "n_items": 35,
6867+ "n_clusters": 35,
6868+ "n_boot": 2000
6869+ },
6870+ "outputs_sample": [
6871+ " 7\n",
6872+ " 12\n",
6873+ " 1\n",
6874+ " 10\n\n",
6875+ " 11\n"
6876+ ],
6877+ "correct": [
6878+ 0.0,
6879+ 0.0,
6880+ 0.0,
6881+ 0.0,
6882+ 0.0,
6883+ 0.0,
6884+ 0.0,
6885+ 0.0,
6886+ 0.0,
6887+ 0.0,
6888+ 0.0,
6889+ 0.0,
6890+ 0.0,
6891+ 0.0,
6892+ 0.0,
6893+ 0.0,
6894+ 0.0,
6895+ 0.0,
6896+ 0.0,
6897+ 0.0,
6898+ 0.0,
6899+ 0.0,
6900+ 0.0,
6901+ 0.0,
6902+ 0.0,
6903+ 0.0,
6904+ 0.0,
6905+ 0.0,
6906+ 0.0,
6907+ 0.0,
6908+ 0.0,
6909+ 0.0,
6910+ 0.0,
6911+ 0.0,
6912+ 0.0
6913+ ]
6914+ },
6915+ "ctl_replace_donor_zeroshot|sham_map|L2": {
6916+ "accuracy": 0.0,
6917+ "gain_vs_zero": {
6918+ "estimate": 0.0,
6919+ "low": 0.0,
6920+ "high": 0.0,
6921+ "level": 0.95,
6922+ "n_items": 35,
6923+ "n_clusters": 35,
6924+ "n_boot": 2000
6925+ },
6926+ "outputs_sample": [
6927+ " 7\n",
6928+ " 12\n",
6929+ " 11111",
6930+ " 10111",
6931+ " 11111"
6932+ ],
6933+ "correct": [
6934+ 0.0,
6935+ 0.0,
6936+ 0.0,
6937+ 0.0,
6938+ 0.0,
6939+ 0.0,
6940+ 0.0,
6941+ 0.0,
6942+ 0.0,
6943+ 0.0,
6944+ 0.0,
6945+ 0.0,
6946+ 0.0,
6947+ 0.0,
6948+ 0.0,
6949+ 0.0,
6950+ 0.0,
6951+ 0.0,
6952+ 0.0,
6953+ 0.0,
6954+ 0.0,
6955+ 0.0,
6956+ 0.0,
6957+ 0.0,
6958+ 0.0,
6959+ 0.0,
6960+ 0.0,
6961+ 0.0,
6962+ 0.0,
6963+ 0.0,
6964+ 0.0,
6965+ 0.0,
6966+ 0.0,
6967+ 0.0,
6968+ 0.0
6969+ ]
6970+ },
6971+ "ctl_replace_donor_fewshot_shuffled_query|sham_map|L2": {
6972+ "accuracy": 0.0,
6973+ "gain_vs_zero": {
6974+ "estimate": 0.0,
6975+ "low": 0.0,
6976+ "high": 0.0,
6977+ "level": 0.95,
6978+ "n_items": 35,
6979+ "n_clusters": 35,
6980+ "n_boot": 2000
6981+ },
6982+ "outputs_sample": [
6983+ " 7\n",
6984+ " 12\n",
6985+ " 11111",
6986+ " 10\n\n",
6987+ " 11\n"
6988+ ],
6989+ "correct": [
6990+ 0.0,
6991+ 0.0,
6992+ 0.0,
6993+ 0.0,
6994+ 0.0,
6995+ 0.0,
6996+ 0.0,
6997+ 0.0,
6998+ 0.0,
6999+ 0.0,
7000+ 0.0,
7001+ 0.0,
7002+ 0.0,
7003+ 0.0,
7004+ 0.0,
7005+ 0.0,
7006+ 0.0,
7007+ 0.0,
7008+ 0.0,
7009+ 0.0,
7010+ 0.0,
7011+ 0.0,
7012+ 0.0,
7013+ 0.0,
7014+ 0.0,
7015+ 0.0,
7016+ 0.0,
7017+ 0.0,
7018+ 0.0,
7019+ 0.0,
7020+ 0.0,
7021+ 0.0,
7022+ 0.0,
7023+ 0.0,
7024+ 0.0
7025+ ]
7026+ },
7027+ "ctl_random_norm_matched|L2": {
7028+ "accuracy": 0.0,
7029+ "gain_vs_zero": {
7030+ "estimate": 0.0,
7031+ "low": 0.0,
7032+ "high": 0.0,
7033+ "level": 0.95,
7034+ "n_items": 35,
7035+ "n_clusters": 35,
7036+ "n_boot": 2000
7037+ },
7038+ "correct": [
7039+ 0.0,
7040+ 0.0,
7041+ 0.0,
7042+ 0.0,
7043+ 0.0,
7044+ 0.0,
7045+ 0.0,
7046+ 0.0,
7047+ 0.0,
7048+ 0.0,
7049+ 0.0,
7050+ 0.0,
7051+ 0.0,
7052+ 0.0,
7053+ 0.0,
7054+ 0.0,
7055+ 0.0,
7056+ 0.0,
7057+ 0.0,
7058+ 0.0,
7059+ 0.0,
7060+ 0.0,
7061+ 0.0,
7062+ 0.0,
7063+ 0.0,
7064+ 0.0,
7065+ 0.0,
7066+ 0.0,
7067+ 0.0,
7068+ 0.0,
7069+ 0.0,
7070+ 0.0,
7071+ 0.0,
7072+ 0.0,
7073+ 0.0
7074+ ]
7075+ },
7076+ "ctl_unrelated_task_vector(antonym)|L2": {
7077+ "accuracy": 0.0,
7078+ "gain_vs_zero": {
7079+ "estimate": 0.0,
7080+ "low": 0.0,
7081+ "high": 0.0,
7082+ "level": 0.95,
7083+ "n_items": 35,
7084+ "n_clusters": 35,
7085+ "n_boot": 2000
7086+ },
7087+ "correct": [
7088+ 0.0,
7089+ 0.0,
7090+ 0.0,
7091+ 0.0,
7092+ 0.0,
7093+ 0.0,
7094+ 0.0,
7095+ 0.0,
7096+ 0.0,
7097+ 0.0,
7098+ 0.0,
7099+ 0.0,
7100+ 0.0,
7101+ 0.0,
7102+ 0.0,
7103+ 0.0,
7104+ 0.0,
7105+ 0.0,
7106+ 0.0,
7107+ 0.0,
7108+ 0.0,
7109+ 0.0,
7110+ 0.0,
7111+ 0.0,
7112+ 0.0,
7113+ 0.0,
7114+ 0.0,
7115+ 0.0,
7116+ 0.0,
7117+ 0.0,
7118+ 0.0,
7119+ 0.0,
7120+ 0.0,
7121+ 0.0,
7122+ 0.0
7123+ ]
7124+ }
7125+ },
7126+ "items": {
7127+ "zero": [
7128+ 0.0,
7129+ 0.0,
7130+ 0.0,
7131+ 0.0,
7132+ 0.0,
7133+ 0.0,
7134+ 0.0,
7135+ 0.0,
7136+ 0.0,
7137+ 0.0,
7138+ 0.0,
7139+ 0.0,
7140+ 0.0,
7141+ 0.0,
7142+ 0.0,
7143+ 0.0,
7144+ 0.0,
7145+ 0.0,
7146+ 0.0,
7147+ 0.0,
7148+ 0.0,
7149+ 0.0,
7150+ 0.0,
7151+ 0.0,
7152+ 0.0,
7153+ 0.0,
7154+ 0.0,
7155+ 0.0,
7156+ 0.0,
7157+ 0.0,
7158+ 0.0,
7159+ 0.0,
7160+ 0.0,
7161+ 0.0,
7162+ 0.0
7163+ ],
7164+ "few": [
7165+ 1.0,
7166+ 1.0,
7167+ 1.0,
7168+ 1.0,
7169+ 1.0,
7170+ 1.0,
7171+ 0.0,
7172+ 1.0,
7173+ 1.0,
7174+ 1.0,
7175+ 1.0,
7176+ 1.0,
7177+ 0.0,
7178+ 1.0,
7179+ 1.0,
7180+ 1.0,
7181+ 1.0,
7182+ 1.0,
7183+ 0.0,
7184+ 1.0,
7185+ 1.0,
7186+ 1.0,
7187+ 1.0,
7188+ 0.0,
7189+ 1.0,
7190+ 1.0,
7191+ 1.0,
7192+ 1.0,
7193+ 1.0,
7194+ 1.0,
7195+ 1.0,
7196+ 1.0,
7197+ 0.0,
7198+ 1.0,
7199+ 1.0
7200+ ],
7201+ "own": [
7202+ 0.0,
7203+ 0.0,
7204+ 0.0,
7205+ 0.0,
7206+ 0.0,
7207+ 0.0,
7208+ 0.0,
7209+ 0.0,
7210+ 0.0,
7211+ 0.0,
7212+ 0.0,
7213+ 0.0,
7214+ 0.0,
7215+ 0.0,
7216+ 0.0,
7217+ 0.0,
7218+ 0.0,
7219+ 0.0,
7220+ 0.0,
7221+ 0.0,
7222+ 0.0,
7223+ 0.0,
7224+ 0.0,
7225+ 0.0,
7226+ 0.0,
7227+ 0.0,
7228+ 0.0,
7229+ 0.0,
7230+ 0.0,
7231+ 0.0,
7232+ 0.0,
7233+ 0.0,
7234+ 0.0,
7235+ 0.0,
7236+ 0.0
7237+ ]
7238+ }
7239+ }
7240+ },
7241+ "maps": {
7242+ "antonym|L25->L16|procrustes": {
7243+ "r2_fit": 0.7789317263716866,
7244+ "r2_heldout": 0.5213518036301777,
7245+ "n_params": 3147264,
7246+ "n_fit": 700
7247+ },
7248+ "antonym|L25->L16|ridge": {
7249+ "r2_fit": 0.9953081671956826,
7250+ "r2_heldout": 0.5962281983489065,
7251+ "n_params": 3147264,
7252+ "n_fit": 700
7253+ },
7254+ "antonym|L25->L16|cca": {
7255+ "r2_fit": 1.0,
7256+ "r2_heldout": 0.47990349723620374,
7257+ "n_params": 3147264,
7258+ "n_fit": 700
7259+ },
7260+ "antonym|L25->L16|random_orth": {
7261+ "r2_fit": -0.7392699882347817,
7262+ "r2_heldout": -0.8256160248234292,
7263+ "n_params": 3147264,
7264+ "n_fit": 700
7265+ },
7266+ "antonym|L25->L19|procrustes": {
7267+ "r2_fit": 0.7671198318359469,
7268+ "r2_heldout": 0.5187313859710784,
7269+ "n_params": 3147264,
7270+ "n_fit": 700
7271+ },
7272+ "antonym|L25->L19|ridge": {
7273+ "r2_fit": 0.9953872622216102,
7274+ "r2_heldout": 0.5649946817921517,
7275+ "n_params": 3147264,
7276+ "n_fit": 700
7277+ },
7278+ "antonym|L25->L19|cca": {
7279+ "r2_fit": 1.0,
7280+ "r2_heldout": 0.4544442913335136,
7281+ "n_params": 3147264,
7282+ "n_fit": 700
7283+ },
7284+ "antonym|L25->L19|random_orth": {
7285+ "r2_fit": -0.7481952037384061,
7286+ "r2_heldout": -0.8097331316005054,
7287+ "n_params": 3147264,
7288+ "n_fit": 700
7289+ },
7290+ "capital|L25->L19|procrustes": {
7291+ "r2_fit": 0.7671198318359469,
7292+ "r2_heldout": 0.5187313859710784,
7293+ "n_params": 3147264,
7294+ "n_fit": 700
7295+ },
7296+ "capital|L25->L19|ridge": {
7297+ "r2_fit": 0.9953872622216102,
7298+ "r2_heldout": 0.5649946817921517,
7299+ "n_params": 3147264,
7300+ "n_fit": 700
7301+ },
7302+ "capital|L25->L19|cca": {
7303+ "r2_fit": 1.0,
7304+ "r2_heldout": 0.4544442913335136,
7305+ "n_params": 3147264,
7306+ "n_fit": 700
7307+ },
7308+ "capital|L25->L19|random_orth": {
7309+ "r2_fit": -0.7481952037384061,
7310+ "r2_heldout": -0.8097331316005054,
7311+ "n_params": 3147264,
7312+ "n_fit": 700
7313+ },
7314+ "capital|L25->L22|procrustes": {
7315+ "r2_fit": 0.6812579025365755,
7316+ "r2_heldout": 0.356227252008668,
7317+ "n_params": 3147264,
7318+ "n_fit": 700
7319+ },
7320+ "capital|L25->L22|ridge": {
7321+ "r2_fit": 0.9921556862460278,
7322+ "r2_heldout": 0.3182894155249444,
7323+ "n_params": 3147264,
7324+ "n_fit": 700
7325+ },
7326+ "capital|L25->L22|cca": {
7327+ "r2_fit": 1.0,
7328+ "r2_heldout": 0.14245856098406207,
7329+ "n_params": 3147264,
7330+ "n_fit": 700
7331+ },
7332+ "capital|L25->L22|random_orth": {
7333+ "r2_fit": -0.7592103384443982,
7334+ "r2_heldout": -0.7672547555750187,
7335+ "n_params": 3147264,
7336+ "n_fit": 700
7337+ },
7338+ "morph|L2->L2|procrustes": {
7339+ "r2_fit": 0.8768402669986404,
7340+ "r2_heldout": 0.8272530562101117,
7341+ "n_params": 3147264,
7342+ "n_fit": 700
7343+ },
7344+ "morph|L2->L2|ridge": {
7345+ "r2_fit": 0.9455517774891209,
7346+ "r2_heldout": 0.9229578754765076,
7347+ "n_params": 3147264,
7348+ "n_fit": 700
7349+ },
7350+ "morph|L2->L2|cca": {
7351+ "r2_fit": 1.0,
7352+ "r2_heldout": 0.9246851631237542,
7353+ "n_params": 3147264,
7354+ "n_fit": 700
7355+ },
7356+ "morph|L2->L2|random_orth": {
7357+ "r2_fit": -0.7696971836371103,
7358+ "r2_heldout": -0.8283611188222051,
7359+ "n_params": 3147264,
7360+ "n_fit": 700
7361+ },
7362+ "addthree|L2->L2|procrustes": {
7363+ "r2_fit": 0.8768402669986404,
7364+ "r2_heldout": 0.8272530562101117,
7365+ "n_params": 3147264,
7366+ "n_fit": 700
7367+ },
7368+ "addthree|L2->L2|ridge": {
7369+ "r2_fit": 0.9455517774891209,
7370+ "r2_heldout": 0.9229578754765076,
7371+ "n_params": 3147264,
7372+ "n_fit": 700
7373+ },
7374+ "addthree|L2->L2|cca": {
7375+ "r2_fit": 1.0,
7376+ "r2_heldout": 0.9246851631237542,
7377+ "n_params": 3147264,
7378+ "n_fit": 700
7379+ },
7380+ "addthree|L2->L2|random_orth": {
7381+ "r2_fit": -0.7696971836371103,
7382+ "r2_heldout": -0.8283611188222051,
7383+ "n_params": 3147264,
7384+ "n_fit": 700
7385+ }
7386+ },
7387+ "collateral": {
7388+ "antonym": {
7389+ "condition": "procrustes|L19|a1.0",
7390+ "heldout_nll_base": 2.119346046447754,
7391+ "heldout_nll_with_vector": 2.670026969909668,
7392+ "cross_task": {
7393+ "capital": {
7394+ "zero": 0.0,
7395+ "with_vector": 0.0
7396+ },
7397+ "morph": {
7398+ "zero": 0.0,
7399+ "with_vector": 0.0
7400+ },
7401+ "addthree": {
7402+ "zero": 0.0,
7403+ "with_vector": 0.0
7404+ }
7405+ }
7406+ },
7407+ "capital": {
7408+ "condition": "procrustes|L22|a2.0",
7409+ "heldout_nll_base": 2.119346046447754,
7410+ "heldout_nll_with_vector": 3.568995157877604,
7411+ "cross_task": {
7412+ "antonym": {
7413+ "zero": 0.1875,
7414+ "with_vector": 0.0625
7415+ },
7416+ "morph": {
7417+ "zero": 0.0,
7418+ "with_vector": 0.0
7419+ },
7420+ "addthree": {
7421+ "zero": 0.0,
7422+ "with_vector": 0.0
7423+ }
7424+ }
7425+ },
7426+ "morph": {
7427+ "condition": "procrustes|L2|a1.0",
7428+ "heldout_nll_base": 2.119346046447754,
7429+ "heldout_nll_with_vector": 2.1115839958190916,
7430+ "cross_task": {
7431+ "antonym": {
7432+ "zero": 0.1875,
7433+ "with_vector": 0.0625
7434+ },
7435+ "capital": {
7436+ "zero": 0.0,
7437+ "with_vector": 0.0
7438+ },
7439+ "addthree": {
7440+ "zero": 0.0,
7441+ "with_vector": 0.0
7442+ }
7443+ }
7444+ },
7445+ "addthree": {
7446+ "condition": "procrustes|L2|a1.0",
7447+ "heldout_nll_base": 2.119346046447754,
7448+ "heldout_nll_with_vector": 2.0965938250223797,
7449+ "cross_task": {
7450+ "antonym": {
7451+ "zero": 0.1875,
7452+ "with_vector": 0.0625
7453+ },
7454+ "capital": {
7455+ "zero": 0.0,
7456+ "with_vector": 0.0
7457+ },
7458+ "morph": {
7459+ "zero": 0.0,
7460+ "with_vector": 0.0
7461+ }
7462+ }
7463+ }
7464+ }
7465+ },
7466+ "qwen1.5b->qwen3b": {
7467+ "donor": "qwen1.5b",
7468+ "recipient": "qwen3b",
7469+ "tasks": {
7470+ "antonym": {
7471+ "recipient_zero": 0.09375,
7472+ "recipient_few": 0.9375,
7473+ "recipient_own_vector": 0.90625,
7474+ "donor_layer": 16,
7475+ "conditions": {
7476+ "procrustes|L21|a1.0": {
7477+ "accuracy": 0.5625,
7478+ "gain_vs_zero": {
7479+ "estimate": 0.46875,
7480+ "low": 0.28125,
7481+ "high": 0.65625,
7482+ "level": 0.95,
7483+ "n_items": 32,
7484+ "n_clusters": 32,
7485+ "n_boot": 2000
7486+ },
7487+ "mapped_norm": 38.82050704956055,
7488+ "outputs_sample": [
7489+ " sad\n",
7490+ " depart\n\n",
7491+ " light\n",
7492+ " calm\n",
7493+ " under\n"
7494+ ],
7495+ "correct": [
7496+ 1.0,
7497+ 1.0,
7498+ 0.0,
7499+ 0.0,
7500+ 1.0,
7501+ 0.0,
7502+ 0.0,
7503+ 0.0,
7504+ 0.0,
7505+ 1.0,
7506+ 1.0,
7507+ 0.0,
7508+ 1.0,
7509+ 1.0,
7510+ 0.0,
7511+ 1.0,
7512+ 1.0,
7513+ 1.0,
7514+ 1.0,
7515+ 1.0,
7516+ 1.0,
7517+ 0.0,
7518+ 0.0,
7519+ 1.0,
7520+ 1.0,
7521+ 0.0,
7522+ 0.0,
7523+ 1.0,
7524+ 1.0,
7525+ 1.0,
7526+ 0.0,
7527+ 0.0
7528+ ]
7529+ },
7530+ "procrustes|L21|a2.0": {
7531+ "accuracy": 0.6875,
7532+ "gain_vs_zero": {
7533+ "estimate": 0.59375,
7534+ "low": 0.40625,
7535+ "high": 0.78125,
7536+ "level": 0.95,
7537+ "n_items": 32,
7538+ "n_clusters": 32,
7539+ "n_boot": 2000
7540+ },
7541+ "mapped_norm": 38.82050704956055,
7542+ "outputs_sample": [
7543+ " sad\n",
7544+ " leave\n\n",
7545+ " dark\n",
7546+ " cold\n",
7547+ " under\n"
7548+ ],
7549+ "correct": [
7550+ 1.0,
7551+ 0.0,
7552+ 1.0,
7553+ 0.0,
7554+ 1.0,
7555+ 0.0,
7556+ 1.0,
7557+ 1.0,
7558+ 1.0,
7559+ 1.0,
7560+ 1.0,
7561+ 0.0,
7562+ 1.0,
7563+ 1.0,
7564+ 0.0,
7565+ 1.0,
7566+ 0.0,
7567+ 1.0,
7568+ 1.0,
7569+ 1.0,
7570+ 1.0,
7571+ 1.0,
7572+ 1.0,
7573+ 1.0,
7574+ 1.0,
7575+ 0.0,
7576+ 0.0,
7577+ 1.0,
7578+ 0.0,
7579+ 1.0,
7580+ 1.0,
7581+ 0.0
7582+ ]
7583+ },
7584+ "procrustes_rescaled|L21|a1.0": {
7585+ "accuracy": 0.6875,
7586+ "gain_vs_zero": {
7587+ "estimate": 0.59375,
7588+ "low": 0.40625,
7589+ "high": 0.78125,
7590+ "level": 0.95,
7591+ "n_items": 32,
7592+ "n_clusters": 32,
7593+ "n_boot": 2000
7594+ },
7595+ "mapped_norm": 57.1178092956543,
7596+ "outputs_sample": [
7597+ " sad\n",
7598+ " depart\n\n",
7599+ " bright\n",
7600+ " happy\n",
7601+ " under\n"
7602+ ],
7603+ "correct": [
7604+ 1.0,
7605+ 1.0,
7606+ 0.0,
7607+ 0.0,
7608+ 1.0,
7609+ 0.0,
7610+ 1.0,
7611+ 1.0,
7612+ 1.0,
7613+ 1.0,
7614+ 1.0,
7615+ 0.0,
7616+ 1.0,
7617+ 1.0,
7618+ 0.0,
7619+ 1.0,
7620+ 1.0,
7621+ 1.0,
7622+ 1.0,
7623+ 1.0,
7624+ 1.0,
7625+ 1.0,
7626+ 0.0,
7627+ 1.0,
7628+ 1.0,
7629+ 0.0,
7630+ 0.0,
7631+ 1.0,
7632+ 1.0,
7633+ 1.0,
7634+ 0.0,
7635+ 0.0
7636+ ]
7637+ },
7638+ "ridge|L21|a1.0": {
7639+ "accuracy": 0.59375,
7640+ "gain_vs_zero": {
7641+ "estimate": 0.5,
7642+ "low": 0.3125,
7643+ "high": 0.6875,
7644+ "level": 0.95,
7645+ "n_items": 32,
7646+ "n_clusters": 32,
7647+ "n_boot": 2000
7648+ },
7649+ "mapped_norm": 50.51205825805664,
7650+ "outputs_sample": [
7651+ " sad\n",
7652+ " 1\n",
7653+ " dark\n",
7654+ " calm\n",
7655+ " under\n"
7656+ ],
7657+ "correct": [
7658+ 1.0,
7659+ 0.0,
7660+ 1.0,
7661+ 0.0,
7662+ 1.0,
7663+ 0.0,
7664+ 0.0,
7665+ 1.0,
7666+ 0.0,
7667+ 1.0,
7668+ 1.0,
7669+ 0.0,
7670+ 0.0,
7671+ 1.0,
7672+ 0.0,
7673+ 1.0,
7674+ 0.0,
7675+ 1.0,
7676+ 1.0,
7677+ 1.0,
7678+ 1.0,
7679+ 0.0,
7680+ 1.0,
7681+ 1.0,
7682+ 1.0,
7683+ 0.0,
7684+ 0.0,
7685+ 1.0,
7686+ 1.0,
7687+ 1.0,
7688+ 0.0,
7689+ 1.0
7690+ ]
7691+ },
7692+ "ridge|L21|a2.0": {
7693+ "accuracy": 0.3125,
7694+ "gain_vs_zero": {
7695+ "estimate": 0.21875,
7696+ "low": 0.09375,
7697+ "high": 0.34375,
7698+ "level": 0.95,
7699+ "n_items": 32,
7700+ "n_clusters": 32,
7701+ "n_boot": 2000
7702+ },
7703+ "mapped_norm": 50.51205825805664,
7704+ "outputs_sample": [
7705+ " sad\n",
7706+ " escape\n",
7707+ " dark\n",
7708+ " cold\n",
7709+ " over\n"
7710+ ],
7711+ "correct": [
7712+ 1.0,
7713+ 0.0,
7714+ 1.0,
7715+ 0.0,
7716+ 0.0,
7717+ 0.0,
7718+ 0.0,
7719+ 0.0,
7720+ 0.0,
7721+ 0.0,
7722+ 1.0,
7723+ 1.0,
7724+ 0.0,
7725+ 0.0,
7726+ 0.0,
7727+ 1.0,
7728+ 0.0,
7729+ 1.0,
7730+ 0.0,
7731+ 1.0,
7732+ 1.0,
7733+ 0.0,
7734+ 0.0,
7735+ 1.0,
7736+ 0.0,
7737+ 0.0,
7738+ 0.0,
7739+ 0.0,
7740+ 1.0,
7741+ 0.0,
7742+ 0.0,
7743+ 0.0
7744+ ]
7745+ },
7746+ "ridge_rescaled|L21|a1.0": {
7747+ "accuracy": 0.65625,
7748+ "gain_vs_zero": {
7749+ "estimate": 0.5625,
7750+ "low": 0.375,
7751+ "high": 0.75,
7752+ "level": 0.95,
7753+ "n_items": 32,
7754+ "n_clusters": 32,
7755+ "n_boot": 2000
7756+ },
7757+ "mapped_norm": 57.1178092956543,
7758+ "outputs_sample": [
7759+ " sad\n",
7760+ " depart\n",
7761+ " dark\n",
7762+ " calm\n",
7763+ " under\n"
7764+ ],
7765+ "correct": [
7766+ 1.0,
7767+ 1.0,
7768+ 1.0,
7769+ 0.0,
7770+ 1.0,
7771+ 0.0,
7772+ 1.0,
7773+ 1.0,
7774+ 0.0,
7775+ 1.0,
7776+ 1.0,
7777+ 0.0,
7778+ 0.0,
7779+ 1.0,
7780+ 0.0,
7781+ 1.0,
7782+ 0.0,
7783+ 1.0,
7784+ 1.0,
7785+ 1.0,
7786+ 1.0,
7787+ 0.0,
7788+ 1.0,
7789+ 1.0,
7790+ 1.0,
7791+ 0.0,
7792+ 0.0,
7793+ 1.0,
7794+ 1.0,
7795+ 1.0,
7796+ 0.0,
7797+ 1.0
7798+ ]
7799+ },
7800+ "cca|L21|a1.0": {
7801+ "accuracy": 0.46875,
7802+ "gain_vs_zero": {
7803+ "estimate": 0.375,
7804+ "low": 0.1875,
7805+ "high": 0.5625,
7806+ "level": 0.95,
7807+ "n_items": 32,
7808+ "n_clusters": 32,
7809+ "n_boot": 2000
7810+ },
7811+ "mapped_norm": 59.15024948120117,
7812+ "outputs_sample": [
7813+ " sad\n",
7814+ " depart\n",
7815+ " bright\n",
7816+ " calm\n",
7817+ " under\n"
7818+ ],
7819+ "correct": [
7820+ 1.0,
7821+ 1.0,
7822+ 0.0,
7823+ 0.0,
7824+ 1.0,
7825+ 0.0,
7826+ 0.0,
7827+ 0.0,
7828+ 0.0,
7829+ 1.0,
7830+ 0.0,
7831+ 0.0,
7832+ 0.0,
7833+ 1.0,
7834+ 0.0,
7835+ 1.0,
7836+ 0.0,
7837+ 1.0,
7838+ 0.0,
7839+ 1.0,
7840+ 1.0,
7841+ 0.0,
7842+ 1.0,
7843+ 1.0,
7844+ 1.0,
7845+ 0.0,
7846+ 0.0,
7847+ 0.0,
7848+ 1.0,
7849+ 1.0,
7850+ 0.0,
7851+ 1.0
7852+ ]
7853+ },
7854+ "cca|L21|a2.0": {
7855+ "accuracy": 0.0625,
7856+ "gain_vs_zero": {
7857+ "estimate": -0.03125,
7858+ "low": -0.125,
7859+ "high": 0.0625,
7860+ "level": 0.95,
7861+ "n_items": 32,
7862+ "n_clusters": 32,
7863+ "n_boot": 2000
7864+ },
7865+ "mapped_norm": 59.15024948120117,
7866+ "outputs_sample": [
7867+ " happy\n",
7868+ " arrive\n",
7869+ " bright\n",
7870+ " good\n",
7871+ " over\n"
7872+ ],
7873+ "correct": [
7874+ 0.0,
7875+ 0.0,
7876+ 0.0,
7877+ 0.0,
7878+ 0.0,
7879+ 0.0,
7880+ 0.0,
7881+ 0.0,
7882+ 0.0,
7883+ 0.0,
7884+ 0.0,
7885+ 0.0,
7886+ 0.0,
7887+ 0.0,
7888+ 0.0,
7889+ 0.0,
7890+ 0.0,
7891+ 0.0,
7892+ 0.0,
7893+ 1.0,
7894+ 0.0,
7895+ 0.0,
7896+ 0.0,
7897+ 0.0,
7898+ 0.0,
7899+ 0.0,
7900+ 0.0,
7901+ 0.0,
7902+ 1.0,
7903+ 0.0,
7904+ 0.0,
7905+ 0.0
7906+ ]
7907+ },
7908+ "random_orth|L21|a1.0": {
7909+ "accuracy": 0.0,
7910+ "gain_vs_zero": {
7911+ "estimate": -0.09375,
7912+ "low": -0.1875,
7913+ "high": 0.0,
7914+ "level": 0.95,
7915+ "n_items": 32,
7916+ "n_clusters": 32,
7917+ "n_boot": 2000
7918+ },
7919+ "mapped_norm": 42.75835418701172,
7920+ "outputs_sample": [
7921+ " 1\n",
7922+ " \"arrive\"\n",
7923+ " bright\n",
7924+ " \"aCML\"\n",
7925+ " Over\n"
7926+ ],
7927+ "correct": [
7928+ 0.0,
7929+ 0.0,
7930+ 0.0,
7931+ 0.0,
7932+ 0.0,
7933+ 0.0,
7934+ 0.0,
7935+ 0.0,
7936+ 0.0,
7937+ 0.0,
7938+ 0.0,
7939+ 0.0,
7940+ 0.0,
7941+ 0.0,
7942+ 0.0,
7943+ 0.0,
7944+ 0.0,
7945+ 0.0,
7946+ 0.0,
7947+ 0.0,
7948+ 0.0,
7949+ 0.0,
7950+ 0.0,
7951+ 0.0,
7952+ 0.0,
7953+ 0.0,
7954+ 0.0,
7955+ 0.0,
7956+ 0.0,
7957+ 0.0,
7958+ 0.0,
7959+ 0.0
7960+ ]
7961+ },
7962+ "random_orth|L21|a2.0": {
7963+ "accuracy": 0.0,
7964+ "gain_vs_zero": {
7965+ "estimate": -0.09375,
7966+ "low": -0.1875,
7967+ "high": 0.0,
7968+ "level": 0.95,
7969+ "n_items": 32,
7970+ "n_clusters": 32,
7971+ "n_boot": 2000
7972+ },
7973+ "mapped_norm": 42.75835418701172,
7974+ "outputs_sample": [
7975+ " happy\n",
7976+ " \"arrive\"\n",
7977+ " bright\n",
7978+ " \"Calm\"\n",
7979+ " Over\n"
7980+ ],
7981+ "correct": [
7982+ 0.0,
7983+ 0.0,
7984+ 0.0,
7985+ 0.0,
7986+ 0.0,
7987+ 0.0,
7988+ 0.0,
7989+ 0.0,
7990+ 0.0,
7991+ 0.0,
7992+ 0.0,
7993+ 0.0,
7994+ 0.0,
7995+ 0.0,
7996+ 0.0,
7997+ 0.0,
7998+ 0.0,
7999+ 0.0,
8000+ 0.0,
8001+ 0.0,
8002+ 0.0,
8003+ 0.0,
8004+ 0.0,
8005+ 0.0,
8006+ 0.0,
8007+ 0.0,
8008+ 0.0,
8009+ 0.0,
8010+ 0.0,
8011+ 0.0,
8012+ 0.0,
8013+ 0.0
8014+ ]
8015+ },
8016+ "replace_donor_fewshot|procrustes|L21": {
8017+ "accuracy": 0.65625,
8018+ "gain_vs_zero": {
8019+ "estimate": 0.5625,
8020+ "low": 0.375,
8021+ "high": 0.75,
8022+ "level": 0.95,
8023+ "n_items": 32,
8024+ "n_clusters": 32,
8025+ "n_boot": 2000
8026+ },
8027+ "outputs_sample": [
8028+ " sad\n",
8029+ " arrive\n\n",
8030+ " dark\n",
8031+ " calm\n",
8032+ " under\n"
8033+ ],
8034+ "correct": [
8035+ 1.0,
8036+ 0.0,
8037+ 1.0,
8038+ 0.0,
8039+ 1.0,
8040+ 0.0,
8041+ 1.0,
8042+ 1.0,
8043+ 1.0,
8044+ 1.0,
8045+ 1.0,
8046+ 0.0,
8047+ 1.0,
8048+ 1.0,
8049+ 0.0,
8050+ 1.0,
8051+ 1.0,
8052+ 1.0,
8053+ 1.0,
8054+ 1.0,
8055+ 1.0,
8056+ 0.0,
8057+ 0.0,
8058+ 1.0,
8059+ 1.0,
8060+ 0.0,
8061+ 0.0,
8062+ 1.0,
8063+ 1.0,
8064+ 1.0,
8065+ 0.0,
8066+ 0.0
8067+ ]
8068+ },
8069+ "ctl_replace_donor_zeroshot|procrustes|L21": {
8070+ "accuracy": 0.09375,
8071+ "gain_vs_zero": {
8072+ "estimate": 0.0,
8073+ "low": -0.125,
8074+ "high": 0.125,
8075+ "level": 0.95,
8076+ "n_items": 32,
8077+ "n_clusters": 32,
8078+ "n_boot": 2000
8079+ },
8080+ "outputs_sample": [
8081+ " 4\n",
8082+ " 1\n",
8083+ " The word \"bright\" is",
8084+ " The word \"calm\"",
8085+ " 3\n\n"
8086+ ],
8087+ "correct": [
8088+ 0.0,
8089+ 0.0,
8090+ 0.0,
8091+ 0.0,
8092+ 0.0,
8093+ 0.0,
8094+ 0.0,
8095+ 0.0,
8096+ 0.0,
8097+ 0.0,
8098+ 1.0,
8099+ 0.0,
8100+ 0.0,
8101+ 0.0,
8102+ 0.0,
8103+ 1.0,
8104+ 0.0,
8105+ 0.0,
8106+ 0.0,
8107+ 1.0,
8108+ 0.0,
8109+ 0.0,
8110+ 0.0,
8111+ 0.0,
8112+ 0.0,
8113+ 0.0,
8114+ 0.0,
8115+ 0.0,
8116+ 0.0,
8117+ 0.0,
8118+ 0.0,
8119+ 0.0
8120+ ]
8121+ },
8122+ "ctl_replace_donor_fewshot_shuffled_query|procrustes|L21": {
8123+ "accuracy": 0.625,
8124+ "gain_vs_zero": {
8125+ "estimate": 0.53125,
8126+ "low": 0.34375,
8127+ "high": 0.71875,
8128+ "level": 0.95,
8129+ "n_items": 32,
8130+ "n_clusters": 32,
8131+ "n_boot": 2000
8132+ },
8133+ "outputs_sample": [
8134+ " sad\n",
8135+ " 1\n",
8136+ " dark\n",
8137+ " calm\n",
8138+ " under\n"
8139+ ],
8140+ "correct": [
8141+ 1.0,
8142+ 0.0,
8143+ 1.0,
8144+ 0.0,
8145+ 1.0,
8146+ 0.0,
8147+ 0.0,
8148+ 1.0,
8149+ 1.0,
8150+ 1.0,
8151+ 0.0,
8152+ 0.0,
8153+ 1.0,
8154+ 1.0,
8155+ 0.0,
8156+ 1.0,
8157+ 1.0,
8158+ 1.0,
8159+ 1.0,
8160+ 1.0,
8161+ 1.0,
8162+ 1.0,
8163+ 0.0,
8164+ 1.0,
8165+ 1.0,
8166+ 0.0,
8167+ 0.0,
8168+ 1.0,
8169+ 1.0,
8170+ 1.0,
8171+ 0.0,
8172+ 0.0
8173+ ]
8174+ },
8175+ "replace_donor_fewshot|ridge|L21": {
8176+ "accuracy": 0.65625,
8177+ "gain_vs_zero": {
8178+ "estimate": 0.5625,
8179+ "low": 0.375,
8180+ "high": 0.75,
8181+ "level": 0.95,
8182+ "n_items": 32,
8183+ "n_clusters": 32,
8184+ "n_boot": 2000
8185+ },
8186+ "outputs_sample": [
8187+ " sad\n",
8188+ " 1\n",
8189+ " dark\n",
8190+ " calm\n",
8191+ " under\n"
8192+ ],
8193+ "correct": [
8194+ 1.0,
8195+ 0.0,
8196+ 1.0,
8197+ 0.0,
8198+ 1.0,
8199+ 0.0,
8200+ 0.0,
8201+ 1.0,
8202+ 1.0,
8203+ 1.0,
8204+ 1.0,
8205+ 0.0,
8206+ 0.0,
8207+ 1.0,
8208+ 0.0,
8209+ 1.0,
8210+ 1.0,
8211+ 1.0,
8212+ 1.0,
8213+ 1.0,
8214+ 1.0,
8215+ 1.0,
8216+ 0.0,
8217+ 1.0,
8218+ 1.0,
8219+ 0.0,
8220+ 0.0,
8221+ 1.0,
8222+ 1.0,
8223+ 1.0,
8224+ 0.0,
8225+ 1.0
8226+ ]
8227+ },
8228+ "ctl_replace_donor_zeroshot|ridge|L21": {
8229+ "accuracy": 0.0625,
8230+ "gain_vs_zero": {
8231+ "estimate": -0.03125,
8232+ "low": -0.125,
8233+ "high": 0.0625,
8234+ "level": 0.95,
8235+ "n_items": 32,
8236+ "n_clusters": 32,
8237+ "n_boot": 2000
8238+ },
8239+ "outputs_sample": [
8240+ " 4\n",
8241+ " 1\n",
8242+ " The word \"bright\" is",
8243+ " The word \"calm\"",
8244+ " 1\n"
8245+ ],
8246+ "correct": [
8247+ 0.0,
8248+ 0.0,
8249+ 0.0,
8250+ 0.0,
8251+ 0.0,
8252+ 0.0,
8253+ 0.0,
8254+ 0.0,
8255+ 0.0,
8256+ 0.0,
8257+ 1.0,
8258+ 0.0,
8259+ 0.0,
8260+ 0.0,
8261+ 0.0,
8262+ 0.0,
8263+ 0.0,
8264+ 0.0,
8265+ 0.0,
8266+ 1.0,
8267+ 0.0,
8268+ 0.0,
8269+ 0.0,
8270+ 0.0,
8271+ 0.0,
8272+ 0.0,
8273+ 0.0,
8274+ 0.0,
8275+ 0.0,
8276+ 0.0,
8277+ 0.0,
8278+ 0.0
8279+ ]
8280+ },
8281+ "ctl_replace_donor_fewshot_shuffled_query|ridge|L21": {
8282+ "accuracy": 0.625,
8283+ "gain_vs_zero": {
8284+ "estimate": 0.53125,
8285+ "low": 0.34375,
8286+ "high": 0.71875,
8287+ "level": 0.95,
8288+ "n_items": 32,
8289+ "n_clusters": 32,
8290+ "n_boot": 2000
8291+ },
8292+ "outputs_sample": [
8293+ " sad\n",
8294+ " 1\n",
8295+ " dark\n",
8296+ " calm\n",
8297+ " under\n"
8298+ ],
8299+ "correct": [
8300+ 1.0,
8301+ 0.0,
8302+ 1.0,
8303+ 0.0,
8304+ 1.0,
8305+ 0.0,
8306+ 1.0,
8307+ 0.0,
8308+ 1.0,
8309+ 1.0,
8310+ 1.0,
8311+ 0.0,
8312+ 0.0,
8313+ 1.0,
8314+ 0.0,
8315+ 1.0,
8316+ 1.0,
8317+ 1.0,
8318+ 1.0,
8319+ 1.0,
8320+ 1.0,
8321+ 1.0,
8322+ 0.0,
8323+ 1.0,
8324+ 1.0,
8325+ 0.0,
8326+ 0.0,
8327+ 0.0,
8328+ 1.0,
8329+ 1.0,
8330+ 0.0,
8331+ 1.0
8332+ ]
8333+ },
8334+ "ctl_replace_donor_fewshot|sham_map|L21": {
8335+ "accuracy": 0.375,
8336+ "gain_vs_zero": {
8337+ "estimate": 0.28125,
8338+ "low": 0.09375,
8339+ "high": 0.43828124999999574,
8340+ "level": 0.95,
8341+ "n_items": 32,
8342+ "n_clusters": 32,
8343+ "n_boot": 2000
8344+ },
8345+ "outputs_sample": [
8346+ " sad\n",
8347+ " 1\n",
8348+ " \"Bright\"\n",
8349+ " \"aCML\"\n",
8350+ " under\n"
8351+ ],
8352+ "correct": [
8353+ 1.0,
8354+ 0.0,
8355+ 0.0,
8356+ 0.0,
8357+ 1.0,
8358+ 0.0,
8359+ 0.0,
8360+ 0.0,
8361+ 0.0,
8362+ 0.0,
8363+ 1.0,
8364+ 0.0,
8365+ 0.0,
8366+ 0.0,
8367+ 0.0,
8368+ 1.0,
8369+ 0.0,
8370+ 1.0,
8371+ 0.0,
8372+ 1.0,
8373+ 1.0,
8374+ 1.0,
8375+ 0.0,
8376+ 1.0,
8377+ 1.0,
8378+ 0.0,
8379+ 0.0,
8380+ 1.0,
8381+ 1.0,
8382+ 0.0,
8383+ 0.0,
8384+ 0.0
8385+ ]
8386+ },
8387+ "ctl_replace_donor_zeroshot|sham_map|L21": {
8388+ "accuracy": 0.21875,
8389+ "gain_vs_zero": {
8390+ "estimate": 0.125,
8391+ "low": -0.03125,
8392+ "high": 0.28125,
8393+ "level": 0.95,
8394+ "n_items": 32,
8395+ "n_clusters": 32,
8396+ "n_boot": 2000
8397+ },
8398+ "outputs_sample": [
8399+ " 4\n\n",
8400+ " 1\n",
8401+ " The word \"bright\" is",
8402+ " \"aCML\"\n",
8403+ " under\n"
8404+ ],
8405+ "correct": [
8406+ 0.0,
8407+ 0.0,
8408+ 0.0,
8409+ 0.0,
8410+ 1.0,
8411+ 0.0,
8412+ 0.0,
8413+ 0.0,
8414+ 1.0,
8415+ 0.0,
8416+ 1.0,
8417+ 0.0,
8418+ 0.0,
8419+ 1.0,
8420+ 0.0,
8421+ 1.0,
8422+ 0.0,
8423+ 0.0,
8424+ 0.0,
8425+ 1.0,
8426+ 0.0,
8427+ 0.0,
8428+ 0.0,
8429+ 0.0,
8430+ 0.0,
8431+ 0.0,
8432+ 0.0,
8433+ 0.0,
8434+ 1.0,
8435+ 0.0,
8436+ 0.0,
8437+ 0.0
8438+ ]
8439+ },
8440+ "ctl_replace_donor_fewshot_shuffled_query|sham_map|L21": {
8441+ "accuracy": 0.3125,
8442+ "gain_vs_zero": {
8443+ "estimate": 0.21875,
8444+ "low": 0.03125,
8445+ "high": 0.40625,
8446+ "level": 0.95,
8447+ "n_items": 32,
8448+ "n_clusters": 32,
8449+ "n_boot": 2000
8450+ },
8451+ "outputs_sample": [
8452+ " happy\n",
8453+ " \"arrive\"\n\n",
8454+ " \"Bright\"\n",
8455+ " \"aCML\"\n",
8456+ " under\n"
8457+ ],
8458+ "correct": [
8459+ 0.0,
8460+ 0.0,
8461+ 0.0,
8462+ 0.0,
8463+ 1.0,
8464+ 0.0,
8465+ 0.0,
8466+ 0.0,
8467+ 0.0,
8468+ 0.0,
8469+ 1.0,
8470+ 0.0,
8471+ 0.0,
8472+ 0.0,
8473+ 0.0,
8474+ 1.0,
8475+ 1.0,
8476+ 0.0,
8477+ 0.0,
8478+ 1.0,
8479+ 0.0,
8480+ 0.0,
8481+ 1.0,
8482+ 1.0,
8483+ 1.0,
8484+ 0.0,
8485+ 0.0,
8486+ 1.0,
8487+ 1.0,
8488+ 0.0,
8489+ 0.0,
8490+ 0.0
8491+ ]
8492+ },
8493+ "ctl_random_norm_matched|L21": {
8494+ "accuracy": 0.15625,
8495+ "gain_vs_zero": {
8496+ "estimate": 0.0625,
8497+ "low": -0.0625,
8498+ "high": 0.1875,
8499+ "level": 0.95,
8500+ "n_items": 32,
8501+ "n_clusters": 32,
8502+ "n_boot": 2000
8503+ },
8504+ "correct": [
8505+ 0.0,
8506+ 0.0,
8507+ 0.0,
8508+ 0.0,
8509+ 0.0,
8510+ 0.0,
8511+ 0.0,
8512+ 0.0,
8513+ 0.0,
8514+ 0.0,
8515+ 1.0,
8516+ 0.0,
8517+ 0.0,
8518+ 0.0,
8519+ 0.0,
8520+ 1.0,
8521+ 0.0,
8522+ 1.0,
8523+ 0.0,
8524+ 1.0,
8525+ 0.0,
8526+ 0.0,
8527+ 0.0,
8528+ 0.0,
8529+ 0.0,
8530+ 0.0,
8531+ 0.0,
8532+ 0.0,
8533+ 1.0,
8534+ 0.0,
8535+ 0.0,
8536+ 0.0
8537+ ]
8538+ },
8539+ "ctl_unrelated_task_vector(capital)|L21": {
8540+ "accuracy": 0.1875,
8541+ "gain_vs_zero": {
8542+ "estimate": 0.09375,
8543+ "low": -0.03125,
8544+ "high": 0.21875,
8545+ "level": 0.95,
8546+ "n_items": 32,
8547+ "n_clusters": 32,
8548+ "n_boot": 2000
8549+ },
8550+ "correct": [
8551+ 0.0,
8552+ 0.0,
8553+ 0.0,
8554+ 0.0,
8555+ 0.0,
8556+ 0.0,
8557+ 0.0,
8558+ 0.0,
8559+ 0.0,
8560+ 0.0,
8561+ 0.0,
8562+ 0.0,
8563+ 0.0,
8564+ 1.0,
8565+ 0.0,
8566+ 1.0,
8567+ 0.0,
8568+ 1.0,
8569+ 0.0,
8570+ 1.0,
8571+ 0.0,
8572+ 0.0,
8573+ 0.0,
8574+ 0.0,
8575+ 1.0,
8576+ 0.0,
8577+ 0.0,
8578+ 0.0,
8579+ 1.0,
8580+ 0.0,
8581+ 0.0,
8582+ 0.0
8583+ ]
8584+ },
8585+ "procrustes|L25|a1.0": {
8586+ "accuracy": 0.75,
8587+ "gain_vs_zero": {
8588+ "estimate": 0.65625,
8589+ "low": 0.5,
8590+ "high": 0.8125,
8591+ "level": 0.95,
8592+ "n_items": 32,
8593+ "n_clusters": 32,
8594+ "n_boot": 2000
8595+ },
8596+ "mapped_norm": 55.15292739868164,
8597+ "outputs_sample": [
8598+ " sad\n",
8599+ " leave\n\n",
8600+ " dark\n",
8601+ " happy\n",
8602+ " under\n\n"
8603+ ],
8604+ "correct": [
8605+ 1.0,
8606+ 0.0,
8607+ 1.0,
8608+ 0.0,
8609+ 1.0,
8610+ 0.0,
8611+ 1.0,
8612+ 1.0,
8613+ 1.0,
8614+ 1.0,
8615+ 1.0,
8616+ 1.0,
8617+ 0.0,
8618+ 1.0,
8619+ 0.0,
8620+ 1.0,
8621+ 0.0,
8622+ 1.0,
8623+ 1.0,
8624+ 1.0,
8625+ 1.0,
8626+ 1.0,
8627+ 1.0,
8628+ 1.0,
8629+ 1.0,
8630+ 1.0,
8631+ 0.0,
8632+ 1.0,
8633+ 1.0,
8634+ 0.0,
8635+ 1.0,
8636+ 1.0
8637+ ]
8638+ },
8639+ "procrustes|L25|a2.0": {
8640+ "accuracy": 0.3125,
8641+ "gain_vs_zero": {
8642+ "estimate": 0.21875,
8643+ "low": 0.0625,
8644+ "high": 0.375,
8645+ "level": 0.95,
8646+ "n_items": 32,
8647+ "n_clusters": 32,
8648+ "n_boot": 2000
8649+ },
8650+ "mapped_norm": 55.15292739868164,
8651+ "outputs_sample": [
8652+ " sad\n",
8653+ " child\n\n",
8654+ " light\n",
8655+ " happy\n",
8656+ " light\n"
8657+ ],
8658+ "correct": [
8659+ 1.0,
8660+ 0.0,
8661+ 0.0,
8662+ 0.0,
8663+ 0.0,
8664+ 0.0,
8665+ 1.0,
8666+ 0.0,
8667+ 0.0,
8668+ 0.0,
8669+ 1.0,
8670+ 0.0,
8671+ 0.0,
8672+ 0.0,
8673+ 0.0,
8674+ 1.0,
8675+ 0.0,
8676+ 1.0,
8677+ 0.0,
8678+ 1.0,
8679+ 1.0,
8680+ 0.0,
8681+ 0.0,
8682+ 1.0,
8683+ 0.0,
8684+ 0.0,
8685+ 0.0,
8686+ 0.0,
8687+ 1.0,
8688+ 0.0,
8689+ 1.0,
8690+ 0.0
8691+ ]
8692+ },
8693+ "procrustes_rescaled|L25|a1.0": {
8694+ "accuracy": 0.75,
8695+ "gain_vs_zero": {
8696+ "estimate": 0.65625,
8697+ "low": 0.5,
8698+ "high": 0.8125,
8699+ "level": 0.95,
8700+ "n_items": 32,
8701+ "n_clusters": 32,
8702+ "n_boot": 2000
8703+ },
8704+ "mapped_norm": 57.11780548095703,
8705+ "outputs_sample": [
8706+ " sad\n",
8707+ " leave\n\n",
8708+ " dark\n",
8709+ " happy\n",
8710+ " under\n\n"
8711+ ],
8712+ "correct": [
8713+ 1.0,
8714+ 0.0,
8715+ 1.0,
8716+ 0.0,
8717+ 1.0,
8718+ 0.0,
8719+ 1.0,
8720+ 1.0,
8721+ 1.0,
8722+ 1.0,
8723+ 1.0,
8724+ 1.0,
8725+ 0.0,
8726+ 1.0,
8727+ 0.0,
8728+ 1.0,
8729+ 0.0,
8730+ 1.0,
8731+ 1.0,
8732+ 1.0,
8733+ 1.0,
8734+ 1.0,
8735+ 1.0,
8736+ 1.0,
8737+ 1.0,
8738+ 1.0,
8739+ 0.0,
8740+ 1.0,
8741+ 1.0,
8742+ 0.0,
8743+ 1.0,
8744+ 1.0
8745+ ]
8746+ },
8747+ "ridge|L25|a1.0": {
8748+ "accuracy": 0.375,
8749+ "gain_vs_zero": {
8750+ "estimate": 0.28125,
8751+ "low": 0.125,
8752+ "high": 0.4375,
8753+ "level": 0.95,
8754+ "n_items": 32,
8755+ "n_clusters": 32,
8756+ "n_boot": 2000
8757+ },
8758+ "mapped_norm": 77.63898468017578,
8759+ "outputs_sample": [
8760+ " sad\n",
8761+ " leave\n",
8762+ " light\n",
8763+ " cry\n",
8764+ " under\n"
8765+ ],
8766+ "correct": [
8767+ 1.0,
8768+ 0.0,
8769+ 0.0,
8770+ 0.0,
8771+ 1.0,
8772+ 0.0,
8773+ 1.0,
8774+ 0.0,
8775+ 1.0,
8776+ 0.0,
8777+ 0.0,
8778+ 1.0,
8779+ 0.0,
8780+ 0.0,
8781+ 0.0,
8782+ 1.0,
8783+ 0.0,
8784+ 1.0,
8785+ 0.0,
8786+ 1.0,
8787+ 1.0,
8788+ 0.0,
8789+ 0.0,
8790+ 1.0,
8791+ 1.0,
8792+ 0.0,
8793+ 0.0,
8794+ 0.0,
8795+ 1.0,
8796+ 0.0,
8797+ 0.0,
8798+ 0.0
8799+ ]
8800+ },
8801+ "ridge|L25|a2.0": {
8802+ "accuracy": 0.0,
8803+ "gain_vs_zero": {
8804+ "estimate": -0.09375,
8805+ "low": -0.1875,
8806+ "high": 0.0,
8807+ "level": 0.95,
8808+ "n_items": 32,
8809+ "n_clusters": 32,
8810+ "n_boot": 2000
8811+ },
8812+ "mapped_norm": 77.63898468017578,
8813+ "outputs_sample": [
8814+ " free\n",
8815+ " plant\n",
8816+ " fit\n",
8817+ " fit\n",
8818+ " five\n"
8819+ ],
8820+ "correct": [
8821+ 0.0,
8822+ 0.0,
8823+ 0.0,
8824+ 0.0,
8825+ 0.0,
8826+ 0.0,
8827+ 0.0,
8828+ 0.0,
8829+ 0.0,
8830+ 0.0,
8831+ 0.0,
8832+ 0.0,
8833+ 0.0,
8834+ 0.0,
8835+ 0.0,
8836+ 0.0,
8837+ 0.0,
8838+ 0.0,
8839+ 0.0,
8840+ 0.0,
8841+ 0.0,
8842+ 0.0,
8843+ 0.0,
8844+ 0.0,
8845+ 0.0,
8846+ 0.0,
8847+ 0.0,
8848+ 0.0,
8849+ 0.0,
8850+ 0.0,
8851+ 0.0,
8852+ 0.0
8853+ ]
8854+ },
8855+ "ridge_rescaled|L25|a1.0": {
8856+ "accuracy": 0.46875,
8857+ "gain_vs_zero": {
8858+ "estimate": 0.375,
8859+ "low": 0.1875,
8860+ "high": 0.5625,
8861+ "level": 0.95,
8862+ "n_items": 32,
8863+ "n_clusters": 32,
8864+ "n_boot": 2000
8865+ },
8866+ "mapped_norm": 57.11780548095703,
8867+ "outputs_sample": [
8868+ " sad\n",
8869+ " 1\n",
8870+ " dark\n",
8871+ " calm\n",
8872+ " under\n"
8873+ ],
8874+ "correct": [
8875+ 1.0,
8876+ 0.0,
8877+ 1.0,
8878+ 0.0,
8879+ 1.0,
8880+ 0.0,
8881+ 1.0,
8882+ 0.0,
8883+ 1.0,
8884+ 1.0,
8885+ 1.0,
8886+ 0.0,
8887+ 0.0,
8888+ 0.0,
8889+ 0.0,
8890+ 1.0,
8891+ 1.0,
8892+ 1.0,
8893+ 0.0,
8894+ 1.0,
8895+ 1.0,
8896+ 0.0,
8897+ 0.0,
8898+ 1.0,
8899+ 1.0,
8900+ 0.0,
8901+ 0.0,
8902+ 0.0,
8903+ 1.0,
8904+ 0.0,
8905+ 0.0,
8906+ 0.0
8907+ ]
8908+ },
8909+ "cca|L25|a1.0": {
8910+ "accuracy": 0.3125,
8911+ "gain_vs_zero": {
8912+ "estimate": 0.21875,
8913+ "low": 0.03125,
8914+ "high": 0.375,
8915+ "level": 0.95,
8916+ "n_items": 32,
8917+ "n_clusters": 32,
8918+ "n_boot": 2000
8919+ },
8920+ "mapped_norm": 96.08650207519531,
8921+ "outputs_sample": [
8922+ " happy\n",
8923+ " 1\n",
8924+ " light\n",
8925+ " shy\n",
8926+ " zero\n"
8927+ ],
8928+ "correct": [
8929+ 0.0,
8930+ 0.0,
8931+ 0.0,
8932+ 0.0,
8933+ 0.0,
8934+ 0.0,
8935+ 1.0,
8936+ 0.0,
8937+ 1.0,
8938+ 0.0,
8939+ 1.0,
8940+ 0.0,
8941+ 0.0,
8942+ 0.0,
8943+ 0.0,
8944+ 1.0,
8945+ 0.0,
8946+ 1.0,
8947+ 0.0,
8948+ 1.0,
8949+ 1.0,
8950+ 0.0,
8951+ 0.0,
8952+ 1.0,
8953+ 1.0,
8954+ 0.0,
8955+ 0.0,
8956+ 0.0,
8957+ 1.0,
8958+ 0.0,
8959+ 0.0,
8960+ 0.0
8961+ ]
8962+ },
8963+ "cca|L25|a2.0": {
8964+ "accuracy": 0.0,
8965+ "gain_vs_zero": {
8966+ "estimate": -0.09375,
8967+ "low": -0.1875,
8968+ "high": 0.0,
8969+ "level": 0.95,
8970+ "n_items": 32,
8971+ "n_clusters": 32,
8972+ "n_boot": 2000
8973+ },
8974+ "mapped_norm": 96.08650207519531,
8975+ "outputs_sample": [
8976+ "\n\n\n",
8977+ "\n",
8978+ " fit\n",
8979+ "\n",
8980+ "\n"
8981+ ],
8982+ "correct": [
8983+ 0.0,
8984+ 0.0,
8985+ 0.0,
8986+ 0.0,
8987+ 0.0,
8988+ 0.0,
8989+ 0.0,
8990+ 0.0,
8991+ 0.0,
8992+ 0.0,
8993+ 0.0,
8994+ 0.0,
8995+ 0.0,
8996+ 0.0,
8997+ 0.0,
8998+ 0.0,
8999+ 0.0,
9000+ 0.0,
9001+ 0.0,
9002+ 0.0,
9003+ 0.0,
9004+ 0.0,
9005+ 0.0,
9006+ 0.0,
9007+ 0.0,
9008+ 0.0,
9009+ 0.0,
9010+ 0.0,
9011+ 0.0,
9012+ 0.0,
9013+ 0.0,
9014+ 0.0
9015+ ]
9016+ },
9017+ "random_orth|L25|a1.0": {
9018+ "accuracy": 0.125,
9019+ "gain_vs_zero": {
9020+ "estimate": 0.03125,
9021+ "low": -0.09375,
9022+ "high": 0.15625,
9023+ "level": 0.95,
9024+ "n_items": 32,
9025+ "n_clusters": 32,
9026+ "n_boot": 2000
9027+ },
9028+ "mapped_norm": 62.4911994934082,
9029+ "outputs_sample": [
9030+ " happy\n",
9031+ " arrive\n",
9032+ " bright\n",
9033+ " \"aCML\"\n",
9034+ " over\n"
9035+ ],
9036+ "correct": [
9037+ 0.0,
9038+ 0.0,
9039+ 0.0,
9040+ 0.0,
9041+ 0.0,
9042+ 0.0,
9043+ 0.0,
9044+ 0.0,
9045+ 0.0,
9046+ 0.0,
9047+ 0.0,
9048+ 0.0,
9049+ 0.0,
9050+ 0.0,
9051+ 0.0,
9052+ 1.0,
9053+ 0.0,
9054+ 0.0,
9055+ 0.0,
9056+ 1.0,
9057+ 1.0,
9058+ 0.0,
9059+ 0.0,
9060+ 1.0,
9061+ 0.0,
9062+ 0.0,
9063+ 0.0,
9064+ 0.0,
9065+ 0.0,
9066+ 0.0,
9067+ 0.0,
9068+ 0.0
9069+ ]
9070+ },
9071+ "random_orth|L25|a2.0": {
9072+ "accuracy": 0.0,
9073+ "gain_vs_zero": {
9074+ "estimate": -0.09375,
9075+ "low": -0.1875,
9076+ "high": 0.0,
9077+ "level": 0.95,
9078+ "n_items": 32,
9079+ "n_clusters": 32,
9080+ "n_boot": 2000
9081+ },
9082+ "mapped_norm": 62.4911994934082,
9083+ "outputs_sample": [
9084+ " happy\n",
9085+ " \"arrive\"\n",
9086+ " \"Bright\"\n",
9087+ " \"aCML\"\n",
9088+ " over\n"
9089+ ],
9090+ "correct": [
9091+ 0.0,
9092+ 0.0,
9093+ 0.0,
9094+ 0.0,
9095+ 0.0,
9096+ 0.0,
9097+ 0.0,
9098+ 0.0,
9099+ 0.0,
9100+ 0.0,
9101+ 0.0,
9102+ 0.0,
9103+ 0.0,
9104+ 0.0,
9105+ 0.0,
9106+ 0.0,
9107+ 0.0,
9108+ 0.0,
9109+ 0.0,
9110+ 0.0,
9111+ 0.0,
9112+ 0.0,
9113+ 0.0,
9114+ 0.0,
9115+ 0.0,
9116+ 0.0,
9117+ 0.0,
9118+ 0.0,
9119+ 0.0,
9120+ 0.0,
9121+ 0.0,
9122+ 0.0
9123+ ]
9124+ },
9125+ "replace_donor_fewshot|procrustes|L25": {
9126+ "accuracy": 0.84375,
9127+ "gain_vs_zero": {
9128+ "estimate": 0.75,
9129+ "low": 0.59375,
9130+ "high": 0.875,
9131+ "level": 0.95,
9132+ "n_items": 32,
9133+ "n_clusters": 32,
9134+ "n_boot": 2000
9135+ },
9136+ "outputs_sample": [
9137+ " sad\n",
9138+ " leave\n\n",
9139+ " dark\n",
9140+ " excited\n",
9141+ " under\n\n"
9142+ ],
9143+ "correct": [
9144+ 1.0,
9145+ 0.0,
9146+ 1.0,
9147+ 0.0,
9148+ 1.0,
9149+ 0.0,
9150+ 1.0,
9151+ 1.0,
9152+ 1.0,
9153+ 1.0,
9154+ 1.0,
9155+ 1.0,
9156+ 1.0,
9157+ 1.0,
9158+ 1.0,
9159+ 1.0,
9160+ 1.0,
9161+ 1.0,
9162+ 1.0,
9163+ 1.0,
9164+ 1.0,
9165+ 1.0,
9166+ 1.0,
9167+ 1.0,
9168+ 1.0,
9169+ 1.0,
9170+ 0.0,
9171+ 1.0,
9172+ 1.0,
9173+ 0.0,
9174+ 1.0,
9175+ 1.0
9176+ ]
9177+ },
9178+ "ctl_replace_donor_zeroshot|procrustes|L25": {
9179+ "accuracy": 0.03125,
9180+ "gain_vs_zero": {
9181+ "estimate": -0.0625,
9182+ "low": -0.1875,
9183+ "high": 0.03125,
9184+ "level": 0.95,
9185+ "n_items": 32,
9186+ "n_clusters": 32,
9187+ "n_boot": 2000
9188+ },
9189+ "outputs_sample": [
9190+ " 4\n",
9191+ " 1\n",
9192+ " The word \"bright\" is",
9193+ " 3\n",
9194+ " 3\n\n"
9195+ ],
9196+ "correct": [
9197+ 0.0,
9198+ 0.0,
9199+ 0.0,
9200+ 0.0,
9201+ 0.0,
9202+ 0.0,
9203+ 0.0,
9204+ 0.0,
9205+ 0.0,
9206+ 0.0,
9207+ 0.0,
9208+ 0.0,
9209+ 0.0,
9210+ 0.0,
9211+ 0.0,
9212+ 1.0,
9213+ 0.0,
9214+ 0.0,
9215+ 0.0,
9216+ 0.0,
9217+ 0.0,
9218+ 0.0,
9219+ 0.0,
9220+ 0.0,
9221+ 0.0,
9222+ 0.0,
9223+ 0.0,
9224+ 0.0,
9225+ 0.0,
9226+ 0.0,
9227+ 0.0,
9228+ 0.0
9229+ ]
9230+ },
9231+ "ctl_replace_donor_fewshot_shuffled_query|procrustes|L25": {
9232+ "accuracy": 0.8125,
9233+ "gain_vs_zero": {
9234+ "estimate": 0.71875,
9235+ "low": 0.5625,
9236+ "high": 0.875,
9237+ "level": 0.95,
9238+ "n_items": 32,
9239+ "n_clusters": 32,
9240+ "n_boot": 2000
9241+ },
9242+ "outputs_sample": [
9243+ " sad\n",
9244+ " leave\n\n",
9245+ " dark\n",
9246+ " happy\n",
9247+ " under\n"
9248+ ],
9249+ "correct": [
9250+ 1.0,
9251+ 0.0,
9252+ 1.0,
9253+ 0.0,
9254+ 1.0,
9255+ 0.0,
9256+ 1.0,
9257+ 1.0,
9258+ 1.0,
9259+ 1.0,
9260+ 1.0,
9261+ 1.0,
9262+ 1.0,
9263+ 1.0,
9264+ 1.0,
9265+ 1.0,
9266+ 1.0,
9267+ 1.0,
9268+ 1.0,
9269+ 1.0,
9270+ 1.0,
9271+ 1.0,
9272+ 1.0,
9273+ 1.0,
9274+ 1.0,
9275+ 0.0,
9276+ 0.0,
9277+ 1.0,
9278+ 1.0,
9279+ 0.0,
9280+ 1.0,
9281+ 1.0
9282+ ]
9283+ },
9284+ "replace_donor_fewshot|ridge|L25": {
9285+ "accuracy": 0.53125,
9286+ "gain_vs_zero": {
9287+ "estimate": 0.4375,
9288+ "low": 0.25,
9289+ "high": 0.59375,
9290+ "level": 0.95,
9291+ "n_items": 32,
9292+ "n_clusters": 32,
9293+ "n_boot": 2000
9294+ },
9295+ "outputs_sample": [
9296+ " sad\n",
9297+ " 1\n",
9298+ " dark\n",
9299+ " cry\n",
9300+ " over\n"
9301+ ],
9302+ "correct": [
9303+ 1.0,
9304+ 0.0,
9305+ 1.0,
9306+ 0.0,
9307+ 0.0,
9308+ 0.0,
9309+ 1.0,
9310+ 0.0,
9311+ 1.0,
9312+ 1.0,
9313+ 1.0,
9314+ 1.0,
9315+ 0.0,
9316+ 1.0,
9317+ 0.0,
9318+ 1.0,
9319+ 1.0,
9320+ 1.0,
9321+ 0.0,
9322+ 1.0,
9323+ 1.0,
9324+ 0.0,
9325+ 0.0,
9326+ 1.0,
9327+ 1.0,
9328+ 1.0,
9329+ 0.0,
9330+ 0.0,
9331+ 1.0,
9332+ 0.0,
9333+ 0.0,
9334+ 0.0
9335+ ]
9336+ },
9337+ "ctl_replace_donor_zeroshot|ridge|L25": {
9338+ "accuracy": 0.0,
9339+ "gain_vs_zero": {
9340+ "estimate": -0.09375,
9341+ "low": -0.1875,
9342+ "high": 0.0,
9343+ "level": 0.95,
9344+ "n_items": 32,
9345+ "n_clusters": 32,
9346+ "n_boot": 2000
9347+ },
9348+ "outputs_sample": [
9349+ " 4\n",
9350+ " 1\n",
9351+ " The word \"bright\" is",
9352+ " 3\n",
9353+ " 3\n"
9354+ ],
9355+ "correct": [
9356+ 0.0,
9357+ 0.0,
9358+ 0.0,
9359+ 0.0,
9360+ 0.0,
9361+ 0.0,
9362+ 0.0,
9363+ 0.0,
9364+ 0.0,
9365+ 0.0,
9366+ 0.0,
9367+ 0.0,
9368+ 0.0,
9369+ 0.0,
9370+ 0.0,
9371+ 0.0,
9372+ 0.0,
9373+ 0.0,
9374+ 0.0,
9375+ 0.0,
9376+ 0.0,
9377+ 0.0,
9378+ 0.0,
9379+ 0.0,
9380+ 0.0,
9381+ 0.0,
9382+ 0.0,
9383+ 0.0,
9384+ 0.0,
9385+ 0.0,
9386+ 0.0,
9387+ 0.0
9388+ ]
9389+ },
9390+ "ctl_replace_donor_fewshot_shuffled_query|ridge|L25": {
9391+ "accuracy": 0.5,
9392+ "gain_vs_zero": {
9393+ "estimate": 0.40625,
9394+ "low": 0.21875,
9395+ "high": 0.59375,
9396+ "level": 0.95,
9397+ "n_items": 32,
9398+ "n_clusters": 32,
9399+ "n_boot": 2000
9400+ },
9401+ "outputs_sample": [
9402+ " sad\n",
9403+ " 1\n",
9404+ " dark\n",
9405+ " happy\n",
9406+ " under\n"
9407+ ],
9408+ "correct": [
9409+ 1.0,
9410+ 0.0,
9411+ 1.0,
9412+ 0.0,
9413+ 1.0,
9414+ 0.0,
9415+ 1.0,
9416+ 0.0,
9417+ 1.0,
9418+ 1.0,
9419+ 1.0,
9420+ 0.0,
9421+ 0.0,
9422+ 0.0,
9423+ 1.0,
9424+ 1.0,
9425+ 1.0,
9426+ 1.0,
9427+ 0.0,
9428+ 1.0,
9429+ 1.0,
9430+ 0.0,
9431+ 0.0,
9432+ 1.0,
9433+ 1.0,
9434+ 0.0,
9435+ 0.0,
9436+ 0.0,
9437+ 1.0,
9438+ 0.0,
9439+ 0.0,
9440+ 0.0
9441+ ]
9442+ },
9443+ "ctl_replace_donor_fewshot|sham_map|L25": {
9444+ "accuracy": 0.03125,
9445+ "gain_vs_zero": {
9446+ "estimate": -0.0625,
9447+ "low": -0.1875,
9448+ "high": 0.0625,
9449+ "level": 0.95,
9450+ "n_items": 32,
9451+ "n_clusters": 32,
9452+ "n_boot": 2000
9453+ },
9454+ "outputs_sample": [
9455+ " happy\n",
9456+ " arrive\n\n",
9457+ " bright\n",
9458+ " \"aCML\"\n\n",
9459+ " over\n"
9460+ ],
9461+ "correct": [
9462+ 0.0,
9463+ 0.0,
9464+ 0.0,
9465+ 0.0,
9466+ 0.0,
9467+ 0.0,
9468+ 0.0,
9469+ 0.0,
9470+ 1.0,
9471+ 0.0,
9472+ 0.0,
9473+ 0.0,
9474+ 0.0,
9475+ 0.0,
9476+ 0.0,
9477+ 0.0,
9478+ 0.0,
9479+ 0.0,
9480+ 0.0,
9481+ 0.0,
9482+ 0.0,
9483+ 0.0,
9484+ 0.0,
9485+ 0.0,
9486+ 0.0,
9487+ 0.0,
9488+ 0.0,
9489+ 0.0,
9490+ 0.0,
9491+ 0.0,
9492+ 0.0,
9493+ 0.0
9494+ ]
9495+ },
9496+ "ctl_replace_donor_zeroshot|sham_map|L25": {
9497+ "accuracy": 0.0625,
9498+ "gain_vs_zero": {
9499+ "estimate": -0.03125,
9500+ "low": -0.15625,
9501+ "high": 0.0625,
9502+ "level": 0.95,
9503+ "n_items": 32,
9504+ "n_clusters": 32,
9505+ "n_boot": 2000
9506+ },
9507+ "outputs_sample": [
9508+ " 5\n\n",
9509+ " 1\n\n",
9510+ " The word \"bright\" is",
9511+ " The word \"calm\"",
9512+ " The word \"over\" is"
9513+ ],
9514+ "correct": [
9515+ 0.0,
9516+ 0.0,
9517+ 0.0,
9518+ 0.0,
9519+ 0.0,
9520+ 0.0,
9521+ 0.0,
9522+ 0.0,
9523+ 0.0,
9524+ 0.0,
9525+ 0.0,
9526+ 0.0,
9527+ 0.0,
9528+ 0.0,
9529+ 0.0,
9530+ 1.0,
9531+ 0.0,
9532+ 0.0,
9533+ 0.0,
9534+ 1.0,
9535+ 0.0,
9536+ 0.0,
9537+ 0.0,
9538+ 0.0,
9539+ 0.0,
9540+ 0.0,
9541+ 0.0,
9542+ 0.0,
9543+ 0.0,
9544+ 0.0,
9545+ 0.0,
9546+ 0.0
9547+ ]
9548+ },
9549+ "ctl_replace_donor_fewshot_shuffled_query|sham_map|L25": {
9550+ "accuracy": 0.0625,
9551+ "gain_vs_zero": {
9552+ "estimate": -0.03125,
9553+ "low": -0.125,
9554+ "high": 0.0625,
9555+ "level": 0.95,
9556+ "n_items": 32,
9557+ "n_clusters": 32,
9558+ "n_boot": 2000
9559+ },
9560+ "outputs_sample": [
9561+ " happy\n",
9562+ " arrive\n\n",
9563+ " bright\n",
9564+ " \"aCML\"\n",
9565+ " 5\n\n"
9566+ ],
9567+ "correct": [
9568+ 0.0,
9569+ 0.0,
9570+ 0.0,
9571+ 0.0,
9572+ 0.0,
9573+ 0.0,
9574+ 0.0,
9575+ 0.0,
9576+ 1.0,
9577+ 0.0,
9578+ 0.0,
9579+ 0.0,
9580+ 0.0,
9581+ 0.0,
9582+ 0.0,
9583+ 0.0,
9584+ 0.0,
9585+ 0.0,
9586+ 0.0,
9587+ 1.0,
9588+ 0.0,
9589+ 0.0,
9590+ 0.0,
9591+ 0.0,
9592+ 0.0,
9593+ 0.0,
9594+ 0.0,
9595+ 0.0,
9596+ 0.0,
9597+ 0.0,
9598+ 0.0,
9599+ 0.0
9600+ ]
9601+ },
9602+ "ctl_random_norm_matched|L25": {
9603+ "accuracy": 0.03125,
9604+ "gain_vs_zero": {
9605+ "estimate": -0.0625,
9606+ "low": -0.15625,
9607+ "high": 0.0,
9608+ "level": 0.95,
9609+ "n_items": 32,
9610+ "n_clusters": 32,
9611+ "n_boot": 2000
9612+ },
9613+ "correct": [
9614+ 0.0,
9615+ 0.0,
9616+ 0.0,
9617+ 0.0,
9618+ 0.0,
9619+ 0.0,
9620+ 0.0,
9621+ 0.0,
9622+ 0.0,
9623+ 0.0,
9624+ 0.0,
9625+ 0.0,
9626+ 0.0,
9627+ 0.0,
9628+ 0.0,
9629+ 0.0,
9630+ 0.0,
9631+ 1.0,
9632+ 0.0,
9633+ 0.0,
9634+ 0.0,
9635+ 0.0,
9636+ 0.0,
9637+ 0.0,
9638+ 0.0,
9639+ 0.0,
9640+ 0.0,
9641+ 0.0,
9642+ 0.0,
9643+ 0.0,
9644+ 0.0,
9645+ 0.0
9646+ ]
9647+ },
9648+ "ctl_unrelated_task_vector(capital)|L25": {
9649+ "accuracy": 0.40625,
9650+ "gain_vs_zero": {
9651+ "estimate": 0.3125,
9652+ "low": 0.15625,
9653+ "high": 0.46875,
9654+ "level": 0.95,
9655+ "n_items": 32,
9656+ "n_clusters": 32,
9657+ "n_boot": 2000
9658+ },
9659+ "correct": [
9660+ 0.0,
9661+ 0.0,
9662+ 0.0,
9663+ 0.0,
9664+ 1.0,
9665+ 0.0,
9666+ 1.0,
9667+ 0.0,
9668+ 1.0,
9669+ 0.0,
9670+ 0.0,
9671+ 1.0,
9672+ 0.0,
9673+ 0.0,
9674+ 1.0,
9675+ 1.0,
9676+ 1.0,
9677+ 1.0,
9678+ 1.0,
9679+ 1.0,
9680+ 0.0,
9681+ 0.0,
9682+ 0.0,
9683+ 1.0,
9684+ 1.0,
9685+ 0.0,
9686+ 0.0,
9687+ 0.0,
9688+ 1.0,
9689+ 0.0,
9690+ 0.0,
9691+ 0.0
9692+ ]
9693+ }
9694+ },
9695+ "items": {
9696+ "zero": [
9697+ 0.0,
9698+ 0.0,
9699+ 0.0,
9700+ 0.0,
9701+ 0.0,
9702+ 0.0,
9703+ 0.0,
9704+ 0.0,
9705+ 0.0,
9706+ 0.0,
9707+ 0.0,
9708+ 1.0,
9709+ 0.0,
9710+ 0.0,
9711+ 0.0,
9712+ 0.0,
9713+ 0.0,
9714+ 1.0,
9715+ 0.0,
9716+ 1.0,
9717+ 0.0,
9718+ 0.0,
9719+ 0.0,
9720+ 0.0,
9721+ 0.0,
9722+ 0.0,
9723+ 0.0,
9724+ 0.0,
9725+ 0.0,
9726+ 0.0,
9727+ 0.0,
9728+ 0.0
9729+ ],
9730+ "few": [
9731+ 1.0,
9732+ 1.0,
9733+ 1.0,
9734+ 0.0,
9735+ 1.0,
9736+ 1.0,
9737+ 1.0,
9738+ 1.0,
9739+ 1.0,
9740+ 1.0,
9741+ 1.0,
9742+ 1.0,
9743+ 1.0,
9744+ 1.0,
9745+ 1.0,
9746+ 1.0,
9747+ 1.0,
9748+ 1.0,
9749+ 1.0,
9750+ 1.0,
9751+ 1.0,
9752+ 1.0,
9753+ 0.0,
9754+ 1.0,
9755+ 1.0,
9756+ 1.0,
9757+ 1.0,
9758+ 1.0,
9759+ 1.0,
9760+ 1.0,
9761+ 1.0,
9762+ 1.0
9763+ ],
9764+ "own": [
9765+ 1.0,
9766+ 0.0,
9767+ 1.0,
9768+ 0.0,
9769+ 1.0,
9770+ 1.0,
9771+ 1.0,
9772+ 1.0,
9773+ 1.0,
9774+ 1.0,
9775+ 1.0,
9776+ 1.0,
9777+ 1.0,
9778+ 1.0,
9779+ 1.0,
9780+ 1.0,
9781+ 0.0,
9782+ 1.0,
9783+ 1.0,
9784+ 1.0,
9785+ 1.0,
9786+ 1.0,
9787+ 1.0,
9788+ 1.0,
9789+ 1.0,
9790+ 1.0,
9791+ 1.0,
9792+ 1.0,
9793+ 1.0,
9794+ 1.0,
9795+ 1.0,
9796+ 1.0
9797+ ]
9798+ }
9799+ },
9800+ "capital": {
9801+ "recipient_zero": 0.13636363636363635,
9802+ "recipient_few": 1.0,
9803+ "recipient_own_vector": 0.8181818181818182,
9804+ "donor_layer": 22,
9805+ "conditions": {
9806+ "procrustes|L25|a1.0": {
9807+ "accuracy": 0.6818181818181818,
9808+ "gain_vs_zero": {
9809+ "estimate": 0.5454545454545454,
9810+ "low": 0.3181818181818182,
9811+ "high": 0.7727272727272727,
9812+ "level": 0.95,
9813+ "n_items": 22,
9814+ "n_clusters": 22,
9815+ "n_boot": 2000
9816+ },
9817+ "mapped_norm": 41.208099365234375,
9818+ "outputs_sample": [
9819+ " Caracas\n",
9820+ " Finland is a Nordic country located",
9821+ " Casablanca\n\n",
9822+ " Turkey is a country located in",
9823+ " Tokyo\n\n"
9824+ ],
9825+ "correct": [
9826+ 1.0,
9827+ 0.0,
9828+ 0.0,
9829+ 0.0,
9830+ 1.0,
9831+ 0.0,
9832+ 1.0,
9833+ 1.0,
9834+ 0.0,
9835+ 1.0,
9836+ 1.0,
9837+ 1.0,
9838+ 1.0,
9839+ 1.0,
9840+ 1.0,
9841+ 1.0,
9842+ 0.0,
9843+ 1.0,
9844+ 0.0,
9845+ 1.0,
9846+ 1.0,
9847+ 1.0
9848+ ]
9849+ },
9850+ "procrustes|L25|a2.0": {
9851+ "accuracy": 0.6363636363636364,
9852+ "gain_vs_zero": {
9853+ "estimate": 0.5,
9854+ "low": 0.2727272727272727,
9855+ "high": 0.6818181818181818,
9856+ "level": 0.95,
9857+ "n_items": 22,
9858+ "n_clusters": 22,
9859+ "n_boot": 2000
9860+ },
9861+ "mapped_norm": 41.208099365234375,
9862+ "outputs_sample": [
9863+ " Venezuela is a country located in",
9864+ " Finland\n",
9865+ " Casablanca\n",
9866+ " Turkey is a country located in",
9867+ " Tokyo\n"
9868+ ],
9869+ "correct": [
9870+ 0.0,
9871+ 0.0,
9872+ 0.0,
9873+ 0.0,
9874+ 1.0,
9875+ 0.0,
9876+ 1.0,
9877+ 1.0,
9878+ 0.0,
9879+ 1.0,
9880+ 1.0,
9881+ 1.0,
9882+ 1.0,
9883+ 1.0,
9884+ 1.0,
9885+ 1.0,
9886+ 0.0,
9887+ 1.0,
9888+ 0.0,
9889+ 1.0,
9890+ 1.0,
9891+ 1.0
9892+ ]
9893+ },
9894+ "procrustes_rescaled|L25|a1.0": {
9895+ "accuracy": 0.6363636363636364,
9896+ "gain_vs_zero": {
9897+ "estimate": 0.5,
9898+ "low": 0.2727272727272727,
9899+ "high": 0.6818181818181818,
9900+ "level": 0.95,
9901+ "n_items": 22,
9902+ "n_clusters": 22,
9903+ "n_boot": 2000
9904+ },
9905+ "mapped_norm": 56.58632278442383,
9906+ "outputs_sample": [
9907+ " Venezuela is a country located in",
9908+ " Finland is a Nordic country located",
9909+ " Casablanca\n",
9910+ " Turkey is a country located in",
9911+ " Tokyo\n\n"
9912+ ],
9913+ "correct": [
9914+ 0.0,
9915+ 0.0,
9916+ 0.0,
9917+ 0.0,
9918+ 1.0,
9919+ 0.0,
9920+ 1.0,
9921+ 1.0,
9922+ 0.0,
9923+ 1.0,
9924+ 1.0,
9925+ 1.0,
9926+ 1.0,
9927+ 1.0,
9928+ 1.0,
9929+ 1.0,
9930+ 0.0,
9931+ 1.0,
9932+ 0.0,
9933+ 1.0,
9934+ 1.0,
9935+ 1.0
9936+ ]
9937+ },
9938+ "ridge|L25|a1.0": {
9939+ "accuracy": 0.45454545454545453,
9940+ "gain_vs_zero": {
9941+ "estimate": 0.3181818181818182,
9942+ "low": 0.09090909090909091,
9943+ "high": 0.5454545454545454,
9944+ "level": 0.95,
9945+ "n_items": 22,
9946+ "n_clusters": 22,
9947+ "n_boot": 2000
9948+ },
9949+ "mapped_norm": 69.26692962646484,
9950+ "outputs_sample": [
9951+ " Caracas\n\n",
9952+ " Finland\n",
9953+ " Casablanca\n\n",
9954+ " Turkey\n",
9955+ " Tokyo\n\n"
9956+ ],
9957+ "correct": [
9958+ 1.0,
9959+ 0.0,
9960+ 0.0,
9961+ 0.0,
9962+ 1.0,
9963+ 0.0,
9964+ 1.0,
9965+ 0.0,
9966+ 0.0,
9967+ 0.0,
9968+ 1.0,
9969+ 1.0,
9970+ 1.0,
9971+ 0.0,
9972+ 0.0,
9973+ 0.0,
9974+ 0.0,
9975+ 1.0,
9976+ 0.0,
9977+ 1.0,
9978+ 1.0,
9979+ 1.0
9980+ ]
9981+ },
9982+ "ridge|L25|a2.0": {
9983+ "accuracy": 0.045454545454545456,
9984+ "gain_vs_zero": {
9985+ "estimate": -0.09090909090909091,
9986+ "low": -0.2727272727272727,
9987+ "high": 0.09090909090909091,
9988+ "level": 0.95,
9989+ "n_items": 22,
9990+ "n_clusters": 22,
9991+ "n_boot": 2000
9992+ },
9993+ "mapped_norm": 69.26692962646484,
9994+ "outputs_sample": [
9995+ " Country\n",
9996+ " Country\n",
9997+ " Indica\n",
9998+ " Turkey is a country located in",
9999+ " Japan\n"
10000+ ],
10001+ "correct": [
10002+ 0.0,
10003+ 0.0,
10004+ 0.0,
10005+ 0.0,
10006+ 0.0,
10007+ 0.0,
10008+ 0.0,
10009+ 0.0,
10010+ 0.0,
10011+ 0.0,
10012+ 0.0,
10013+ 0.0,
10014+ 0.0,
10015+ 0.0,
10016+ 0.0,
10017+ 0.0,
10018+ 0.0,
10019+ 0.0,
10020+ 0.0,
10021+ 1.0,
10022+ 0.0,
10023+ 0.0
10024+ ]
10025+ },
10026+ "ridge_rescaled|L25|a1.0": {
10027+ "accuracy": 0.5454545454545454,
10028+ "gain_vs_zero": {
10029+ "estimate": 0.4090909090909091,
10030+ "low": 0.22727272727272727,
10031+ "high": 0.6363636363636364,
10032+ "level": 0.95,
10033+ "n_items": 22,
10034+ "n_clusters": 22,
10035+ "n_boot": 2000
10036+ },
10037+ "mapped_norm": 56.586326599121094,
10038+ "outputs_sample": [
10039+ " Caracas\n\n",
10040+ " Finland\n",
10041+ " Casablanca\n\n",
10042+ " Istanbul, Ankara, Izmir",
10043+ " Tokyo\n\n"
10044+ ],
10045+ "correct": [
10046+ 1.0,
10047+ 0.0,
10048+ 0.0,
10049+ 0.0,
10050+ 1.0,
10051+ 0.0,
10052+ 1.0,
10053+ 1.0,
10054+ 0.0,
10055+ 0.0,
10056+ 1.0,
10057+ 1.0,
10058+ 1.0,
10059+ 1.0,
10060+ 0.0,
10061+ 0.0,
10062+ 0.0,
10063+ 1.0,
10064+ 0.0,
10065+ 1.0,
10066+ 1.0,
10067+ 1.0
10068+ ]
10069+ },
10070+ "cca|L25|a1.0": {
10071+ "accuracy": 0.5454545454545454,
10072+ "gain_vs_zero": {
10073+ "estimate": 0.4090909090909091,
10074+ "low": 0.18181818181818182,
10075+ "high": 0.6363636363636364,
10076+ "level": 0.95,
10077+ "n_items": 22,
10078+ "n_clusters": 22,
10079+ "n_boot": 2000
10080+ },
10081+ "mapped_norm": 76.77274322509766,
10082+ "outputs_sample": [
10083+ " Caracas\n\n",
10084+ " Finland\n",
10085+ " Casablanca\n\n",
10086+ " Turkey is a country located in",
10087+ " Tokyo\n\n"
10088+ ],
10089+ "correct": [
10090+ 1.0,
10091+ 0.0,
10092+ 0.0,
10093+ 0.0,
10094+ 1.0,
10095+ 0.0,
10096+ 1.0,
10097+ 0.0,
10098+ 0.0,
10099+ 1.0,
10100+ 1.0,
10101+ 1.0,
10102+ 1.0,
10103+ 1.0,
10104+ 0.0,
10105+ 0.0,
10106+ 0.0,
10107+ 1.0,
10108+ 0.0,
10109+ 1.0,
10110+ 1.0,
10111+ 1.0
10112+ ]
10113+ },
10114+ "cca|L25|a2.0": {
10115+ "accuracy": 0.0,
10116+ "gain_vs_zero": {
10117+ "estimate": -0.13636363636363635,
10118+ "low": -0.2727272727272727,
10119+ "high": 0.0,
10120+ "level": 0.95,
10121+ "n_items": 22,
10122+ "n_clusters": 22,
10123+ "n_boot": 2000
10124+ },
10125+ "mapped_norm": 76.77274322509766,
10126+ "outputs_sample": [
10127+ " Country\n",
10128+ " Country\n",
10129+ " Country\n",
10130+ " Turkey is a country located in",
10131+ " Japan is an island nation in"
10132+ ],
10133+ "correct": [
10134+ 0.0,
10135+ 0.0,
10136+ 0.0,
10137+ 0.0,
10138+ 0.0,
10139+ 0.0,
10140+ 0.0,
10141+ 0.0,
10142+ 0.0,
10143+ 0.0,
10144+ 0.0,
10145+ 0.0,
10146+ 0.0,
10147+ 0.0,
10148+ 0.0,
10149+ 0.0,
10150+ 0.0,
10151+ 0.0,
10152+ 0.0,
10153+ 0.0,
10154+ 0.0,
10155+ 0.0
10156+ ]
10157+ },
10158+ "random_orth|L25|a1.0": {
10159+ "accuracy": 0.045454545454545456,
10160+ "gain_vs_zero": {
10161+ "estimate": -0.09090909090909091,
10162+ "low": -0.2727272727272727,
10163+ "high": 0.09090909090909091,
10164+ "level": 0.95,
10165+ "n_items": 22,
10166+ "n_clusters": 22,
10167+ "n_boot": 2000
10168+ },
10169+ "mapped_norm": 49.92599868774414,
10170+ "outputs_sample": [
10171+ " Venezuela\n\n",
10172+ " 5.9 (in",
10173+ " Morocco\n\n",
10174+ " Turkey is a country located in",
10175+ " Japan is an island nation in"
10176+ ],
10177+ "correct": [
10178+ 0.0,
10179+ 0.0,
10180+ 0.0,
10181+ 0.0,
10182+ 0.0,
10183+ 0.0,
10184+ 0.0,
10185+ 0.0,
10186+ 0.0,
10187+ 0.0,
10188+ 0.0,
10189+ 0.0,
10190+ 0.0,
10191+ 0.0,
10192+ 1.0,
10193+ 0.0,
10194+ 0.0,
10195+ 0.0,
10196+ 0.0,
10197+ 0.0,
10198+ 0.0,
10199+ 0.0
10200+ ]
10201+ },
10202+ "random_orth|L25|a2.0": {
10203+ "accuracy": 0.0,
10204+ "gain_vs_zero": {
10205+ "estimate": -0.13636363636363635,
10206+ "low": -0.2727272727272727,
10207+ "high": 0.0,
10208+ "level": 0.95,
10209+ "n_items": 22,
10210+ "n_clusters": 22,
10211+ "n_boot": 2000
10212+ },
10213+ "mapped_norm": 49.92599868774414,
10214+ "outputs_sample": [
10215+ " Venezuela is a country located in",
10216+ " Finland\n",
10217+ " Morocco\n",
10218+ " Turkey is a country located in",
10219+ " Japan is an island nation in"
10220+ ],
10221+ "correct": [
10222+ 0.0,
10223+ 0.0,
10224+ 0.0,
10225+ 0.0,
10226+ 0.0,
10227+ 0.0,
10228+ 0.0,
10229+ 0.0,
10230+ 0.0,
10231+ 0.0,
10232+ 0.0,
10233+ 0.0,
10234+ 0.0,
10235+ 0.0,
10236+ 0.0,
10237+ 0.0,
10238+ 0.0,
10239+ 0.0,
10240+ 0.0,
10241+ 0.0,
10242+ 0.0,
10243+ 0.0
10244+ ]
10245+ },
10246+ "replace_donor_fewshot|procrustes|L25": {
10247+ "accuracy": 0.18181818181818182,
10248+ "gain_vs_zero": {
10249+ "estimate": 0.045454545454545456,
10250+ "low": -0.18181818181818182,
10251+ "high": 0.2727272727272727,
10252+ "level": 0.95,
10253+ "n_items": 22,
10254+ "n_clusters": 22,
10255+ "n_boot": 2000
10256+ },
10257+ "outputs_sample": [
10258+ " Caracas\n\n",
10259+ " The capital of Finland is Helsinki",
10260+ " Morocco\n",
10261+ " Turkey is a country located in",
10262+ " Tokyo\n\n"
10263+ ],
10264+ "correct": [
10265+ 1.0,
10266+ 0.0,
10267+ 0.0,
10268+ 0.0,
10269+ 1.0,
10270+ 0.0,
10271+ 0.0,
10272+ 0.0,
10273+ 0.0,
10274+ 0.0,
10275+ 0.0,
10276+ 0.0,
10277+ 0.0,
10278+ 1.0,
10279+ 0.0,
10280+ 0.0,
10281+ 0.0,
10282+ 0.0,
10283+ 0.0,
10284+ 0.0,
10285+ 0.0,
10286+ 1.0
10287+ ]
10288+ },
10289+ "ctl_replace_donor_zeroshot|procrustes|L25": {
10290+ "accuracy": 0.0,
10291+ "gain_vs_zero": {
10292+ "estimate": -0.13636363636363635,
10293+ "low": -0.2727272727272727,
10294+ "high": 0.0,
10295+ "level": 0.95,
10296+ "n_items": 22,
10297+ "n_clusters": 22,
10298+ "n_boot": 2000
10299+ },
10300+ "outputs_sample": [
10301+ " The capital of Venezuela is Car",
10302+ " Finland is a Nordic country located",
10303+ " Morocco is a country located in",
10304+ " Turkey is a country located in",
10305+ " Japan is an island nation in"
10306+ ],
10307+ "correct": [
10308+ 0.0,
10309+ 0.0,
10310+ 0.0,
10311+ 0.0,
10312+ 0.0,
10313+ 0.0,
10314+ 0.0,
10315+ 0.0,
10316+ 0.0,
10317+ 0.0,
10318+ 0.0,
10319+ 0.0,
10320+ 0.0,
10321+ 0.0,
10322+ 0.0,
10323+ 0.0,
10324+ 0.0,
10325+ 0.0,
10326+ 0.0,
10327+ 0.0,
10328+ 0.0,
10329+ 0.0
10330+ ]
10331+ },
10332+ "ctl_replace_donor_fewshot_shuffled_query|procrustes|L25": {
10333+ "accuracy": 0.2727272727272727,
10334+ "gain_vs_zero": {
10335+ "estimate": 0.13636363636363635,
10336+ "low": -0.09090909090909091,
10337+ "high": 0.36363636363636365,
10338+ "level": 0.95,
10339+ "n_items": 22,
10340+ "n_clusters": 22,
10341+ "n_boot": 2000
10342+ },
10343+ "outputs_sample": [
10344+ " Venezuela is a country located in",
10345+ " Finland is a Nordic country located",
10346+ " Morocco is a country located in",
10347+ " Istanbul, Ankara, Izmir",
10348+ " Japan is an island nation in"
10349+ ],
10350+ "correct": [
10351+ 0.0,
10352+ 0.0,
10353+ 0.0,
10354+ 0.0,
10355+ 0.0,
10356+ 0.0,
10357+ 0.0,
10358+ 0.0,
10359+ 0.0,
10360+ 0.0,
10361+ 1.0,
10362+ 1.0,
10363+ 0.0,
10364+ 1.0,
10365+ 1.0,
10366+ 0.0,
10367+ 0.0,
10368+ 0.0,
10369+ 0.0,
10370+ 0.0,
10371+ 1.0,
10372+ 1.0
10373+ ]
10374+ },
10375+ "replace_donor_fewshot|ridge|L25": {
10376+ "accuracy": 0.13636363636363635,
10377+ "gain_vs_zero": {
10378+ "estimate": 0.0,
10379+ "low": -0.22727272727272727,
10380+ "high": 0.22727272727272727,
10381+ "level": 0.95,
10382+ "n_items": 22,
10383+ "n_clusters": 22,
10384+ "n_boot": 2000
10385+ },
10386+ "outputs_sample": [
10387+ " Caracas\n\n",
10388+ " \"Finland\"\n",
10389+ " Morocco\n",
10390+ " Turkey is a country located in",
10391+ " Tokyo\n\n"
10392+ ],
10393+ "correct": [
10394+ 1.0,
10395+ 0.0,
10396+ 0.0,
10397+ 0.0,
10398+ 1.0,
10399+ 0.0,
10400+ 0.0,
10401+ 0.0,
10402+ 0.0,
10403+ 0.0,
10404+ 0.0,
10405+ 0.0,
10406+ 0.0,
10407+ 0.0,
10408+ 0.0,
10409+ 0.0,
10410+ 0.0,
10411+ 0.0,
10412+ 0.0,
10413+ 0.0,
10414+ 0.0,
10415+ 1.0
10416+ ]
10417+ },
10418+ "ctl_replace_donor_zeroshot|ridge|L25": {
10419+ "accuracy": 0.0,
10420+ "gain_vs_zero": {
10421+ "estimate": -0.13636363636363635,
10422+ "low": -0.2727272727272727,
10423+ "high": 0.0,
10424+ "level": 0.95,
10425+ "n_items": 22,
10426+ "n_clusters": 22,
10427+ "n_boot": 2000
10428+ },
10429+ "outputs_sample": [
10430+ " Venezuela is a country located in",
10431+ " The capital of Finland is Helsinki",
10432+ " Morocco\n",
10433+ " 1\n\n",
10434+ " Japan is an island nation located"
10435+ ],
10436+ "correct": [
10437+ 0.0,
10438+ 0.0,
10439+ 0.0,
10440+ 0.0,
10441+ 0.0,
10442+ 0.0,
10443+ 0.0,
10444+ 0.0,
10445+ 0.0,
10446+ 0.0,
10447+ 0.0,
10448+ 0.0,
10449+ 0.0,
10450+ 0.0,
10451+ 0.0,
10452+ 0.0,
10453+ 0.0,
10454+ 0.0,
10455+ 0.0,
10456+ 0.0,
10457+ 0.0,
10458+ 0.0
10459+ ]
10460+ },
10461+ "ctl_replace_donor_fewshot_shuffled_query|ridge|L25": {
10462+ "accuracy": 0.045454545454545456,
10463+ "gain_vs_zero": {
10464+ "estimate": -0.09090909090909091,
10465+ "low": -0.2727272727272727,
10466+ "high": 0.09090909090909091,
10467+ "level": 0.95,
10468+ "n_items": 22,
10469+ "n_clusters": 22,
10470+ "n_boot": 2000
10471+ },
10472+ "outputs_sample": [
10473+ " Venezuela\n",
10474+ " The capital of Finland is Helsinki",
10475+ " \"Morocco\"\n",
10476+ " Turkey is a country located in",
10477+ " Japan\n"
10478+ ],
10479+ "correct": [
10480+ 0.0,
10481+ 0.0,
10482+ 0.0,
10483+ 0.0,
10484+ 0.0,
10485+ 0.0,
10486+ 0.0,
10487+ 0.0,
10488+ 0.0,
10489+ 0.0,
10490+ 0.0,
10491+ 0.0,
10492+ 0.0,
10493+ 0.0,
10494+ 0.0,
10495+ 0.0,
10496+ 1.0,
10497+ 0.0,
10498+ 0.0,
10499+ 0.0,
10500+ 0.0,
10501+ 0.0
10502+ ]
10503+ },
10504+ "ctl_replace_donor_fewshot|sham_map|L25": {
10505+ "accuracy": 0.0,
10506+ "gain_vs_zero": {
10507+ "estimate": -0.13636363636363635,
10508+ "low": -0.2727272727272727,
10509+ "high": 0.0,
10510+ "level": 0.95,
10511+ "n_items": 22,
10512+ "n_clusters": 22,
10513+ "n_boot": 2000
10514+ },
10515+ "outputs_sample": [
10516+ " Venezuela is a country located in",
10517+ " Finland is a Nordic country located",
10518+ " Morocco\n",
10519+ " Turkey is a country located in",
10520+ " Japan is an island nation in"
10521+ ],
10522+ "correct": [
10523+ 0.0,
10524+ 0.0,
10525+ 0.0,
10526+ 0.0,
10527+ 0.0,
10528+ 0.0,
10529+ 0.0,
10530+ 0.0,
10531+ 0.0,
10532+ 0.0,
10533+ 0.0,
10534+ 0.0,
10535+ 0.0,
10536+ 0.0,
10537+ 0.0,
10538+ 0.0,
10539+ 0.0,
10540+ 0.0,
10541+ 0.0,
10542+ 0.0,
10543+ 0.0,
10544+ 0.0
10545+ ]
10546+ },
10547+ "ctl_replace_donor_zeroshot|sham_map|L25": {
10548+ "accuracy": 0.0,
10549+ "gain_vs_zero": {
10550+ "estimate": -0.13636363636363635,
10551+ "low": -0.2727272727272727,
10552+ "high": 0.0,
10553+ "level": 0.95,
10554+ "n_items": 22,
10555+ "n_clusters": 22,
10556+ "n_boot": 2000
10557+ },
10558+ "outputs_sample": [
10559+ " The capital of Venezuela is Car",
10560+ " The capital of Finland is Helsinki",
10561+ " The capital of Morocco is Rab",
10562+ " 100\n\n",
10563+ " The capital of Japan is Tokyo"
10564+ ],
10565+ "correct": [
10566+ 0.0,
10567+ 0.0,
10568+ 0.0,
10569+ 0.0,
10570+ 0.0,
10571+ 0.0,
10572+ 0.0,
10573+ 0.0,
10574+ 0.0,
10575+ 0.0,
10576+ 0.0,
10577+ 0.0,
10578+ 0.0,
10579+ 0.0,
10580+ 0.0,
10581+ 0.0,
10582+ 0.0,
10583+ 0.0,
10584+ 0.0,
10585+ 0.0,
10586+ 0.0,
10587+ 0.0
10588+ ]
10589+ },
10590+ "ctl_replace_donor_fewshot_shuffled_query|sham_map|L25": {
10591+ "accuracy": 0.0,
10592+ "gain_vs_zero": {
10593+ "estimate": -0.13636363636363635,
10594+ "low": -0.2727272727272727,
10595+ "high": 0.0,
10596+ "level": 0.95,
10597+ "n_items": 22,
10598+ "n_clusters": 22,
10599+ "n_boot": 2000
10600+ },
10601+ "outputs_sample": [
10602+ " Venezuela is a country located in",
10603+ " Finland is a Nordic country located",
10604+ " Morocco is a country located in",
10605+ " Turkey is a country located in",
10606+ " Japan is an island nation in"
10607+ ],
10608+ "correct": [
10609+ 0.0,
10610+ 0.0,
10611+ 0.0,
10612+ 0.0,
10613+ 0.0,
10614+ 0.0,
10615+ 0.0,
10616+ 0.0,
10617+ 0.0,
10618+ 0.0,
10619+ 0.0,
10620+ 0.0,
10621+ 0.0,
10622+ 0.0,
10623+ 0.0,
10624+ 0.0,
10625+ 0.0,
10626+ 0.0,
10627+ 0.0,
10628+ 0.0,
10629+ 0.0,
10630+ 0.0
10631+ ]
10632+ },
10633+ "ctl_random_norm_matched|L25": {
10634+ "accuracy": 0.0,
10635+ "gain_vs_zero": {
10636+ "estimate": -0.13636363636363635,
10637+ "low": -0.2727272727272727,
10638+ "high": 0.0,
10639+ "level": 0.95,
10640+ "n_items": 22,
10641+ "n_clusters": 22,
10642+ "n_boot": 2000
10643+ },
10644+ "correct": [
10645+ 0.0,
10646+ 0.0,
10647+ 0.0,
10648+ 0.0,
10649+ 0.0,
10650+ 0.0,
10651+ 0.0,
10652+ 0.0,
10653+ 0.0,
10654+ 0.0,
10655+ 0.0,
10656+ 0.0,
10657+ 0.0,
10658+ 0.0,
10659+ 0.0,
10660+ 0.0,
10661+ 0.0,
10662+ 0.0,
10663+ 0.0,
10664+ 0.0,
10665+ 0.0,
10666+ 0.0
10667+ ]
10668+ },
10669+ "ctl_unrelated_task_vector(antonym)|L25": {
10670+ "accuracy": 0.09090909090909091,
10671+ "gain_vs_zero": {
10672+ "estimate": -0.045454545454545456,
10673+ "low": -0.18295454545454345,
10674+ "high": 0.09090909090909091,
10675+ "level": 0.95,
10676+ "n_items": 22,
10677+ "n_clusters": 22,
10678+ "n_boot": 2000
10679+ },
10680+ "correct": [
10681+ 0.0,
10682+ 0.0,
10683+ 0.0,
10684+ 0.0,
10685+ 0.0,
10686+ 0.0,
10687+ 1.0,
10688+ 0.0,
10689+ 0.0,
10690+ 0.0,
10691+ 0.0,
10692+ 0.0,
10693+ 0.0,
10694+ 0.0,
10695+ 0.0,
10696+ 0.0,
10697+ 0.0,
10698+ 0.0,
10699+ 0.0,
10700+ 0.0,
10701+ 0.0,
10702+ 1.0
10703+ ]
10704+ },
10705+ "procrustes|L28|a1.0": {
10706+ "accuracy": 0.5454545454545454,
10707+ "gain_vs_zero": {
10708+ "estimate": 0.4090909090909091,
10709+ "low": 0.22727272727272727,
10710+ "high": 0.6363636363636364,
10711+ "level": 0.95,
10712+ "n_items": 22,
10713+ "n_clusters": 22,
10714+ "n_boot": 2000
10715+ },
10716+ "mapped_norm": 66.84456634521484,
10717+ "outputs_sample": [
10718+ " Caracas\n\n",
10719+ " Helsinki\n\n",
10720+ " Casablanca, Marr",
10721+ " Istanbul, Ankara, Izmir",
10722+ " Tokyo\n\n"
10723+ ],
10724+ "correct": [
10725+ 1.0,
10726+ 1.0,
10727+ 0.0,
10728+ 0.0,
10729+ 1.0,
10730+ 0.0,
10731+ 1.0,
10732+ 1.0,
10733+ 0.0,
10734+ 1.0,
10735+ 0.0,
10736+ 1.0,
10737+ 1.0,
10738+ 1.0,
10739+ 0.0,
10740+ 0.0,
10741+ 0.0,
10742+ 0.0,
10743+ 1.0,
10744+ 1.0,
10745+ 1.0,
10746+ 0.0
10747+ ]
10748+ },
10749+ "procrustes|L28|a2.0": {
10750+ "accuracy": 0.5454545454545454,
10751+ "gain_vs_zero": {
10752+ "estimate": 0.4090909090909091,
10753+ "low": 0.22727272727272727,
10754+ "high": 0.6363636363636364,
10755+ "level": 0.95,
10756+ "n_items": 22,
10757+ "n_clusters": 22,
10758+ "n_boot": 2000
10759+ },
10760+ "mapped_norm": 66.84456634521484,
10761+ "outputs_sample": [
10762+ " Caracas\n\n",
10763+ " Helsinki\n\n",
10764+ " Morocco is a country located in",
10765+ " Istanbul, Ankara, Izmir",
10766+ " Honshu, Kyoto,"
10767+ ],
10768+ "correct": [
10769+ 1.0,
10770+ 1.0,
10771+ 0.0,
10772+ 0.0,
10773+ 0.0,
10774+ 0.0,
10775+ 1.0,
10776+ 1.0,
10777+ 0.0,
10778+ 1.0,
10779+ 0.0,
10780+ 1.0,
10781+ 1.0,
10782+ 0.0,
10783+ 0.0,
10784+ 1.0,
10785+ 1.0,
10786+ 0.0,
10787+ 1.0,
10788+ 1.0,
10789+ 1.0,
10790+ 0.0
10791+ ]
10792+ },
10793+ "procrustes_rescaled|L28|a1.0": {
10794+ "accuracy": 0.5454545454545454,
10795+ "gain_vs_zero": {
10796+ "estimate": 0.4090909090909091,
10797+ "low": 0.22727272727272727,
10798+ "high": 0.6363636363636364,
10799+ "level": 0.95,
10800+ "n_items": 22,
10801+ "n_clusters": 22,
10802+ "n_boot": 2000
10803+ },
10804+ "mapped_norm": 56.586326599121094,
10805+ "outputs_sample": [
10806+ " Caracas\n\n",
10807+ " Helsinki\n\n",
10808+ " Casablanca, Marr",
10809+ " Istanbul, Ankara, Izmir",
10810+ " Tokyo\n\n"
10811+ ],
10812+ "correct": [
10813+ 1.0,
10814+ 1.0,
10815+ 0.0,
10816+ 0.0,
10817+ 1.0,
10818+ 0.0,
10819+ 1.0,
10820+ 1.0,
10821+ 0.0,
10822+ 1.0,
10823+ 0.0,
10824+ 1.0,
10825+ 1.0,
10826+ 0.0,
10827+ 0.0,
10828+ 0.0,
10829+ 0.0,
10830+ 0.0,
10831+ 1.0,
10832+ 1.0,
10833+ 1.0,
10834+ 1.0
10835+ ]
10836+ },
10837+ "ridge|L28|a1.0": {
10838+ "accuracy": 0.22727272727272727,
10839+ "gain_vs_zero": {
10840+ "estimate": 0.09090909090909091,
10841+ "low": -0.13636363636363635,
10842+ "high": 0.3181818181818182,
10843+ "level": 0.95,
10844+ "n_items": 22,
10845+ "n_clusters": 22,
10846+ "n_boot": 2000
10847+ },
10848+ "mapped_norm": 100.56741333007812,
10849+ "outputs_sample": [
10850+ " Caracas\n\n",
10851+ " city: None\n",
10852+ " Casablanca, Marr",
10853+ " Istanbul, Ankara, Izmir",
10854+ " city: null\n"
10855+ ],
10856+ "correct": [
10857+ 1.0,
10858+ 0.0,
10859+ 0.0,
10860+ 0.0,
10861+ 0.0,
10862+ 0.0,
10863+ 1.0,
10864+ 0.0,
10865+ 0.0,
10866+ 0.0,
10867+ 0.0,
10868+ 0.0,
10869+ 1.0,
10870+ 0.0,
10871+ 0.0,
10872+ 0.0,
10873+ 0.0,
10874+ 0.0,
10875+ 0.0,
10876+ 1.0,
10877+ 0.0,
10878+ 1.0
10879+ ]
10880+ },
10881+ "ridge|L28|a2.0": {
10882+ "accuracy": 0.0,
10883+ "gain_vs_zero": {
10884+ "estimate": -0.13636363636363635,
10885+ "low": -0.2727272727272727,
10886+ "high": 0.0,
10887+ "level": 0.95,
10888+ "n_items": 22,
10889+ "n_clusters": 22,
10890+ "n_boot": 2000
10891+ },
10892+ "mapped_norm": 100.56741333007812,
10893+ "outputs_sample": [
10894+ " city: Caracas\n",
10895+ " city: None\n",
10896+ " city: Casablanca",
10897+ " city: Ankara\n",
10898+ " city: null\n"
10899+ ],
10900+ "correct": [
10901+ 0.0,
10902+ 0.0,
10903+ 0.0,
10904+ 0.0,
10905+ 0.0,
10906+ 0.0,
10907+ 0.0,
10908+ 0.0,
10909+ 0.0,
10910+ 0.0,
10911+ 0.0,
10912+ 0.0,
10913+ 0.0,
10914+ 0.0,
10915+ 0.0,
10916+ 0.0,
10917+ 0.0,
10918+ 0.0,
10919+ 0.0,
10920+ 0.0,
10921+ 0.0,
10922+ 0.0
10923+ ]
10924+ },
10925+ "ridge_rescaled|L28|a1.0": {
10926+ "accuracy": 0.5,
10927+ "gain_vs_zero": {
10928+ "estimate": 0.36363636363636365,
10929+ "low": 0.18181818181818182,
10930+ "high": 0.5909090909090909,
10931+ "level": 0.95,
10932+ "n_items": 22,
10933+ "n_clusters": 22,
10934+ "n_boot": 2000
10935+ },
10936+ "mapped_norm": 56.586326599121094,
10937+ "outputs_sample": [
10938+ " Caracas\n\n",
10939+ " Capital: Helsinki\n",
10940+ " Casablanca, Marr",
10941+ " Istanbul, Ankara, Izmir",
10942+ " Tokyo\n\n"
10943+ ],
10944+ "correct": [
10945+ 1.0,
10946+ 0.0,
10947+ 0.0,
10948+ 0.0,
10949+ 1.0,
10950+ 0.0,
10951+ 1.0,
10952+ 1.0,
10953+ 0.0,
10954+ 1.0,
10955+ 1.0,
10956+ 1.0,
10957+ 1.0,
10958+ 0.0,
10959+ 0.0,
10960+ 0.0,
10961+ 0.0,
10962+ 0.0,
10963+ 0.0,
10964+ 1.0,
10965+ 1.0,
10966+ 1.0
10967+ ]
10968+ },
10969+ "cca|L28|a1.0": {
10970+ "accuracy": 0.18181818181818182,
10971+ "gain_vs_zero": {
10972+ "estimate": 0.045454545454545456,
10973+ "low": -0.18181818181818182,
10974+ "high": 0.2727272727272727,
10975+ "level": 0.95,
10976+ "n_items": 22,
10977+ "n_clusters": 22,
10978+ "n_boot": 2000
10979+ },
10980+ "mapped_norm": 113.17544555664062,
10981+ "outputs_sample": [
10982+ " Caracas\n\n",
10983+ " city: None\n",
10984+ " city: Casablanca",
10985+ " city: Ankara\n",
10986+ " city: null\n"
10987+ ],
10988+ "correct": [
10989+ 1.0,
10990+ 0.0,
10991+ 0.0,
10992+ 0.0,
10993+ 0.0,
10994+ 0.0,
10995+ 0.0,
10996+ 0.0,
10997+ 0.0,
10998+ 0.0,
10999+ 0.0,
11000+ 0.0,
11001+ 1.0,
11002+ 0.0,
11003+ 0.0,
11004+ 0.0,
11005+ 0.0,
11006+ 0.0,
11007+ 0.0,
11008+ 1.0,
11009+ 0.0,
11010+ 1.0
11011+ ]
11012+ },
11013+ "cca|L28|a2.0": {
11014+ "accuracy": 0.0,
11015+ "gain_vs_zero": {
11016+ "estimate": -0.13636363636363635,
11017+ "low": -0.2727272727272727,
11018+ "high": 0.0,
11019+ "level": 0.95,
11020+ "n_items": 22,
11021+ "n_clusters": 22,
11022+ "n_boot": 2000
11023+ },
11024+ "mapped_norm": 113.17544555664062,
11025+ "outputs_sample": [
11026+ " Bilingual\n",
11027+ " city: None\n",
11028+ " Belgrade\n\n",
11029+ " Belonging to the Afro",
11030+ " Buzhongri ("
11031+ ],
11032+ "correct": [
11033+ 0.0,
11034+ 0.0,
11035+ 0.0,
11036+ 0.0,
11037+ 0.0,
11038+ 0.0,
11039+ 0.0,
11040+ 0.0,
11041+ 0.0,
11042+ 0.0,
11043+ 0.0,
11044+ 0.0,
11045+ 0.0,
11046+ 0.0,
11047+ 0.0,
11048+ 0.0,
11049+ 0.0,
11050+ 0.0,
11051+ 0.0,
11052+ 0.0,
11053+ 0.0,
11054+ 0.0
11055+ ]
11056+ },
11057+ "random_orth|L28|a1.0": {
11058+ "accuracy": 0.0,
11059+ "gain_vs_zero": {
11060+ "estimate": -0.13636363636363635,
11061+ "low": -0.2727272727272727,
11062+ "high": 0.0,
11063+ "level": 0.95,
11064+ "n_items": 22,
11065+ "n_clusters": 22,
11066+ "n_boot": 2000
11067+ },
11068+ "mapped_norm": 78.93763732910156,
11069+ "outputs_sample": [
11070+ " #Venezuela\n\n",
11071+ " Finland is a Nordic country located",
11072+ " Morocco is a country located in",
11073+ " Turkey is a country located in",
11074+ " Japan is an island country in"
11075+ ],
11076+ "correct": [
11077+ 0.0,
11078+ 0.0,
11079+ 0.0,
11080+ 0.0,
11081+ 0.0,
11082+ 0.0,
11083+ 0.0,
11084+ 0.0,
11085+ 0.0,
11086+ 0.0,
11087+ 0.0,
11088+ 0.0,
11089+ 0.0,
11090+ 0.0,
11091+ 0.0,
11092+ 0.0,
11093+ 0.0,
11094+ 0.0,
11095+ 0.0,
11096+ 0.0,
11097+ 0.0,
11098+ 0.0
11099+ ]
11100+ },
11101+ "random_orth|L28|a2.0": {
11102+ "accuracy": 0.0,
11103+ "gain_vs_zero": {
11104+ "estimate": -0.13636363636363635,
11105+ "low": -0.2727272727272727,
11106+ "high": 0.0,
11107+ "level": 0.95,
11108+ "n_items": 22,
11109+ "n_clusters": 22,
11110+ "n_boot": 2000
11111+ },
11112+ "mapped_norm": 78.93763732910156,
11113+ "outputs_sample": [
11114+ " In 1958",
11115+ " In 2021",
11116+ " In the north, Morocco borders",
11117+ " In the year 19",
11118+ " In the year 18"
11119+ ],
11120+ "correct": [
11121+ 0.0,
11122+ 0.0,
11123+ 0.0,
11124+ 0.0,
11125+ 0.0,
11126+ 0.0,
11127+ 0.0,
11128+ 0.0,
11129+ 0.0,
11130+ 0.0,
11131+ 0.0,
11132+ 0.0,
11133+ 0.0,
11134+ 0.0,
11135+ 0.0,
11136+ 0.0,
11137+ 0.0,
11138+ 0.0,
11139+ 0.0,
11140+ 0.0,
11141+ 0.0,
11142+ 0.0
11143+ ]
11144+ },
11145+ "replace_donor_fewshot|procrustes|L28": {
11146+ "accuracy": 0.0,
11147+ "gain_vs_zero": {
11148+ "estimate": -0.13636363636363635,
11149+ "low": -0.2727272727272727,
11150+ "high": 0.0,
11151+ "level": 0.95,
11152+ "n_items": 22,
11153+ "n_clusters": 22,
11154+ "n_boot": 2000
11155+ },
11156+ "outputs_sample": [
11157+ " The capital of Venezuela is Car",
11158+ " Fin\n",
11159+ " Morocco is a country located in",
11160+ " Turkey is a country located in",
11161+ " Japan is an island nation in"
11162+ ],
11163+ "correct": [
11164+ 0.0,
11165+ 0.0,
11166+ 0.0,
11167+ 0.0,
11168+ 0.0,
11169+ 0.0,
11170+ 0.0,
11171+ 0.0,
11172+ 0.0,
11173+ 0.0,
11174+ 0.0,
11175+ 0.0,
11176+ 0.0,
11177+ 0.0,
11178+ 0.0,
11179+ 0.0,
11180+ 0.0,
11181+ 0.0,
11182+ 0.0,
11183+ 0.0,
11184+ 0.0,
11185+ 0.0
11186+ ]
11187+ },
11188+ "ctl_replace_donor_zeroshot|procrustes|L28": {
11189+ "accuracy": 0.0,
11190+ "gain_vs_zero": {
11191+ "estimate": -0.13636363636363635,
11192+ "low": -0.2727272727272727,
11193+ "high": 0.0,
11194+ "level": 0.95,
11195+ "n_items": 22,
11196+ "n_clusters": 22,
11197+ "n_boot": 2000
11198+ },
11199+ "outputs_sample": [
11200+ " The capital of Venezuela is Car",
11201+ " Finland is a Nordic country located",
11202+ " Morocco is a country located in",
11203+ " Turkey is a country located in",
11204+ " Japan is an island nation located"
11205+ ],
11206+ "correct": [
11207+ 0.0,
11208+ 0.0,
11209+ 0.0,
11210+ 0.0,
11211+ 0.0,
11212+ 0.0,
11213+ 0.0,
11214+ 0.0,
11215+ 0.0,
11216+ 0.0,
11217+ 0.0,
11218+ 0.0,
11219+ 0.0,
11220+ 0.0,
11221+ 0.0,
11222+ 0.0,
11223+ 0.0,
11224+ 0.0,
11225+ 0.0,
11226+ 0.0,
11227+ 0.0,
11228+ 0.0
11229+ ]
11230+ },
11231+ "ctl_replace_donor_fewshot_shuffled_query|procrustes|L28": {
11232+ "accuracy": 0.0,
11233+ "gain_vs_zero": {
11234+ "estimate": -0.13636363636363635,
11235+ "low": -0.2727272727272727,
11236+ "high": 0.0,
11237+ "level": 0.95,
11238+ "n_items": 22,
11239+ "n_clusters": 22,
11240+ "n_boot": 2000
11241+ },
11242+ "outputs_sample": [
11243+ " The capital of Venezuela is Car",
11244+ " The capital of Finland is Helsinki",
11245+ " Morocco is a country located in",
11246+ " Turkey is a country located in",
11247+ " Japan is an island nation in"
11248+ ],
11249+ "correct": [
11250+ 0.0,
11251+ 0.0,
11252+ 0.0,
11253+ 0.0,
11254+ 0.0,
11255+ 0.0,
11256+ 0.0,
11257+ 0.0,
11258+ 0.0,
11259+ 0.0,
11260+ 0.0,
11261+ 0.0,
11262+ 0.0,
11263+ 0.0,
11264+ 0.0,
11265+ 0.0,
11266+ 0.0,
11267+ 0.0,
11268+ 0.0,
11269+ 0.0,
11270+ 0.0,
11271+ 0.0
11272+ ]
11273+ },
11274+ "replace_donor_fewshot|ridge|L28": {
11275+ "accuracy": 0.0,
11276+ "gain_vs_zero": {
11277+ "estimate": -0.13636363636363635,
11278+ "low": -0.2727272727272727,
11279+ "high": 0.0,
11280+ "level": 0.95,
11281+ "n_items": 22,
11282+ "n_clusters": 22,
11283+ "n_boot": 2000
11284+ },
11285+ "outputs_sample": [
11286+ " city: Caracas\n",
11287+ " 5.99\n",
11288+ " what is the capital of Morocco",
11289+ " Not a country\n",
11290+ " None\n\n"
11291+ ],
11292+ "correct": [
11293+ 0.0,
11294+ 0.0,
11295+ 0.0,
11296+ 0.0,
11297+ 0.0,
11298+ 0.0,
11299+ 0.0,
11300+ 0.0,
11301+ 0.0,
11302+ 0.0,
11303+ 0.0,
11304+ 0.0,
11305+ 0.0,
11306+ 0.0,
11307+ 0.0,
11308+ 0.0,
11309+ 0.0,
11310+ 0.0,
11311+ 0.0,
11312+ 0.0,
11313+ 0.0,
11314+ 0.0
11315+ ]
11316+ },
11317+ "ctl_replace_donor_zeroshot|ridge|L28": {
11318+ "accuracy": 0.0,
11319+ "gain_vs_zero": {
11320+ "estimate": -0.13636363636363635,
11321+ "low": -0.2727272727272727,
11322+ "high": 0.0,
11323+ "level": 0.95,
11324+ "n_items": 22,
11325+ "n_clusters": 22,
11326+ "n_boot": 2000
11327+ },
11328+ "outputs_sample": [
11329+ " Venezuela is a country located in",
11330+ " 5.9 (Fin",
11331+ " Morocco is a country located in",
11332+ " 100\n\n",
11333+ " Japan is an island nation located"
11334+ ],
11335+ "correct": [
11336+ 0.0,
11337+ 0.0,
11338+ 0.0,
11339+ 0.0,
11340+ 0.0,
11341+ 0.0,
11342+ 0.0,
11343+ 0.0,
11344+ 0.0,
11345+ 0.0,
11346+ 0.0,
11347+ 0.0,
11348+ 0.0,
11349+ 0.0,
11350+ 0.0,
11351+ 0.0,
11352+ 0.0,
11353+ 0.0,
11354+ 0.0,
11355+ 0.0,
11356+ 0.0,
11357+ 0.0
11358+ ]
11359+ },
11360+ "ctl_replace_donor_fewshot_shuffled_query|ridge|L28": {
11361+ "accuracy": 0.0,
11362+ "gain_vs_zero": {
11363+ "estimate": -0.13636363636363635,
11364+ "low": -0.2727272727272727,
11365+ "high": 0.0,
11366+ "level": 0.95,
11367+ "n_items": 22,
11368+ "n_clusters": 22,
11369+ "n_boot": 2000
11370+ },
11371+ "outputs_sample": [
11372+ " what is happening in venezuela",
11373+ " [Finland, \"FI",
11374+ " Cannot be determined\n\n",
11375+ " None\n\n",
11376+ " Japan is an island nation in"
11377+ ],
11378+ "correct": [
11379+ 0.0,
11380+ 0.0,
11381+ 0.0,
11382+ 0.0,
11383+ 0.0,
11384+ 0.0,
11385+ 0.0,
11386+ 0.0,
11387+ 0.0,
11388+ 0.0,
11389+ 0.0,
11390+ 0.0,
11391+ 0.0,
11392+ 0.0,
11393+ 0.0,
11394+ 0.0,
11395+ 0.0,
11396+ 0.0,
11397+ 0.0,
11398+ 0.0,
11399+ 0.0,
11400+ 0.0
11401+ ]
11402+ },
11403+ "ctl_replace_donor_fewshot|sham_map|L28": {
11404+ "accuracy": 0.0,
11405+ "gain_vs_zero": {
11406+ "estimate": -0.13636363636363635,
11407+ "low": -0.2727272727272727,
11408+ "high": 0.0,
11409+ "level": 0.95,
11410+ "n_items": 22,
11411+ "n_clusters": 22,
11412+ "n_boot": 2000
11413+ },
11414+ "outputs_sample": [
11415+ " 28.7\n",
11416+ " The capital of Finland is Helsinki",
11417+ " 122\n",
11418+ " Turkey is a country located in",
11419+ " 126,9"
11420+ ],
11421+ "correct": [
11422+ 0.0,
11423+ 0.0,
11424+ 0.0,
11425+ 0.0,
11426+ 0.0,
11427+ 0.0,
11428+ 0.0,
11429+ 0.0,
11430+ 0.0,
11431+ 0.0,
11432+ 0.0,
11433+ 0.0,
11434+ 0.0,
11435+ 0.0,
11436+ 0.0,
11437+ 0.0,
11438+ 0.0,
11439+ 0.0,
11440+ 0.0,
11441+ 0.0,
11442+ 0.0,
11443+ 0.0
11444+ ]
11445+ },
11446+ "ctl_replace_donor_zeroshot|sham_map|L28": {
11447+ "accuracy": 0.0,
11448+ "gain_vs_zero": {
11449+ "estimate": -0.13636363636363635,
11450+ "low": -0.2727272727272727,
11451+ "high": 0.0,
11452+ "level": 0.95,
11453+ "n_items": 22,
11454+ "n_clusters": 22,
11455+ "n_boot": 2000
11456+ },
11457+ "outputs_sample": [
11458+ " The capital of Venezuela is Car",
11459+ " The capital of Finland is Helsinki",
11460+ " The capital of Morocco is Rab",
11461+ " The capital of Turkey is Ankara",
11462+ " The capital of Japan is Tokyo"
11463+ ],
11464+ "correct": [
11465+ 0.0,
11466+ 0.0,
11467+ 0.0,
11468+ 0.0,
11469+ 0.0,
11470+ 0.0,
11471+ 0.0,
11472+ 0.0,
11473+ 0.0,
11474+ 0.0,
11475+ 0.0,
11476+ 0.0,
11477+ 0.0,
11478+ 0.0,
11479+ 0.0,
11480+ 0.0,
11481+ 0.0,
11482+ 0.0,
11483+ 0.0,
11484+ 0.0,
11485+ 0.0,
11486+ 0.0
11487+ ]
11488+ },
11489+ "ctl_replace_donor_fewshot_shuffled_query|sham_map|L28": {
11490+ "accuracy": 0.0,
11491+ "gain_vs_zero": {
11492+ "estimate": -0.13636363636363635,
11493+ "low": -0.2727272727272727,
11494+ "high": 0.0,
11495+ "level": 0.95,
11496+ "n_items": 22,
11497+ "n_clusters": 22,
11498+ "n_boot": 2000
11499+ },
11500+ "outputs_sample": [
11501+ " The capital of Venezuela is Car",
11502+ " 5.96\n",
11503+ " The capital of Morocco is Rab",
11504+ " 100\n\n",
11505+ " Japan is an island nation located"
11506+ ],
11507+ "correct": [
11508+ 0.0,
11509+ 0.0,
11510+ 0.0,
11511+ 0.0,
11512+ 0.0,
11513+ 0.0,
11514+ 0.0,
11515+ 0.0,
11516+ 0.0,
11517+ 0.0,
11518+ 0.0,
11519+ 0.0,
11520+ 0.0,
11521+ 0.0,
11522+ 0.0,
11523+ 0.0,
11524+ 0.0,
11525+ 0.0,
11526+ 0.0,
11527+ 0.0,
11528+ 0.0,
11529+ 0.0
11530+ ]
11531+ },
11532+ "ctl_random_norm_matched|L28": {
11533+ "accuracy": 0.0,
11534+ "gain_vs_zero": {
11535+ "estimate": -0.13636363636363635,
11536+ "low": -0.2727272727272727,
11537+ "high": 0.0,
11538+ "level": 0.95,
11539+ "n_items": 22,
11540+ "n_clusters": 22,
11541+ "n_boot": 2000
11542+ },
11543+ "correct": [
11544+ 0.0,
11545+ 0.0,
11546+ 0.0,
11547+ 0.0,
11548+ 0.0,
11549+ 0.0,
11550+ 0.0,
11551+ 0.0,
11552+ 0.0,
11553+ 0.0,
11554+ 0.0,
11555+ 0.0,
11556+ 0.0,
11557+ 0.0,
11558+ 0.0,
11559+ 0.0,
11560+ 0.0,
11561+ 0.0,
11562+ 0.0,
11563+ 0.0,
11564+ 0.0,
11565+ 0.0
11566+ ]
11567+ },
11568+ "ctl_unrelated_task_vector(antonym)|L28": {
11569+ "accuracy": 0.18181818181818182,
11570+ "gain_vs_zero": {
11571+ "estimate": 0.045454545454545456,
11572+ "low": -0.09090909090909091,
11573+ "high": 0.18181818181818182,
11574+ "level": 0.95,
11575+ "n_items": 22,
11576+ "n_clusters": 22,
11577+ "n_boot": 2000
11578+ },
11579+ "correct": [
11580+ 0.0,
11581+ 0.0,
11582+ 0.0,
11583+ 0.0,
11584+ 0.0,
11585+ 0.0,
11586+ 1.0,
11587+ 0.0,
11588+ 0.0,
11589+ 0.0,
11590+ 0.0,
11591+ 0.0,
11592+ 1.0,
11593+ 0.0,
11594+ 0.0,
11595+ 0.0,
11596+ 0.0,
11597+ 0.0,
11598+ 0.0,
11599+ 0.0,
11600+ 1.0,
11601+ 1.0
11602+ ]
11603+ }
11604+ },
11605+ "items": {
11606+ "zero": [
11607+ 0.0,
11608+ 0.0,
11609+ 0.0,
11610+ 0.0,
11611+ 0.0,
11612+ 0.0,
11613+ 1.0,
11614+ 1.0,
11615+ 0.0,
11616+ 0.0,
11617+ 0.0,
11618+ 0.0,
11619+ 0.0,
11620+ 0.0,
11621+ 0.0,
11622+ 0.0,
11623+ 0.0,
11624+ 0.0,
11625+ 0.0,
11626+ 0.0,
11627+ 1.0,
11628+ 0.0
11629+ ],
11630+ "few": [
11631+ 1.0,
11632+ 1.0,
11633+ 1.0,
11634+ 1.0,
11635+ 1.0,
11636+ 1.0,
11637+ 1.0,
11638+ 1.0,
11639+ 1.0,
11640+ 1.0,
11641+ 1.0,
11642+ 1.0,
11643+ 1.0,
11644+ 1.0,
11645+ 1.0,
11646+ 1.0,
11647+ 1.0,
11648+ 1.0,
11649+ 1.0,
11650+ 1.0,
11651+ 1.0,
11652+ 1.0
11653+ ],
11654+ "own": [
11655+ 1.0,
11656+ 1.0,
11657+ 1.0,
11658+ 1.0,
11659+ 1.0,
11660+ 0.0,
11661+ 1.0,
11662+ 1.0,
11663+ 0.0,
11664+ 0.0,
11665+ 1.0,
11666+ 1.0,
11667+ 1.0,
11668+ 1.0,
11669+ 1.0,
11670+ 1.0,
11671+ 0.0,
11672+ 1.0,
11673+ 1.0,
11674+ 1.0,
11675+ 1.0,
11676+ 1.0
11677+ ]
11678+ }
11679+ },
11680+ "morph": {
11681+ "recipient_zero": 0.0,
11682+ "recipient_few": 0.4,
11683+ "recipient_own_vector": 0.0,
11684+ "donor_layer": 2,
11685+ "conditions": {
11686+ "procrustes|L2|a1.0": {
11687+ "accuracy": 0.0,
11688+ "gain_vs_zero": {
11689+ "estimate": 0.0,
11690+ "low": 0.0,
11691+ "high": 0.0,
11692+ "level": 0.95,
11693+ "n_items": 40,
11694+ "n_clusters": 40,
11695+ "n_boot": 2000
11696+ },
11697+ "mapped_norm": 5.777352333068848,
11698+ "outputs_sample": [
11699+ " The word \"zeni\"",
11700+ " 1\n",
11701+ " 0\n",
11702+ " 1\n",
11703+ " 1\n"
11704+ ],
11705+ "correct": [
11706+ 0.0,
11707+ 0.0,
11708+ 0.0,
11709+ 0.0,
11710+ 0.0,
11711+ 0.0,
11712+ 0.0,
11713+ 0.0,
11714+ 0.0,
11715+ 0.0,
11716+ 0.0,
11717+ 0.0,
11718+ 0.0,
11719+ 0.0,
11720+ 0.0,
11721+ 0.0,
11722+ 0.0,
11723+ 0.0,
11724+ 0.0,
11725+ 0.0,
11726+ 0.0,
11727+ 0.0,
11728+ 0.0,
11729+ 0.0,
11730+ 0.0,
11731+ 0.0,
11732+ 0.0,
11733+ 0.0,
11734+ 0.0,
11735+ 0.0,
11736+ 0.0,
11737+ 0.0,
11738+ 0.0,
11739+ 0.0,
11740+ 0.0,
11741+ 0.0,
11742+ 0.0,
11743+ 0.0,
11744+ 0.0,
11745+ 0.0
11746+ ]
11747+ },
11748+ "procrustes|L2|a2.0": {
11749+ "accuracy": 0.0,
11750+ "gain_vs_zero": {
11751+ "estimate": 0.0,
11752+ "low": 0.0,
11753+ "high": 0.0,
11754+ "level": 0.95,
11755+ "n_items": 40,
11756+ "n_clusters": 40,
11757+ "n_boot": 2000
11758+ },
11759+ "mapped_norm": 5.777352333068848,
11760+ "outputs_sample": [
11761+ " The word \"zeni\"",
11762+ " 1\n",
11763+ " 0\n",
11764+ " 1\n",
11765+ " False\n"
11766+ ],
11767+ "correct": [
11768+ 0.0,
11769+ 0.0,
11770+ 0.0,
11771+ 0.0,
11772+ 0.0,
11773+ 0.0,
11774+ 0.0,
11775+ 0.0,
11776+ 0.0,
11777+ 0.0,
11778+ 0.0,
11779+ 0.0,
11780+ 0.0,
11781+ 0.0,
11782+ 0.0,
11783+ 0.0,
11784+ 0.0,
11785+ 0.0,
11786+ 0.0,
11787+ 0.0,
11788+ 0.0,
11789+ 0.0,
11790+ 0.0,
11791+ 0.0,
11792+ 0.0,
11793+ 0.0,
11794+ 0.0,
11795+ 0.0,
11796+ 0.0,
11797+ 0.0,
11798+ 0.0,
11799+ 0.0,
11800+ 0.0,
11801+ 0.0,
11802+ 0.0,
11803+ 0.0,
11804+ 0.0,
11805+ 0.0,
11806+ 0.0,
11807+ 0.0
11808+ ]
11809+ },
11810+ "procrustes_rescaled|L2|a1.0": {
11811+ "accuracy": 0.0,
11812+ "gain_vs_zero": {
11813+ "estimate": 0.0,
11814+ "low": 0.0,
11815+ "high": 0.0,
11816+ "level": 0.95,
11817+ "n_items": 40,
11818+ "n_clusters": 40,
11819+ "n_boot": 2000
11820+ },
11821+ "mapped_norm": 6.1436028480529785,
11822+ "outputs_sample": [
11823+ " The word \"zeni\"",
11824+ " 1\n",
11825+ " 0\n",
11826+ " 1\n",
11827+ " 1\n"
11828+ ],
11829+ "correct": [
11830+ 0.0,
11831+ 0.0,
11832+ 0.0,
11833+ 0.0,
11834+ 0.0,
11835+ 0.0,
11836+ 0.0,
11837+ 0.0,
11838+ 0.0,
11839+ 0.0,
11840+ 0.0,
11841+ 0.0,
11842+ 0.0,
11843+ 0.0,
11844+ 0.0,
11845+ 0.0,
11846+ 0.0,
11847+ 0.0,
11848+ 0.0,
11849+ 0.0,
11850+ 0.0,
11851+ 0.0,
11852+ 0.0,
11853+ 0.0,
11854+ 0.0,
11855+ 0.0,
11856+ 0.0,
11857+ 0.0,
11858+ 0.0,
11859+ 0.0,
11860+ 0.0,
11861+ 0.0,
11862+ 0.0,
11863+ 0.0,
11864+ 0.0,
11865+ 0.0,
11866+ 0.0,
11867+ 0.0,
11868+ 0.0,
11869+ 0.0
11870+ ]
11871+ },
11872+ "ridge|L2|a1.0": {
11873+ "accuracy": 0.0,
11874+ "gain_vs_zero": {
11875+ "estimate": 0.0,
11876+ "low": 0.0,
11877+ "high": 0.0,
11878+ "level": 0.95,
11879+ "n_items": 40,
11880+ "n_clusters": 40,
11881+ "n_boot": 2000
11882+ },
11883+ "mapped_norm": 5.570345878601074,
11884+ "outputs_sample": [
11885+ " The word \"zeni\"",
11886+ " 1\n",
11887+ " 0\n",
11888+ " 1\n",
11889+ " False\n"
11890+ ],
11891+ "correct": [
11892+ 0.0,
11893+ 0.0,
11894+ 0.0,
11895+ 0.0,
11896+ 0.0,
11897+ 0.0,
11898+ 0.0,
11899+ 0.0,
11900+ 0.0,
11901+ 0.0,
11902+ 0.0,
11903+ 0.0,
11904+ 0.0,
11905+ 0.0,
11906+ 0.0,
11907+ 0.0,
11908+ 0.0,
11909+ 0.0,
11910+ 0.0,
11911+ 0.0,
11912+ 0.0,
11913+ 0.0,
11914+ 0.0,
11915+ 0.0,
11916+ 0.0,
11917+ 0.0,
11918+ 0.0,
11919+ 0.0,
11920+ 0.0,
11921+ 0.0,
11922+ 0.0,
11923+ 0.0,
11924+ 0.0,
11925+ 0.0,
11926+ 0.0,
11927+ 0.0,
11928+ 0.0,
11929+ 0.0,
11930+ 0.0,
11931+ 0.0
11932+ ]
11933+ },
11934+ "ridge|L2|a2.0": {
11935+ "accuracy": 0.0,
11936+ "gain_vs_zero": {
11937+ "estimate": 0.0,
11938+ "low": 0.0,
11939+ "high": 0.0,
11940+ "level": 0.95,
11941+ "n_items": 40,
11942+ "n_clusters": 40,
11943+ "n_boot": 2000
11944+ },
11945+ "mapped_norm": 5.570345878601074,
11946+ "outputs_sample": [
11947+ " The word \"zeni\"",
11948+ " 1\n",
11949+ " 1\n",
11950+ " 1\n",
11951+ " False\n"
11952+ ],
11953+ "correct": [
11954+ 0.0,
11955+ 0.0,
11956+ 0.0,
11957+ 0.0,
11958+ 0.0,
11959+ 0.0,
11960+ 0.0,
11961+ 0.0,
11962+ 0.0,
11963+ 0.0,
11964+ 0.0,
11965+ 0.0,
11966+ 0.0,
11967+ 0.0,
11968+ 0.0,
11969+ 0.0,
11970+ 0.0,
11971+ 0.0,
11972+ 0.0,
11973+ 0.0,
11974+ 0.0,
11975+ 0.0,
11976+ 0.0,
11977+ 0.0,
11978+ 0.0,
11979+ 0.0,
11980+ 0.0,
11981+ 0.0,
11982+ 0.0,
11983+ 0.0,
11984+ 0.0,
11985+ 0.0,
11986+ 0.0,
11987+ 0.0,
11988+ 0.0,
11989+ 0.0,
11990+ 0.0,
11991+ 0.0,
11992+ 0.0,
11993+ 0.0
11994+ ]
11995+ },
11996+ "ridge_rescaled|L2|a1.0": {
11997+ "accuracy": 0.0,
11998+ "gain_vs_zero": {
11999+ "estimate": 0.0,
12000+ "low": 0.0,
12001+ "high": 0.0,
12002+ "level": 0.95,
12003+ "n_items": 40,
12004+ "n_clusters": 40,
12005+ "n_boot": 2000
12006+ },
12007+ "mapped_norm": 6.1436028480529785,
12008+ "outputs_sample": [
12009+ " The word \"zeni\"",
12010+ " 1\n",
12011+ " 0\n",
12012+ " 1\n",
12013+ " False\n"
12014+ ],
12015+ "correct": [
12016+ 0.0,
12017+ 0.0,
12018+ 0.0,
12019+ 0.0,
12020+ 0.0,
12021+ 0.0,
12022+ 0.0,
12023+ 0.0,
12024+ 0.0,
12025+ 0.0,
12026+ 0.0,
12027+ 0.0,
12028+ 0.0,
12029+ 0.0,
12030+ 0.0,
12031+ 0.0,
12032+ 0.0,
12033+ 0.0,
12034+ 0.0,
12035+ 0.0,
12036+ 0.0,
12037+ 0.0,
12038+ 0.0,
12039+ 0.0,
12040+ 0.0,
12041+ 0.0,
12042+ 0.0,
12043+ 0.0,
12044+ 0.0,
12045+ 0.0,
12046+ 0.0,
12047+ 0.0,
12048+ 0.0,
12049+ 0.0,
12050+ 0.0,
12051+ 0.0,
12052+ 0.0,
12053+ 0.0,
12054+ 0.0,
12055+ 0.0
12056+ ]
12057+ },
12058+ "cca|L2|a1.0": {
12059+ "accuracy": 0.0,
12060+ "gain_vs_zero": {
12061+ "estimate": 0.0,
12062+ "low": 0.0,
12063+ "high": 0.0,
12064+ "level": 0.95,
12065+ "n_items": 40,
12066+ "n_clusters": 40,
12067+ "n_boot": 2000
12068+ },
12069+ "mapped_norm": 5.701407432556152,
12070+ "outputs_sample": [
12071+ " The word \"zeni\"",
12072+ " 1\n",
12073+ " 1\n",
12074+ " 1\n",
12075+ " The word \"zute\""
12076+ ],
12077+ "correct": [
12078+ 0.0,
12079+ 0.0,
12080+ 0.0,
12081+ 0.0,
12082+ 0.0,
12083+ 0.0,
12084+ 0.0,
12085+ 0.0,
12086+ 0.0,
12087+ 0.0,
12088+ 0.0,
12089+ 0.0,
12090+ 0.0,
12091+ 0.0,
12092+ 0.0,
12093+ 0.0,
12094+ 0.0,
12095+ 0.0,
12096+ 0.0,
12097+ 0.0,
12098+ 0.0,
12099+ 0.0,
12100+ 0.0,
12101+ 0.0,
12102+ 0.0,
12103+ 0.0,
12104+ 0.0,
12105+ 0.0,
12106+ 0.0,
12107+ 0.0,
12108+ 0.0,
12109+ 0.0,
12110+ 0.0,
12111+ 0.0,
12112+ 0.0,
12113+ 0.0,
12114+ 0.0,
12115+ 0.0,
12116+ 0.0,
12117+ 0.0
12118+ ]
12119+ },
12120+ "cca|L2|a2.0": {
12121+ "accuracy": 0.0,
12122+ "gain_vs_zero": {
12123+ "estimate": 0.0,
12124+ "low": 0.0,
12125+ "high": 0.0,
12126+ "level": 0.95,
12127+ "n_items": 40,
12128+ "n_clusters": 40,
12129+ "n_boot": 2000
12130+ },
12131+ "mapped_norm": 5.701407432556152,
12132+ "outputs_sample": [
12133+ " The word \"zeni\"",
12134+ " 1\n",
12135+ " 1\n",
12136+ " 1\n",
12137+ " False\n"
12138+ ],
12139+ "correct": [
12140+ 0.0,
12141+ 0.0,
12142+ 0.0,
12143+ 0.0,
12144+ 0.0,
12145+ 0.0,
12146+ 0.0,
12147+ 0.0,
12148+ 0.0,
12149+ 0.0,
12150+ 0.0,
12151+ 0.0,
12152+ 0.0,
12153+ 0.0,
12154+ 0.0,
12155+ 0.0,
12156+ 0.0,
12157+ 0.0,
12158+ 0.0,
12159+ 0.0,
12160+ 0.0,
12161+ 0.0,
12162+ 0.0,
12163+ 0.0,
12164+ 0.0,
12165+ 0.0,
12166+ 0.0,
12167+ 0.0,
12168+ 0.0,
12169+ 0.0,
12170+ 0.0,
12171+ 0.0,
12172+ 0.0,
12173+ 0.0,
12174+ 0.0,
12175+ 0.0,
12176+ 0.0,
12177+ 0.0,
12178+ 0.0,
12179+ 0.0
12180+ ]
12181+ },
12182+ "random_orth|L2|a1.0": {
12183+ "accuracy": 0.0,
12184+ "gain_vs_zero": {
12185+ "estimate": 0.0,
12186+ "low": 0.0,
12187+ "high": 0.0,
12188+ "level": 0.95,
12189+ "n_items": 40,
12190+ "n_clusters": 40,
12191+ "n_boot": 2000
12192+ },
12193+ "mapped_norm": 6.169764995574951,
12194+ "outputs_sample": [
12195+ " The word \"zeni\"",
12196+ " 1\n",
12197+ " 0\n",
12198+ " 1\n",
12199+ " The word \"zute\""
12200+ ],
12201+ "correct": [
12202+ 0.0,
12203+ 0.0,
12204+ 0.0,
12205+ 0.0,
12206+ 0.0,
12207+ 0.0,
12208+ 0.0,
12209+ 0.0,
12210+ 0.0,
12211+ 0.0,
12212+ 0.0,
12213+ 0.0,
12214+ 0.0,
12215+ 0.0,
12216+ 0.0,
12217+ 0.0,
12218+ 0.0,
12219+ 0.0,
12220+ 0.0,
12221+ 0.0,
12222+ 0.0,
12223+ 0.0,
12224+ 0.0,
12225+ 0.0,
12226+ 0.0,
12227+ 0.0,
12228+ 0.0,
12229+ 0.0,
12230+ 0.0,
12231+ 0.0,
12232+ 0.0,
12233+ 0.0,
12234+ 0.0,
12235+ 0.0,
12236+ 0.0,
12237+ 0.0,
12238+ 0.0,
12239+ 0.0,
12240+ 0.0,
12241+ 0.0
12242+ ]
12243+ },
12244+ "random_orth|L2|a2.0": {
12245+ "accuracy": 0.0,
12246+ "gain_vs_zero": {
12247+ "estimate": 0.0,
12248+ "low": 0.0,
12249+ "high": 0.0,
12250+ "level": 0.95,
12251+ "n_items": 40,
12252+ "n_clusters": 40,
12253+ "n_boot": 2000
12254+ },
12255+ "mapped_norm": 6.169764995574951,
12256+ "outputs_sample": [
12257+ " The word \"zeni\"",
12258+ " 1\n",
12259+ " 0\n",
12260+ " The word \"tuken\"",
12261+ " The word \"zute\""
12262+ ],
12263+ "correct": [
12264+ 0.0,
12265+ 0.0,
12266+ 0.0,
12267+ 0.0,
12268+ 0.0,
12269+ 0.0,
12270+ 0.0,
12271+ 0.0,
12272+ 0.0,
12273+ 0.0,
12274+ 0.0,
12275+ 0.0,
12276+ 0.0,
12277+ 0.0,
12278+ 0.0,
12279+ 0.0,
12280+ 0.0,
12281+ 0.0,
12282+ 0.0,
12283+ 0.0,
12284+ 0.0,
12285+ 0.0,
12286+ 0.0,
12287+ 0.0,
12288+ 0.0,
12289+ 0.0,
12290+ 0.0,
12291+ 0.0,
12292+ 0.0,
12293+ 0.0,
12294+ 0.0,
12295+ 0.0,
12296+ 0.0,
12297+ 0.0,
12298+ 0.0,
12299+ 0.0,
12300+ 0.0,
12301+ 0.0,
12302+ 0.0,
12303+ 0.0
12304+ ]
12305+ },
12306+ "replace_donor_fewshot|procrustes|L2": {
12307+ "accuracy": 0.0,
12308+ "gain_vs_zero": {
12309+ "estimate": 0.0,
12310+ "low": 0.0,
12311+ "high": 0.0,
12312+ "level": 0.95,
12313+ "n_items": 40,
12314+ "n_clusters": 40,
12315+ "n_boot": 2000
12316+ },
12317+ "outputs_sample": [
12318+ " The word \"zeni\"",
12319+ " 1\n",
12320+ " 0\n",
12321+ " 1\n",
12322+ " The word \"zute\""
12323+ ],
12324+ "correct": [
12325+ 0.0,
12326+ 0.0,
12327+ 0.0,
12328+ 0.0,
12329+ 0.0,
12330+ 0.0,
12331+ 0.0,
12332+ 0.0,
12333+ 0.0,
12334+ 0.0,
12335+ 0.0,
12336+ 0.0,
12337+ 0.0,
12338+ 0.0,
12339+ 0.0,
12340+ 0.0,
12341+ 0.0,
12342+ 0.0,
12343+ 0.0,
12344+ 0.0,
12345+ 0.0,
12346+ 0.0,
12347+ 0.0,
12348+ 0.0,
12349+ 0.0,
12350+ 0.0,
12351+ 0.0,
12352+ 0.0,
12353+ 0.0,
12354+ 0.0,
12355+ 0.0,
12356+ 0.0,
12357+ 0.0,
12358+ 0.0,
12359+ 0.0,
12360+ 0.0,
12361+ 0.0,
12362+ 0.0,
12363+ 0.0,
12364+ 0.0
12365+ ]
12366+ },
12367+ "ctl_replace_donor_zeroshot|procrustes|L2": {
12368+ "accuracy": 0.0,
12369+ "gain_vs_zero": {
12370+ "estimate": 0.0,
12371+ "low": 0.0,
12372+ "high": 0.0,
12373+ "level": 0.95,
12374+ "n_items": 40,
12375+ "n_clusters": 40,
12376+ "n_boot": 2000
12377+ },
12378+ "outputs_sample": [
12379+ " The word \"zeni\"",
12380+ " 1\n",
12381+ " The word \"vofisu",
12382+ " The word \"tuken\"",
12383+ " The word \"zute\""
12384+ ],
12385+ "correct": [
12386+ 0.0,
12387+ 0.0,
12388+ 0.0,
12389+ 0.0,
12390+ 0.0,
12391+ 0.0,
12392+ 0.0,
12393+ 0.0,
12394+ 0.0,
12395+ 0.0,
12396+ 0.0,
12397+ 0.0,
12398+ 0.0,
12399+ 0.0,
12400+ 0.0,
12401+ 0.0,
12402+ 0.0,
12403+ 0.0,
12404+ 0.0,
12405+ 0.0,
12406+ 0.0,
12407+ 0.0,
12408+ 0.0,
12409+ 0.0,
12410+ 0.0,
12411+ 0.0,
12412+ 0.0,
12413+ 0.0,
12414+ 0.0,
12415+ 0.0,
12416+ 0.0,
12417+ 0.0,
12418+ 0.0,
12419+ 0.0,
12420+ 0.0,
12421+ 0.0,
12422+ 0.0,
12423+ 0.0,
12424+ 0.0,
12425+ 0.0
12426+ ]
12427+ },
12428+ "ctl_replace_donor_fewshot_shuffled_query|procrustes|L2": {
12429+ "accuracy": 0.0,
12430+ "gain_vs_zero": {
12431+ "estimate": 0.0,
12432+ "low": 0.0,
12433+ "high": 0.0,
12434+ "level": 0.95,
12435+ "n_items": 40,
12436+ "n_clusters": 40,
12437+ "n_boot": 2000
12438+ },
12439+ "outputs_sample": [
12440+ " The word \"zeni\"",
12441+ " 1\n",
12442+ " 0\n",
12443+ " 1\n",
12444+ " The word \"zute\""
12445+ ],
12446+ "correct": [
12447+ 0.0,
12448+ 0.0,
12449+ 0.0,
12450+ 0.0,
12451+ 0.0,
12452+ 0.0,
12453+ 0.0,
12454+ 0.0,
12455+ 0.0,
12456+ 0.0,
12457+ 0.0,
12458+ 0.0,
12459+ 0.0,
12460+ 0.0,
12461+ 0.0,
12462+ 0.0,
12463+ 0.0,
12464+ 0.0,
12465+ 0.0,
12466+ 0.0,
12467+ 0.0,
12468+ 0.0,
12469+ 0.0,
12470+ 0.0,
12471+ 0.0,
12472+ 0.0,
12473+ 0.0,
12474+ 0.0,
12475+ 0.0,
12476+ 0.0,
12477+ 0.0,
12478+ 0.0,
12479+ 0.0,
12480+ 0.0,
12481+ 0.0,
12482+ 0.0,
12483+ 0.0,
12484+ 0.0,
12485+ 0.0,
12486+ 0.0
12487+ ]
12488+ },
12489+ "replace_donor_fewshot|ridge|L2": {
12490+ "accuracy": 0.0,
12491+ "gain_vs_zero": {
12492+ "estimate": 0.0,
12493+ "low": 0.0,
12494+ "high": 0.0,
12495+ "level": 0.95,
12496+ "n_items": 40,
12497+ "n_clusters": 40,
12498+ "n_boot": 2000
12499+ },
12500+ "outputs_sample": [
12501+ " The word \"zeni\"",
12502+ " 1\n",
12503+ " 0\n",
12504+ " 1\n",
12505+ " The word \"zute\""
12506+ ],
12507+ "correct": [
12508+ 0.0,
12509+ 0.0,
12510+ 0.0,
12511+ 0.0,
12512+ 0.0,
12513+ 0.0,
12514+ 0.0,
12515+ 0.0,
12516+ 0.0,
12517+ 0.0,
12518+ 0.0,
12519+ 0.0,
12520+ 0.0,
12521+ 0.0,
12522+ 0.0,
12523+ 0.0,
12524+ 0.0,
12525+ 0.0,
12526+ 0.0,
12527+ 0.0,
12528+ 0.0,
12529+ 0.0,
12530+ 0.0,
12531+ 0.0,
12532+ 0.0,
12533+ 0.0,
12534+ 0.0,
12535+ 0.0,
12536+ 0.0,
12537+ 0.0,
12538+ 0.0,
12539+ 0.0,
12540+ 0.0,
12541+ 0.0,
12542+ 0.0,
12543+ 0.0,
12544+ 0.0,
12545+ 0.0,
12546+ 0.0,
12547+ 0.0
12548+ ]
12549+ },
12550+ "ctl_replace_donor_zeroshot|ridge|L2": {
12551+ "accuracy": 0.0,
12552+ "gain_vs_zero": {
12553+ "estimate": 0.0,
12554+ "low": 0.0,
12555+ "high": 0.0,
12556+ "level": 0.95,
12557+ "n_items": 40,
12558+ "n_clusters": 40,
12559+ "n_boot": 2000
12560+ },
12561+ "outputs_sample": [
12562+ " The word \"zeni\"",
12563+ " 1\n",
12564+ " The word \"vofisu",
12565+ " The word \"tuken\"",
12566+ " The word \"zute\""
12567+ ],
12568+ "correct": [
12569+ 0.0,
12570+ 0.0,
12571+ 0.0,
12572+ 0.0,
12573+ 0.0,
12574+ 0.0,
12575+ 0.0,
12576+ 0.0,
12577+ 0.0,
12578+ 0.0,
12579+ 0.0,
12580+ 0.0,
12581+ 0.0,
12582+ 0.0,
12583+ 0.0,
12584+ 0.0,
12585+ 0.0,
12586+ 0.0,
12587+ 0.0,
12588+ 0.0,
12589+ 0.0,
12590+ 0.0,
12591+ 0.0,
12592+ 0.0,
12593+ 0.0,
12594+ 0.0,
12595+ 0.0,
12596+ 0.0,
12597+ 0.0,
12598+ 0.0,
12599+ 0.0,
12600+ 0.0,
12601+ 0.0,
12602+ 0.0,
12603+ 0.0,
12604+ 0.0,
12605+ 0.0,
12606+ 0.0,
12607+ 0.0,
12608+ 0.0
12609+ ]
12610+ },
12611+ "ctl_replace_donor_fewshot_shuffled_query|ridge|L2": {
12612+ "accuracy": 0.0,
12613+ "gain_vs_zero": {
12614+ "estimate": 0.0,
12615+ "low": 0.0,
12616+ "high": 0.0,
12617+ "level": 0.95,
12618+ "n_items": 40,
12619+ "n_clusters": 40,
12620+ "n_boot": 2000
12621+ },
12622+ "outputs_sample": [
12623+ " The word \"zeni\"",
12624+ " 1\n",
12625+ " 0\n",
12626+ " 1\n",
12627+ " False\n"
12628+ ],
12629+ "correct": [
12630+ 0.0,
12631+ 0.0,
12632+ 0.0,
12633+ 0.0,
12634+ 0.0,
12635+ 0.0,
12636+ 0.0,
12637+ 0.0,
12638+ 0.0,
12639+ 0.0,
12640+ 0.0,
12641+ 0.0,
12642+ 0.0,
12643+ 0.0,
12644+ 0.0,
12645+ 0.0,
12646+ 0.0,
12647+ 0.0,
12648+ 0.0,
12649+ 0.0,
12650+ 0.0,
12651+ 0.0,
12652+ 0.0,
12653+ 0.0,
12654+ 0.0,
12655+ 0.0,
12656+ 0.0,
12657+ 0.0,
12658+ 0.0,
12659+ 0.0,
12660+ 0.0,
12661+ 0.0,
12662+ 0.0,
12663+ 0.0,
12664+ 0.0,
12665+ 0.0,
12666+ 0.0,
12667+ 0.0,
12668+ 0.0,
12669+ 0.0
12670+ ]
12671+ },
12672+ "ctl_replace_donor_fewshot|sham_map|L2": {
12673+ "accuracy": 0.0,
12674+ "gain_vs_zero": {
12675+ "estimate": 0.0,
12676+ "low": 0.0,
12677+ "high": 0.0,
12678+ "level": 0.95,
12679+ "n_items": 40,
12680+ "n_clusters": 40,
12681+ "n_boot": 2000
12682+ },
12683+ "outputs_sample": [
12684+ " The word \"zeni\"",
12685+ " 0\n",
12686+ " 0\n",
12687+ " 1\n",
12688+ " The word \"zute\""
12689+ ],
12690+ "correct": [
12691+ 0.0,
12692+ 0.0,
12693+ 0.0,
12694+ 0.0,
12695+ 0.0,
12696+ 0.0,
12697+ 0.0,
12698+ 0.0,
12699+ 0.0,
12700+ 0.0,
12701+ 0.0,
12702+ 0.0,
12703+ 0.0,
12704+ 0.0,
12705+ 0.0,
12706+ 0.0,
12707+ 0.0,
12708+ 0.0,
12709+ 0.0,
12710+ 0.0,
12711+ 0.0,
12712+ 0.0,
12713+ 0.0,
12714+ 0.0,
12715+ 0.0,
12716+ 0.0,
12717+ 0.0,
12718+ 0.0,
12719+ 0.0,
12720+ 0.0,
12721+ 0.0,
12722+ 0.0,
12723+ 0.0,
12724+ 0.0,
12725+ 0.0,
12726+ 0.0,
12727+ 0.0,
12728+ 0.0,
12729+ 0.0,
12730+ 0.0
12731+ ]
12732+ },
12733+ "ctl_replace_donor_zeroshot|sham_map|L2": {
12734+ "accuracy": 0.0,
12735+ "gain_vs_zero": {
12736+ "estimate": 0.0,
12737+ "low": 0.0,
12738+ "high": 0.0,
12739+ "level": 0.95,
12740+ "n_items": 40,
12741+ "n_clusters": 40,
12742+ "n_boot": 2000
12743+ },
12744+ "outputs_sample": [
12745+ " The word \"zeni\"",
12746+ " 1\n",
12747+ " 0\n",
12748+ " 1\n",
12749+ " The word \"zute\""
12750+ ],
12751+ "correct": [
12752+ 0.0,
12753+ 0.0,
12754+ 0.0,
12755+ 0.0,
12756+ 0.0,
12757+ 0.0,
12758+ 0.0,
12759+ 0.0,
12760+ 0.0,
12761+ 0.0,
12762+ 0.0,
12763+ 0.0,
12764+ 0.0,
12765+ 0.0,
12766+ 0.0,
12767+ 0.0,
12768+ 0.0,
12769+ 0.0,
12770+ 0.0,
12771+ 0.0,
12772+ 0.0,
12773+ 0.0,
12774+ 0.0,
12775+ 0.0,
12776+ 0.0,
12777+ 0.0,
12778+ 0.0,
12779+ 0.0,
12780+ 0.0,
12781+ 0.0,
12782+ 0.0,
12783+ 0.0,
12784+ 0.0,
12785+ 0.0,
12786+ 0.0,
12787+ 0.0,
12788+ 0.0,
12789+ 0.0,
12790+ 0.0,
12791+ 0.0
12792+ ]
12793+ },
12794+ "ctl_replace_donor_fewshot_shuffled_query|sham_map|L2": {
12795+ "accuracy": 0.0,
12796+ "gain_vs_zero": {
12797+ "estimate": 0.0,
12798+ "low": 0.0,
12799+ "high": 0.0,
12800+ "level": 0.95,
12801+ "n_items": 40,
12802+ "n_clusters": 40,
12803+ "n_boot": 2000
12804+ },
12805+ "outputs_sample": [
12806+ " The word \"zeni\"",
12807+ " 1\n",
12808+ " 0\n",
12809+ " 1\n",
12810+ " The word \"zute\""
12811+ ],
12812+ "correct": [
12813+ 0.0,
12814+ 0.0,
12815+ 0.0,
12816+ 0.0,
12817+ 0.0,
12818+ 0.0,
12819+ 0.0,
12820+ 0.0,
12821+ 0.0,
12822+ 0.0,
12823+ 0.0,
12824+ 0.0,
12825+ 0.0,
12826+ 0.0,
12827+ 0.0,
12828+ 0.0,
12829+ 0.0,
12830+ 0.0,
12831+ 0.0,
12832+ 0.0,
12833+ 0.0,
12834+ 0.0,
12835+ 0.0,
12836+ 0.0,
12837+ 0.0,
12838+ 0.0,
12839+ 0.0,
12840+ 0.0,
12841+ 0.0,
12842+ 0.0,
12843+ 0.0,
12844+ 0.0,
12845+ 0.0,
12846+ 0.0,
12847+ 0.0,
12848+ 0.0,
12849+ 0.0,
12850+ 0.0,
12851+ 0.0,
12852+ 0.0
12853+ ]
12854+ },
12855+ "ctl_random_norm_matched|L2": {
12856+ "accuracy": 0.0,
12857+ "gain_vs_zero": {
12858+ "estimate": 0.0,
12859+ "low": 0.0,
12860+ "high": 0.0,
12861+ "level": 0.95,
12862+ "n_items": 40,
12863+ "n_clusters": 40,
12864+ "n_boot": 2000
12865+ },
12866+ "correct": [
12867+ 0.0,
12868+ 0.0,
12869+ 0.0,
12870+ 0.0,
12871+ 0.0,
12872+ 0.0,
12873+ 0.0,
12874+ 0.0,
12875+ 0.0,
12876+ 0.0,
12877+ 0.0,
12878+ 0.0,
12879+ 0.0,
12880+ 0.0,
12881+ 0.0,
12882+ 0.0,
12883+ 0.0,
12884+ 0.0,
12885+ 0.0,
12886+ 0.0,
12887+ 0.0,
12888+ 0.0,
12889+ 0.0,
12890+ 0.0,
12891+ 0.0,
12892+ 0.0,
12893+ 0.0,
12894+ 0.0,
12895+ 0.0,
12896+ 0.0,
12897+ 0.0,
12898+ 0.0,
12899+ 0.0,
12900+ 0.0,
12901+ 0.0,
12902+ 0.0,
12903+ 0.0,
12904+ 0.0,
12905+ 0.0,
12906+ 0.0
12907+ ]
12908+ },
12909+ "ctl_unrelated_task_vector(antonym)|L2": {
12910+ "accuracy": 0.0,
12911+ "gain_vs_zero": {
12912+ "estimate": 0.0,
12913+ "low": 0.0,
12914+ "high": 0.0,
12915+ "level": 0.95,
12916+ "n_items": 40,
12917+ "n_clusters": 40,
12918+ "n_boot": 2000
12919+ },
12920+ "correct": [
12921+ 0.0,
12922+ 0.0,
12923+ 0.0,
12924+ 0.0,
12925+ 0.0,
12926+ 0.0,
12927+ 0.0,
12928+ 0.0,
12929+ 0.0,
12930+ 0.0,
12931+ 0.0,
12932+ 0.0,
12933+ 0.0,
12934+ 0.0,
12935+ 0.0,
12936+ 0.0,
12937+ 0.0,
12938+ 0.0,
12939+ 0.0,
12940+ 0.0,
12941+ 0.0,
12942+ 0.0,
12943+ 0.0,
12944+ 0.0,
12945+ 0.0,
12946+ 0.0,
12947+ 0.0,
12948+ 0.0,
12949+ 0.0,
12950+ 0.0,
12951+ 0.0,
12952+ 0.0,
12953+ 0.0,
12954+ 0.0,
12955+ 0.0,
12956+ 0.0,
12957+ 0.0,
12958+ 0.0,
12959+ 0.0,
12960+ 0.0
12961+ ]
12962+ },
12963+ "procrustes|L3|a1.0": {
12964+ "accuracy": 0.0,
12965+ "gain_vs_zero": {
12966+ "estimate": 0.0,
12967+ "low": 0.0,
12968+ "high": 0.0,
12969+ "level": 0.95,
12970+ "n_items": 40,
12971+ "n_clusters": 40,
12972+ "n_boot": 2000
12973+ },
12974+ "mapped_norm": 9.104889869689941,
12975+ "outputs_sample": [
12976+ " The word \"zeni\"",
12977+ " 1\n",
12978+ " 1\n",
12979+ " 1\n",
12980+ " The word \"zute\""
12981+ ],
12982+ "correct": [
12983+ 0.0,
12984+ 0.0,
12985+ 0.0,
12986+ 0.0,
12987+ 0.0,
12988+ 0.0,
12989+ 0.0,
12990+ 0.0,
12991+ 0.0,
12992+ 0.0,
12993+ 0.0,
12994+ 0.0,
12995+ 0.0,
12996+ 0.0,
12997+ 0.0,
12998+ 0.0,
12999+ 0.0,
13000+ 0.0,
13001+ 0.0,
13002+ 0.0,
13003+ 0.0,
13004+ 0.0,
13005+ 0.0,
13006+ 0.0,
13007+ 0.0,
13008+ 0.0,
13009+ 0.0,
13010+ 0.0,
13011+ 0.0,
13012+ 0.0,
13013+ 0.0,
13014+ 0.0,
13015+ 0.0,
13016+ 0.0,
13017+ 0.0,
13018+ 0.0,
13019+ 0.0,
13020+ 0.0,
13021+ 0.0,
13022+ 0.0
13023+ ]
13024+ },
13025+ "procrustes|L3|a2.0": {
13026+ "accuracy": 0.0,
13027+ "gain_vs_zero": {
13028+ "estimate": 0.0,
13029+ "low": 0.0,
13030+ "high": 0.0,
13031+ "level": 0.95,
13032+ "n_items": 40,
13033+ "n_clusters": 40,
13034+ "n_boot": 2000
13035+ },
13036+ "mapped_norm": 9.104889869689941,
13037+ "outputs_sample": [
13038+ " The word \"zeni\"",
13039+ " 1\n",
13040+ " 0\n",
13041+ " 1\n",
13042+ " False\n"
13043+ ],
13044+ "correct": [
13045+ 0.0,
13046+ 0.0,
13047+ 0.0,
13048+ 0.0,
13049+ 0.0,
13050+ 0.0,
13051+ 0.0,
13052+ 0.0,
13053+ 0.0,
13054+ 0.0,
13055+ 0.0,
13056+ 0.0,
13057+ 0.0,
13058+ 0.0,
13059+ 0.0,
13060+ 0.0,
13061+ 0.0,
13062+ 0.0,
13063+ 0.0,
13064+ 0.0,
13065+ 0.0,
13066+ 0.0,
13067+ 0.0,
13068+ 0.0,
13069+ 0.0,
13070+ 0.0,
13071+ 0.0,
13072+ 0.0,
13073+ 0.0,
13074+ 0.0,
13075+ 0.0,
13076+ 0.0,
13077+ 0.0,
13078+ 0.0,
13079+ 0.0,
13080+ 0.0,
13081+ 0.0,
13082+ 0.0,
13083+ 0.0,
13084+ 0.0
13085+ ]
13086+ },
13087+ "procrustes_rescaled|L3|a1.0": {
13088+ "accuracy": 0.0,
13089+ "gain_vs_zero": {
13090+ "estimate": 0.0,
13091+ "low": 0.0,
13092+ "high": 0.0,
13093+ "level": 0.95,
13094+ "n_items": 40,
13095+ "n_clusters": 40,
13096+ "n_boot": 2000
13097+ },
13098+ "mapped_norm": 6.1436028480529785,
13099+ "outputs_sample": [
13100+ " The word \"zeni\"",
13101+ " 1\n",
13102+ " 0\n",
13103+ " 1\n",
13104+ " The word \"zute\""
13105+ ],
13106+ "correct": [
13107+ 0.0,
13108+ 0.0,
13109+ 0.0,
13110+ 0.0,
13111+ 0.0,
13112+ 0.0,
13113+ 0.0,
13114+ 0.0,
13115+ 0.0,
13116+ 0.0,
13117+ 0.0,
13118+ 0.0,
13119+ 0.0,
13120+ 0.0,
13121+ 0.0,
13122+ 0.0,
13123+ 0.0,
13124+ 0.0,
13125+ 0.0,
13126+ 0.0,
13127+ 0.0,
13128+ 0.0,
13129+ 0.0,
13130+ 0.0,
13131+ 0.0,
13132+ 0.0,
13133+ 0.0,
13134+ 0.0,
13135+ 0.0,
13136+ 0.0,
13137+ 0.0,
13138+ 0.0,
13139+ 0.0,
13140+ 0.0,
13141+ 0.0,
13142+ 0.0,
13143+ 0.0,
13144+ 0.0,
13145+ 0.0,
13146+ 0.0
13147+ ]
13148+ },
13149+ "ridge|L3|a1.0": {
13150+ "accuracy": 0.0,
13151+ "gain_vs_zero": {
13152+ "estimate": 0.0,
13153+ "low": 0.0,
13154+ "high": 0.0,
13155+ "level": 0.95,
13156+ "n_items": 40,
13157+ "n_clusters": 40,
13158+ "n_boot": 2000
13159+ },
13160+ "mapped_norm": 8.740130424499512,
13161+ "outputs_sample": [
13162+ " The word \"zeni\"",
13163+ " 1\n",
13164+ " 0\n",
13165+ " 1\n",
13166+ " The word \"zute\""
13167+ ],
13168+ "correct": [
13169+ 0.0,
13170+ 0.0,
13171+ 0.0,
13172+ 0.0,
13173+ 0.0,
13174+ 0.0,
13175+ 0.0,
13176+ 0.0,
13177+ 0.0,
13178+ 0.0,
13179+ 0.0,
13180+ 0.0,
13181+ 0.0,
13182+ 0.0,
13183+ 0.0,
13184+ 0.0,
13185+ 0.0,
13186+ 0.0,
13187+ 0.0,
13188+ 0.0,
13189+ 0.0,
13190+ 0.0,
13191+ 0.0,
13192+ 0.0,
13193+ 0.0,
13194+ 0.0,
13195+ 0.0,
13196+ 0.0,
13197+ 0.0,
13198+ 0.0,
13199+ 0.0,
13200+ 0.0,
13201+ 0.0,
13202+ 0.0,
13203+ 0.0,
13204+ 0.0,
13205+ 0.0,
13206+ 0.0,
13207+ 0.0,
13208+ 0.0
13209+ ]
13210+ },
13211+ "ridge|L3|a2.0": {
13212+ "accuracy": 0.0,
13213+ "gain_vs_zero": {
13214+ "estimate": 0.0,
13215+ "low": 0.0,
13216+ "high": 0.0,
13217+ "level": 0.95,
13218+ "n_items": 40,
13219+ "n_clusters": 40,
13220+ "n_boot": 2000
13221+ },
13222+ "mapped_norm": 8.740130424499512,
13223+ "outputs_sample": [
13224+ " The word \"zeni\"",
13225+ " 1\n",
13226+ " 1\n",
13227+ " 1\n",
13228+ " False\n"
13229+ ],
13230+ "correct": [
13231+ 0.0,
13232+ 0.0,
13233+ 0.0,
13234+ 0.0,
13235+ 0.0,
13236+ 0.0,
13237+ 0.0,
13238+ 0.0,
13239+ 0.0,
13240+ 0.0,
13241+ 0.0,
13242+ 0.0,
13243+ 0.0,
13244+ 0.0,
13245+ 0.0,
13246+ 0.0,
13247+ 0.0,
13248+ 0.0,
13249+ 0.0,
13250+ 0.0,
13251+ 0.0,
13252+ 0.0,
13253+ 0.0,
13254+ 0.0,
13255+ 0.0,
13256+ 0.0,
13257+ 0.0,
13258+ 0.0,
13259+ 0.0,
13260+ 0.0,
13261+ 0.0,
13262+ 0.0,
13263+ 0.0,
13264+ 0.0,
13265+ 0.0,
13266+ 0.0,
13267+ 0.0,
13268+ 0.0,
13269+ 0.0,
13270+ 0.0
13271+ ]
13272+ },
13273+ "ridge_rescaled|L3|a1.0": {
13274+ "accuracy": 0.0,
13275+ "gain_vs_zero": {
13276+ "estimate": 0.0,
13277+ "low": 0.0,
13278+ "high": 0.0,
13279+ "level": 0.95,
13280+ "n_items": 40,
13281+ "n_clusters": 40,
13282+ "n_boot": 2000
13283+ },
13284+ "mapped_norm": 6.1436028480529785,
13285+ "outputs_sample": [
13286+ " The word \"zeni\"",
13287+ " 1\n",
13288+ " 0\n",
13289+ " 1\n",
13290+ " The word \"zute\""
13291+ ],
13292+ "correct": [
13293+ 0.0,
13294+ 0.0,
13295+ 0.0,
13296+ 0.0,
13297+ 0.0,
13298+ 0.0,
13299+ 0.0,
13300+ 0.0,
13301+ 0.0,
13302+ 0.0,
13303+ 0.0,
13304+ 0.0,
13305+ 0.0,
13306+ 0.0,
13307+ 0.0,
13308+ 0.0,
13309+ 0.0,
13310+ 0.0,
13311+ 0.0,
13312+ 0.0,
13313+ 0.0,
13314+ 0.0,
13315+ 0.0,
13316+ 0.0,
13317+ 0.0,
13318+ 0.0,
13319+ 0.0,
13320+ 0.0,
13321+ 0.0,
13322+ 0.0,
13323+ 0.0,
13324+ 0.0,
13325+ 0.0,
13326+ 0.0,
13327+ 0.0,
13328+ 0.0,
13329+ 0.0,
13330+ 0.0,
13331+ 0.0,
13332+ 0.0
13333+ ]
13334+ },
13335+ "cca|L3|a1.0": {
13336+ "accuracy": 0.0,
13337+ "gain_vs_zero": {
13338+ "estimate": 0.0,
13339+ "low": 0.0,
13340+ "high": 0.0,
13341+ "level": 0.95,
13342+ "n_items": 40,
13343+ "n_clusters": 40,
13344+ "n_boot": 2000
13345+ },
13346+ "mapped_norm": 8.59157943725586,
13347+ "outputs_sample": [
13348+ " The word \"zeni\"",
13349+ " 1\n",
13350+ " 0\n",
13351+ " 1\n",
13352+ " The word \"zute\""
13353+ ],
13354+ "correct": [
13355+ 0.0,
13356+ 0.0,
13357+ 0.0,
13358+ 0.0,
13359+ 0.0,
13360+ 0.0,
13361+ 0.0,
13362+ 0.0,
13363+ 0.0,
13364+ 0.0,
13365+ 0.0,
13366+ 0.0,
13367+ 0.0,
13368+ 0.0,
13369+ 0.0,
13370+ 0.0,
13371+ 0.0,
13372+ 0.0,
13373+ 0.0,
13374+ 0.0,
13375+ 0.0,
13376+ 0.0,
13377+ 0.0,
13378+ 0.0,
13379+ 0.0,
13380+ 0.0,
13381+ 0.0,
13382+ 0.0,
13383+ 0.0,
13384+ 0.0,
13385+ 0.0,
13386+ 0.0,
13387+ 0.0,
13388+ 0.0,
13389+ 0.0,
13390+ 0.0,
13391+ 0.0,
13392+ 0.0,
13393+ 0.0,
13394+ 0.0
13395+ ]
13396+ },
13397+ "cca|L3|a2.0": {
13398+ "accuracy": 0.0,
13399+ "gain_vs_zero": {
13400+ "estimate": 0.0,
13401+ "low": 0.0,
13402+ "high": 0.0,
13403+ "level": 0.95,
13404+ "n_items": 40,
13405+ "n_clusters": 40,
13406+ "n_boot": 2000
13407+ },
13408+ "mapped_norm": 8.59157943725586,
13409+ "outputs_sample": [
13410+ " The word \"zeni\"",
13411+ " 1\n",
13412+ " 1\n",
13413+ " 1\n",
13414+ " False\n"
13415+ ],
13416+ "correct": [
13417+ 0.0,
13418+ 0.0,
13419+ 0.0,
13420+ 0.0,
13421+ 0.0,
13422+ 0.0,
13423+ 0.0,
13424+ 0.0,
13425+ 0.0,
13426+ 0.0,
13427+ 0.0,
13428+ 0.0,
13429+ 0.0,
13430+ 0.0,
13431+ 0.0,
13432+ 0.0,
13433+ 0.0,
13434+ 0.0,
13435+ 0.0,
13436+ 0.0,
13437+ 0.0,
13438+ 0.0,
13439+ 0.0,
13440+ 0.0,
13441+ 0.0,
13442+ 0.0,
13443+ 0.0,
13444+ 0.0,
13445+ 0.0,
13446+ 0.0,
13447+ 0.0,
13448+ 0.0,
13449+ 0.0,
13450+ 0.0,
13451+ 0.0,
13452+ 0.0,
13453+ 0.0,
13454+ 0.0,
13455+ 0.0,
13456+ 0.0
13457+ ]
13458+ },
13459+ "random_orth|L3|a1.0": {
13460+ "accuracy": 0.0,
13461+ "gain_vs_zero": {
13462+ "estimate": 0.0,
13463+ "low": 0.0,
13464+ "high": 0.0,
13465+ "level": 0.95,
13466+ "n_items": 40,
13467+ "n_clusters": 40,
13468+ "n_boot": 2000
13469+ },
13470+ "mapped_norm": 9.646642684936523,
13471+ "outputs_sample": [
13472+ " The word \"zeni\"",
13473+ " 1\n",
13474+ " 0\n",
13475+ " The word \"tuken\"",
13476+ " The word \"zute\""
13477+ ],
13478+ "correct": [
13479+ 0.0,
13480+ 0.0,
13481+ 0.0,
13482+ 0.0,
13483+ 0.0,
13484+ 0.0,
13485+ 0.0,
13486+ 0.0,
13487+ 0.0,
13488+ 0.0,
13489+ 0.0,
13490+ 0.0,
13491+ 0.0,
13492+ 0.0,
13493+ 0.0,
13494+ 0.0,
13495+ 0.0,
13496+ 0.0,
13497+ 0.0,
13498+ 0.0,
13499+ 0.0,
13500+ 0.0,
13501+ 0.0,
13502+ 0.0,
13503+ 0.0,
13504+ 0.0,
13505+ 0.0,
13506+ 0.0,
13507+ 0.0,
13508+ 0.0,
13509+ 0.0,
13510+ 0.0,
13511+ 0.0,
13512+ 0.0,
13513+ 0.0,
13514+ 0.0,
13515+ 0.0,
13516+ 0.0,
13517+ 0.0,
13518+ 0.0
13519+ ]
13520+ },
13521+ "random_orth|L3|a2.0": {
13522+ "accuracy": 0.0,
13523+ "gain_vs_zero": {
13524+ "estimate": 0.0,
13525+ "low": 0.0,
13526+ "high": 0.0,
13527+ "level": 0.95,
13528+ "n_items": 40,
13529+ "n_clusters": 40,
13530+ "n_boot": 2000
13531+ },
13532+ "mapped_norm": 9.646642684936523,
13533+ "outputs_sample": [
13534+ " The word \"zeni\"",
13535+ " 1\n",
13536+ " 1\n",
13537+ " 1\n",
13538+ " False\n"
13539+ ],
13540+ "correct": [
13541+ 0.0,
13542+ 0.0,
13543+ 0.0,
13544+ 0.0,
13545+ 0.0,
13546+ 0.0,
13547+ 0.0,
13548+ 0.0,
13549+ 0.0,
13550+ 0.0,
13551+ 0.0,
13552+ 0.0,
13553+ 0.0,
13554+ 0.0,
13555+ 0.0,
13556+ 0.0,
13557+ 0.0,
13558+ 0.0,
13559+ 0.0,
13560+ 0.0,
13561+ 0.0,
13562+ 0.0,
13563+ 0.0,
13564+ 0.0,
13565+ 0.0,
13566+ 0.0,
13567+ 0.0,
13568+ 0.0,
13569+ 0.0,
13570+ 0.0,
13571+ 0.0,
13572+ 0.0,
13573+ 0.0,
13574+ 0.0,
13575+ 0.0,
13576+ 0.0,
13577+ 0.0,
13578+ 0.0,
13579+ 0.0,
13580+ 0.0
13581+ ]
13582+ },
13583+ "replace_donor_fewshot|procrustes|L3": {
13584+ "accuracy": 0.0,
13585+ "gain_vs_zero": {
13586+ "estimate": 0.0,
13587+ "low": 0.0,
13588+ "high": 0.0,
13589+ "level": 0.95,
13590+ "n_items": 40,
13591+ "n_clusters": 40,
13592+ "n_boot": 2000
13593+ },
13594+ "outputs_sample": [
13595+ " The word \"zeni\"",
13596+ " 1\n",
13597+ " 0\n",
13598+ " 1\n",
13599+ " The word \"zute\""
13600+ ],
13601+ "correct": [
13602+ 0.0,
13603+ 0.0,
13604+ 0.0,
13605+ 0.0,
13606+ 0.0,
13607+ 0.0,
13608+ 0.0,
13609+ 0.0,
13610+ 0.0,
13611+ 0.0,
13612+ 0.0,
13613+ 0.0,
13614+ 0.0,
13615+ 0.0,
13616+ 0.0,
13617+ 0.0,
13618+ 0.0,
13619+ 0.0,
13620+ 0.0,
13621+ 0.0,
13622+ 0.0,
13623+ 0.0,
13624+ 0.0,
13625+ 0.0,
13626+ 0.0,
13627+ 0.0,
13628+ 0.0,
13629+ 0.0,
13630+ 0.0,
13631+ 0.0,
13632+ 0.0,
13633+ 0.0,
13634+ 0.0,
13635+ 0.0,
13636+ 0.0,
13637+ 0.0,
13638+ 0.0,
13639+ 0.0,
13640+ 0.0,
13641+ 0.0
13642+ ]
13643+ },
13644+ "ctl_replace_donor_zeroshot|procrustes|L3": {
13645+ "accuracy": 0.0,
13646+ "gain_vs_zero": {
13647+ "estimate": 0.0,
13648+ "low": 0.0,
13649+ "high": 0.0,
13650+ "level": 0.95,
13651+ "n_items": 40,
13652+ "n_clusters": 40,
13653+ "n_boot": 2000
13654+ },
13655+ "outputs_sample": [
13656+ " The word \"zeni\"",
13657+ " 1\n",
13658+ " 0\n",
13659+ " The word \"tuken\"",
13660+ " The word \"zute\""
13661+ ],
13662+ "correct": [
13663+ 0.0,
13664+ 0.0,
13665+ 0.0,
13666+ 0.0,
13667+ 0.0,
13668+ 0.0,
13669+ 0.0,
13670+ 0.0,
13671+ 0.0,
13672+ 0.0,
13673+ 0.0,
13674+ 0.0,
13675+ 0.0,
13676+ 0.0,
13677+ 0.0,
13678+ 0.0,
13679+ 0.0,
13680+ 0.0,
13681+ 0.0,
13682+ 0.0,
13683+ 0.0,
13684+ 0.0,
13685+ 0.0,
13686+ 0.0,
13687+ 0.0,
13688+ 0.0,
13689+ 0.0,
13690+ 0.0,
13691+ 0.0,
13692+ 0.0,
13693+ 0.0,
13694+ 0.0,
13695+ 0.0,
13696+ 0.0,
13697+ 0.0,
13698+ 0.0,
13699+ 0.0,
13700+ 0.0,
13701+ 0.0,
13702+ 0.0
13703+ ]
13704+ },
13705+ "ctl_replace_donor_fewshot_shuffled_query|procrustes|L3": {
13706+ "accuracy": 0.0,
13707+ "gain_vs_zero": {
13708+ "estimate": 0.0,
13709+ "low": 0.0,
13710+ "high": 0.0,
13711+ "level": 0.95,
13712+ "n_items": 40,
13713+ "n_clusters": 40,
13714+ "n_boot": 2000
13715+ },
13716+ "outputs_sample": [
13717+ " The word \"zeni\"",
13718+ " 1\n",
13719+ " 0\n",
13720+ " 1\n",
13721+ " 1\n"
13722+ ],
13723+ "correct": [
13724+ 0.0,
13725+ 0.0,
13726+ 0.0,
13727+ 0.0,
13728+ 0.0,
13729+ 0.0,
13730+ 0.0,
13731+ 0.0,
13732+ 0.0,
13733+ 0.0,
13734+ 0.0,
13735+ 0.0,
13736+ 0.0,
13737+ 0.0,
13738+ 0.0,
13739+ 0.0,
13740+ 0.0,
13741+ 0.0,
13742+ 0.0,
13743+ 0.0,
13744+ 0.0,
13745+ 0.0,
13746+ 0.0,
13747+ 0.0,
13748+ 0.0,
13749+ 0.0,
13750+ 0.0,
13751+ 0.0,
13752+ 0.0,
13753+ 0.0,
13754+ 0.0,
13755+ 0.0,
13756+ 0.0,
13757+ 0.0,
13758+ 0.0,
13759+ 0.0,
13760+ 0.0,
13761+ 0.0,
13762+ 0.0,
13763+ 0.0
13764+ ]
13765+ },
13766+ "replace_donor_fewshot|ridge|L3": {
13767+ "accuracy": 0.0,
13768+ "gain_vs_zero": {
13769+ "estimate": 0.0,
13770+ "low": 0.0,
13771+ "high": 0.0,
13772+ "level": 0.95,
13773+ "n_items": 40,
13774+ "n_clusters": 40,
13775+ "n_boot": 2000
13776+ },
13777+ "outputs_sample": [
13778+ " The word \"zeni\"",
13779+ " 1\n",
13780+ " 0\n",
13781+ " 1\n",
13782+ " The word \"zute\""
13783+ ],
13784+ "correct": [
13785+ 0.0,
13786+ 0.0,
13787+ 0.0,
13788+ 0.0,
13789+ 0.0,
13790+ 0.0,
13791+ 0.0,
13792+ 0.0,
13793+ 0.0,
13794+ 0.0,
13795+ 0.0,
13796+ 0.0,
13797+ 0.0,
13798+ 0.0,
13799+ 0.0,
13800+ 0.0,
13801+ 0.0,
13802+ 0.0,
13803+ 0.0,
13804+ 0.0,
13805+ 0.0,
13806+ 0.0,
13807+ 0.0,
13808+ 0.0,
13809+ 0.0,
13810+ 0.0,
13811+ 0.0,
13812+ 0.0,
13813+ 0.0,
13814+ 0.0,
13815+ 0.0,
13816+ 0.0,
13817+ 0.0,
13818+ 0.0,
13819+ 0.0,
13820+ 0.0,
13821+ 0.0,
13822+ 0.0,
13823+ 0.0,
13824+ 0.0
13825+ ]
13826+ },
13827+ "ctl_replace_donor_zeroshot|ridge|L3": {
13828+ "accuracy": 0.0,
13829+ "gain_vs_zero": {
13830+ "estimate": 0.0,
13831+ "low": 0.0,
13832+ "high": 0.0,
13833+ "level": 0.95,
13834+ "n_items": 40,
13835+ "n_clusters": 40,
13836+ "n_boot": 2000
13837+ },
13838+ "outputs_sample": [
13839+ " The word \"zeni\"",
13840+ " 1\n",
13841+ " The word \"vofisu",
13842+ " The word \"tuken\"",
13843+ " The word \"zute\""
13844+ ],
13845+ "correct": [
13846+ 0.0,
13847+ 0.0,
13848+ 0.0,
13849+ 0.0,
13850+ 0.0,
13851+ 0.0,
13852+ 0.0,
13853+ 0.0,
13854+ 0.0,
13855+ 0.0,
13856+ 0.0,
13857+ 0.0,
13858+ 0.0,
13859+ 0.0,
13860+ 0.0,
13861+ 0.0,
13862+ 0.0,
13863+ 0.0,
13864+ 0.0,
13865+ 0.0,
13866+ 0.0,
13867+ 0.0,
13868+ 0.0,
13869+ 0.0,
13870+ 0.0,
13871+ 0.0,
13872+ 0.0,
13873+ 0.0,
13874+ 0.0,
13875+ 0.0,
13876+ 0.0,
13877+ 0.0,
13878+ 0.0,
13879+ 0.0,
13880+ 0.0,
13881+ 0.0,
13882+ 0.0,
13883+ 0.0,
13884+ 0.0,
13885+ 0.0
13886+ ]
13887+ },
13888+ "ctl_replace_donor_fewshot_shuffled_query|ridge|L3": {
13889+ "accuracy": 0.0,
13890+ "gain_vs_zero": {
13891+ "estimate": 0.0,
13892+ "low": 0.0,
13893+ "high": 0.0,
13894+ "level": 0.95,
13895+ "n_items": 40,
13896+ "n_clusters": 40,
13897+ "n_boot": 2000
13898+ },
13899+ "outputs_sample": [
13900+ " The word \"zeni\"",
13901+ " 1\n",
13902+ " 0\n",
13903+ " 1\n",
13904+ " The word \"zute\""
13905+ ],
13906+ "correct": [
13907+ 0.0,
13908+ 0.0,
13909+ 0.0,
13910+ 0.0,
13911+ 0.0,
13912+ 0.0,
13913+ 0.0,
13914+ 0.0,
13915+ 0.0,
13916+ 0.0,
13917+ 0.0,
13918+ 0.0,
13919+ 0.0,
13920+ 0.0,
13921+ 0.0,
13922+ 0.0,
13923+ 0.0,
13924+ 0.0,
13925+ 0.0,
13926+ 0.0,
13927+ 0.0,
13928+ 0.0,
13929+ 0.0,
13930+ 0.0,
13931+ 0.0,
13932+ 0.0,
13933+ 0.0,
13934+ 0.0,
13935+ 0.0,
13936+ 0.0,
13937+ 0.0,
13938+ 0.0,
13939+ 0.0,
13940+ 0.0,
13941+ 0.0,
13942+ 0.0,
13943+ 0.0,
13944+ 0.0,
13945+ 0.0,
13946+ 0.0
13947+ ]
13948+ },
13949+ "ctl_replace_donor_fewshot|sham_map|L3": {
13950+ "accuracy": 0.0,
13951+ "gain_vs_zero": {
13952+ "estimate": 0.0,
13953+ "low": 0.0,
13954+ "high": 0.0,
13955+ "level": 0.95,
13956+ "n_items": 40,
13957+ "n_clusters": 40,
13958+ "n_boot": 2000
13959+ },
13960+ "outputs_sample": [
13961+ " The word \"zeni\"",
13962+ " 1\n",
13963+ " The word \"vofisu",
13964+ " 1\n",
13965+ " The word \"zute\""
13966+ ],
13967+ "correct": [
13968+ 0.0,
13969+ 0.0,
13970+ 0.0,
13971+ 0.0,
13972+ 0.0,
13973+ 0.0,
13974+ 0.0,
13975+ 0.0,
13976+ 0.0,
13977+ 0.0,
13978+ 0.0,
13979+ 0.0,
13980+ 0.0,
13981+ 0.0,
13982+ 0.0,
13983+ 0.0,
13984+ 0.0,
13985+ 0.0,
13986+ 0.0,
13987+ 0.0,
13988+ 0.0,
13989+ 0.0,
13990+ 0.0,
13991+ 0.0,
13992+ 0.0,
13993+ 0.0,
13994+ 0.0,
13995+ 0.0,
13996+ 0.0,
13997+ 0.0,
13998+ 0.0,
13999+ 0.0,
14000+ 0.0,
14001+ 0.0,
14002+ 0.0,
14003+ 0.0,
14004+ 0.0,
14005+ 0.0,
14006+ 0.0,
14007+ 0.0
14008+ ]
14009+ },
14010+ "ctl_replace_donor_zeroshot|sham_map|L3": {
14011+ "accuracy": 0.0,
14012+ "gain_vs_zero": {
14013+ "estimate": 0.0,
14014+ "low": 0.0,
14015+ "high": 0.0,
14016+ "level": 0.95,
14017+ "n_items": 40,
14018+ "n_clusters": 40,
14019+ "n_boot": 2000
14020+ },
14021+ "outputs_sample": [
14022+ " The word \"zeni\"",
14023+ " 1\n",
14024+ " 0\n",
14025+ " 1\n",
14026+ " The word \"zute\""
14027+ ],
14028+ "correct": [
14029+ 0.0,
14030+ 0.0,
14031+ 0.0,
14032+ 0.0,
14033+ 0.0,
14034+ 0.0,
14035+ 0.0,
14036+ 0.0,
14037+ 0.0,
14038+ 0.0,
14039+ 0.0,
14040+ 0.0,
14041+ 0.0,
14042+ 0.0,
14043+ 0.0,
14044+ 0.0,
14045+ 0.0,
14046+ 0.0,
14047+ 0.0,
14048+ 0.0,
14049+ 0.0,
14050+ 0.0,
14051+ 0.0,
14052+ 0.0,
14053+ 0.0,
14054+ 0.0,
14055+ 0.0,
14056+ 0.0,
14057+ 0.0,
14058+ 0.0,
14059+ 0.0,
14060+ 0.0,
14061+ 0.0,
14062+ 0.0,
14063+ 0.0,
14064+ 0.0,
14065+ 0.0,
14066+ 0.0,
14067+ 0.0,
14068+ 0.0
14069+ ]
14070+ },
14071+ "ctl_replace_donor_fewshot_shuffled_query|sham_map|L3": {
14072+ "accuracy": 0.0,
14073+ "gain_vs_zero": {
14074+ "estimate": 0.0,
14075+ "low": 0.0,
14076+ "high": 0.0,
14077+ "level": 0.95,
14078+ "n_items": 40,
14079+ "n_clusters": 40,
14080+ "n_boot": 2000
14081+ },
14082+ "outputs_sample": [
14083+ " The word \"zeni\"",
14084+ " 1\n",
14085+ " The word \"vofisu",
14086+ " 1\n",
14087+ " The word \"zute\""
14088+ ],
14089+ "correct": [
14090+ 0.0,
14091+ 0.0,
14092+ 0.0,
14093+ 0.0,
14094+ 0.0,
14095+ 0.0,
14096+ 0.0,
14097+ 0.0,
14098+ 0.0,
14099+ 0.0,
14100+ 0.0,
14101+ 0.0,
14102+ 0.0,
14103+ 0.0,
14104+ 0.0,
14105+ 0.0,
14106+ 0.0,
14107+ 0.0,
14108+ 0.0,
14109+ 0.0,
14110+ 0.0,
14111+ 0.0,
14112+ 0.0,
14113+ 0.0,
14114+ 0.0,
14115+ 0.0,
14116+ 0.0,
14117+ 0.0,
14118+ 0.0,
14119+ 0.0,
14120+ 0.0,
14121+ 0.0,
14122+ 0.0,
14123+ 0.0,
14124+ 0.0,
14125+ 0.0,
14126+ 0.0,
14127+ 0.0,
14128+ 0.0,
14129+ 0.0
14130+ ]
14131+ },
14132+ "ctl_random_norm_matched|L3": {
14133+ "accuracy": 0.0,
14134+ "gain_vs_zero": {
14135+ "estimate": 0.0,
14136+ "low": 0.0,
14137+ "high": 0.0,
14138+ "level": 0.95,
14139+ "n_items": 40,
14140+ "n_clusters": 40,
14141+ "n_boot": 2000
14142+ },
14143+ "correct": [
14144+ 0.0,
14145+ 0.0,
14146+ 0.0,
14147+ 0.0,
14148+ 0.0,
14149+ 0.0,
14150+ 0.0,
14151+ 0.0,
14152+ 0.0,
14153+ 0.0,
14154+ 0.0,
14155+ 0.0,
14156+ 0.0,
14157+ 0.0,
14158+ 0.0,
14159+ 0.0,
14160+ 0.0,
14161+ 0.0,
14162+ 0.0,
14163+ 0.0,
14164+ 0.0,
14165+ 0.0,
14166+ 0.0,
14167+ 0.0,
14168+ 0.0,
14169+ 0.0,
14170+ 0.0,
14171+ 0.0,
14172+ 0.0,
14173+ 0.0,
14174+ 0.0,
14175+ 0.0,
14176+ 0.0,
14177+ 0.0,
14178+ 0.0,
14179+ 0.0,
14180+ 0.0,
14181+ 0.0,
14182+ 0.0,
14183+ 0.0
14184+ ]
14185+ },
14186+ "ctl_unrelated_task_vector(antonym)|L3": {
14187+ "accuracy": 0.0,
14188+ "gain_vs_zero": {
14189+ "estimate": 0.0,
14190+ "low": 0.0,
14191+ "high": 0.0,
14192+ "level": 0.95,
14193+ "n_items": 40,
14194+ "n_clusters": 40,
14195+ "n_boot": 2000
14196+ },
14197+ "correct": [
14198+ 0.0,
14199+ 0.0,
14200+ 0.0,
14201+ 0.0,
14202+ 0.0,
14203+ 0.0,
14204+ 0.0,
14205+ 0.0,
14206+ 0.0,
14207+ 0.0,
14208+ 0.0,
14209+ 0.0,
14210+ 0.0,
14211+ 0.0,
14212+ 0.0,
14213+ 0.0,
14214+ 0.0,
14215+ 0.0,
14216+ 0.0,
14217+ 0.0,
14218+ 0.0,
14219+ 0.0,
14220+ 0.0,
14221+ 0.0,
14222+ 0.0,
14223+ 0.0,
14224+ 0.0,
14225+ 0.0,
14226+ 0.0,
14227+ 0.0,
14228+ 0.0,
14229+ 0.0,
14230+ 0.0,
14231+ 0.0,
14232+ 0.0,
14233+ 0.0,
14234+ 0.0,
14235+ 0.0,
14236+ 0.0,
14237+ 0.0
14238+ ]
14239+ }
14240+ },
14241+ "items": {
14242+ "zero": [
14243+ 0.0,
14244+ 0.0,
14245+ 0.0,
14246+ 0.0,
14247+ 0.0,
14248+ 0.0,
14249+ 0.0,
14250+ 0.0,
14251+ 0.0,
14252+ 0.0,
14253+ 0.0,
14254+ 0.0,
14255+ 0.0,
14256+ 0.0,
14257+ 0.0,
14258+ 0.0,
14259+ 0.0,
14260+ 0.0,
14261+ 0.0,
14262+ 0.0,
14263+ 0.0,
14264+ 0.0,
14265+ 0.0,
14266+ 0.0,
14267+ 0.0,
14268+ 0.0,
14269+ 0.0,
14270+ 0.0,
14271+ 0.0,
14272+ 0.0,
14273+ 0.0,
14274+ 0.0,
14275+ 0.0,
14276+ 0.0,
14277+ 0.0,
14278+ 0.0,
14279+ 0.0,
14280+ 0.0,
14281+ 0.0,
14282+ 0.0
14283+ ],
14284+ "few": [
14285+ 0.0,
14286+ 1.0,
14287+ 1.0,
14288+ 0.0,
14289+ 1.0,
14290+ 1.0,
14291+ 0.0,
14292+ 1.0,
14293+ 1.0,
14294+ 0.0,
14295+ 0.0,
14296+ 1.0,
14297+ 0.0,
14298+ 0.0,
14299+ 0.0,
14300+ 1.0,
14301+ 0.0,
14302+ 0.0,
14303+ 0.0,
14304+ 1.0,
14305+ 0.0,
14306+ 1.0,
14307+ 0.0,
14308+ 0.0,
14309+ 1.0,
14310+ 0.0,
14311+ 0.0,
14312+ 1.0,
14313+ 0.0,
14314+ 0.0,
14315+ 0.0,
14316+ 1.0,
14317+ 0.0,
14318+ 0.0,
14319+ 0.0,
14320+ 1.0,
14321+ 0.0,
14322+ 1.0,
14323+ 0.0,
14324+ 1.0
14325+ ],
14326+ "own": [
14327+ 0.0,
14328+ 0.0,
14329+ 0.0,
14330+ 0.0,
14331+ 0.0,
14332+ 0.0,
14333+ 0.0,
14334+ 0.0,
14335+ 0.0,
14336+ 0.0,
14337+ 0.0,
14338+ 0.0,
14339+ 0.0,
14340+ 0.0,
14341+ 0.0,
14342+ 0.0,
14343+ 0.0,
14344+ 0.0,
14345+ 0.0,
14346+ 0.0,
14347+ 0.0,
14348+ 0.0,
14349+ 0.0,
14350+ 0.0,
14351+ 0.0,
14352+ 0.0,
14353+ 0.0,
14354+ 0.0,
14355+ 0.0,
14356+ 0.0,
14357+ 0.0,
14358+ 0.0,
14359+ 0.0,
14360+ 0.0,
14361+ 0.0,
14362+ 0.0,
14363+ 0.0,
14364+ 0.0,
14365+ 0.0,
14366+ 0.0
14367+ ]
14368+ }
14369+ },
14370+ "addthree": {
14371+ "recipient_zero": 0.0,
14372+ "recipient_few": 1.0,
14373+ "recipient_own_vector": 0.0,
14374+ "donor_layer": 2,
14375+ "conditions": {
14376+ "procrustes|L2|a1.0": {
14377+ "accuracy": 0.0,
14378+ "gain_vs_zero": {
14379+ "estimate": 0.0,
14380+ "low": 0.0,
14381+ "high": 0.0,
14382+ "level": 0.95,
14383+ "n_items": 35,
14384+ "n_clusters": 35,
14385+ "n_boot": 2000
14386+ },
14387+ "mapped_norm": 5.994113445281982,
14388+ "outputs_sample": [
14389+ " 7\n",
14390+ " 12\n",
14391+ " 83\n",
14392+ " 19\n",
14393+ " 71\n"
14394+ ],
14395+ "correct": [
14396+ 0.0,
14397+ 0.0,
14398+ 0.0,
14399+ 0.0,
14400+ 0.0,
14401+ 0.0,
14402+ 0.0,
14403+ 0.0,
14404+ 0.0,
14405+ 0.0,
14406+ 0.0,
14407+ 0.0,
14408+ 0.0,
14409+ 0.0,
14410+ 0.0,
14411+ 0.0,
14412+ 0.0,
14413+ 0.0,
14414+ 0.0,
14415+ 0.0,
14416+ 0.0,
14417+ 0.0,
14418+ 0.0,
14419+ 0.0,
14420+ 0.0,
14421+ 0.0,
14422+ 0.0,
14423+ 0.0,
14424+ 0.0,
14425+ 0.0,
14426+ 0.0,
14427+ 0.0,
14428+ 0.0,
14429+ 0.0,
14430+ 0.0
14431+ ]
14432+ },
14433+ "procrustes|L2|a2.0": {
14434+ "accuracy": 0.0,
14435+ "gain_vs_zero": {
14436+ "estimate": 0.0,
14437+ "low": 0.0,
14438+ "high": 0.0,
14439+ "level": 0.95,
14440+ "n_items": 35,
14441+ "n_clusters": 35,
14442+ "n_boot": 2000
14443+ },
14444+ "mapped_norm": 5.994113445281982,
14445+ "outputs_sample": [
14446+ " 7\n",
14447+ " 12\n",
14448+ " 83\n",
14449+ " 19\n",
14450+ " 71\n"
14451+ ],
14452+ "correct": [
14453+ 0.0,
14454+ 0.0,
14455+ 0.0,
14456+ 0.0,
14457+ 0.0,
14458+ 0.0,
14459+ 0.0,
14460+ 0.0,
14461+ 0.0,
14462+ 0.0,
14463+ 0.0,
14464+ 0.0,
14465+ 0.0,
14466+ 0.0,
14467+ 0.0,
14468+ 0.0,
14469+ 0.0,
14470+ 0.0,
14471+ 0.0,
14472+ 0.0,
14473+ 0.0,
14474+ 0.0,
14475+ 0.0,
14476+ 0.0,
14477+ 0.0,
14478+ 0.0,
14479+ 0.0,
14480+ 0.0,
14481+ 0.0,
14482+ 0.0,
14483+ 0.0,
14484+ 0.0,
14485+ 0.0,
14486+ 0.0,
14487+ 0.0
14488+ ]
14489+ },
14490+ "procrustes_rescaled|L2|a1.0": {
14491+ "accuracy": 0.0,
14492+ "gain_vs_zero": {
14493+ "estimate": 0.0,
14494+ "low": 0.0,
14495+ "high": 0.0,
14496+ "level": 0.95,
14497+ "n_items": 35,
14498+ "n_clusters": 35,
14499+ "n_boot": 2000
14500+ },
14501+ "mapped_norm": 5.985179901123047,
14502+ "outputs_sample": [
14503+ " 7\n",
14504+ " 12\n",
14505+ " 83\n",
14506+ " 19\n",
14507+ " 71\n"
14508+ ],
14509+ "correct": [
14510+ 0.0,
14511+ 0.0,
14512+ 0.0,
14513+ 0.0,
14514+ 0.0,
14515+ 0.0,
14516+ 0.0,
14517+ 0.0,
14518+ 0.0,
14519+ 0.0,
14520+ 0.0,
14521+ 0.0,
14522+ 0.0,
14523+ 0.0,
14524+ 0.0,
14525+ 0.0,
14526+ 0.0,
14527+ 0.0,
14528+ 0.0,
14529+ 0.0,
14530+ 0.0,
14531+ 0.0,
14532+ 0.0,
14533+ 0.0,
14534+ 0.0,
14535+ 0.0,
14536+ 0.0,
14537+ 0.0,
14538+ 0.0,
14539+ 0.0,
14540+ 0.0,
14541+ 0.0,
14542+ 0.0,
14543+ 0.0,
14544+ 0.0
14545+ ]
14546+ },
14547+ "ridge|L2|a1.0": {
14548+ "accuracy": 0.0,
14549+ "gain_vs_zero": {
14550+ "estimate": 0.0,
14551+ "low": 0.0,
14552+ "high": 0.0,
14553+ "level": 0.95,
14554+ "n_items": 35,
14555+ "n_clusters": 35,
14556+ "n_boot": 2000
14557+ },
14558+ "mapped_norm": 5.74902868270874,
14559+ "outputs_sample": [
14560+ " 7\n",
14561+ " 12\n",
14562+ " 83\n",
14563+ " 19\n",
14564+ " 71\n"
14565+ ],
14566+ "correct": [
14567+ 0.0,
14568+ 0.0,
14569+ 0.0,
14570+ 0.0,
14571+ 0.0,
14572+ 0.0,
14573+ 0.0,
14574+ 0.0,
14575+ 0.0,
14576+ 0.0,
14577+ 0.0,
14578+ 0.0,
14579+ 0.0,
14580+ 0.0,
14581+ 0.0,
14582+ 0.0,
14583+ 0.0,
14584+ 0.0,
14585+ 0.0,
14586+ 0.0,
14587+ 0.0,
14588+ 0.0,
14589+ 0.0,
14590+ 0.0,
14591+ 0.0,
14592+ 0.0,
14593+ 0.0,
14594+ 0.0,
14595+ 0.0,
14596+ 0.0,
14597+ 0.0,
14598+ 0.0,
14599+ 0.0,
14600+ 0.0,
14601+ 0.0
14602+ ]
14603+ },
14604+ "ridge|L2|a2.0": {
14605+ "accuracy": 0.0,
14606+ "gain_vs_zero": {
14607+ "estimate": 0.0,
14608+ "low": 0.0,
14609+ "high": 0.0,
14610+ "level": 0.95,
14611+ "n_items": 35,
14612+ "n_clusters": 35,
14613+ "n_boot": 2000
14614+ },
14615+ "mapped_norm": 5.74902868270874,
14616+ "outputs_sample": [
14617+ " 7\n",
14618+ " 12\n",
14619+ " 83\n",
14620+ " 19\n",
14621+ " 71\n"
14622+ ],
14623+ "correct": [
14624+ 0.0,
14625+ 0.0,
14626+ 0.0,
14627+ 0.0,
14628+ 0.0,
14629+ 0.0,
14630+ 0.0,
14631+ 0.0,
14632+ 0.0,
14633+ 0.0,
14634+ 0.0,
14635+ 0.0,
14636+ 0.0,
14637+ 0.0,
14638+ 0.0,
14639+ 0.0,
14640+ 0.0,
14641+ 0.0,
14642+ 0.0,
14643+ 0.0,
14644+ 0.0,
14645+ 0.0,
14646+ 0.0,
14647+ 0.0,
14648+ 0.0,
14649+ 0.0,
14650+ 0.0,
14651+ 0.0,
14652+ 0.0,
14653+ 0.0,
14654+ 0.0,
14655+ 0.0,
14656+ 0.0,
14657+ 0.0,
14658+ 0.0
14659+ ]
14660+ },
14661+ "ridge_rescaled|L2|a1.0": {
14662+ "accuracy": 0.0,
14663+ "gain_vs_zero": {
14664+ "estimate": 0.0,
14665+ "low": 0.0,
14666+ "high": 0.0,
14667+ "level": 0.95,
14668+ "n_items": 35,
14669+ "n_clusters": 35,
14670+ "n_boot": 2000
14671+ },
14672+ "mapped_norm": 5.985179901123047,
14673+ "outputs_sample": [
14674+ " 7\n",
14675+ " 24\n",
14676+ " 83\n",
14677+ " 19\n",
14678+ " 71\n"
14679+ ],
14680+ "correct": [
14681+ 0.0,
14682+ 0.0,
14683+ 0.0,
14684+ 0.0,
14685+ 0.0,
14686+ 0.0,
14687+ 0.0,
14688+ 0.0,
14689+ 0.0,
14690+ 0.0,
14691+ 0.0,
14692+ 0.0,
14693+ 0.0,
14694+ 0.0,
14695+ 0.0,
14696+ 0.0,
14697+ 0.0,
14698+ 0.0,
14699+ 0.0,
14700+ 0.0,
14701+ 0.0,
14702+ 0.0,
14703+ 0.0,
14704+ 0.0,
14705+ 0.0,
14706+ 0.0,
14707+ 0.0,
14708+ 0.0,
14709+ 0.0,
14710+ 0.0,
14711+ 0.0,
14712+ 0.0,
14713+ 0.0,
14714+ 0.0,
14715+ 0.0
14716+ ]
14717+ },
14718+ "cca|L2|a1.0": {
14719+ "accuracy": 0.0,
14720+ "gain_vs_zero": {
14721+ "estimate": 0.0,
14722+ "low": 0.0,
14723+ "high": 0.0,
14724+ "level": 0.95,
14725+ "n_items": 35,
14726+ "n_clusters": 35,
14727+ "n_boot": 2000
14728+ },
14729+ "mapped_norm": 6.255377769470215,
14730+ "outputs_sample": [
14731+ " 7\n",
14732+ " 24\n",
14733+ " 83\n",
14734+ " 19\n",
14735+ " 71\n"
14736+ ],
14737+ "correct": [
14738+ 0.0,
14739+ 0.0,
14740+ 0.0,
14741+ 0.0,
14742+ 0.0,
14743+ 0.0,
14744+ 0.0,
14745+ 0.0,
14746+ 0.0,
14747+ 0.0,
14748+ 0.0,
14749+ 0.0,
14750+ 0.0,
14751+ 0.0,
14752+ 0.0,
14753+ 0.0,
14754+ 0.0,
14755+ 0.0,
14756+ 0.0,
14757+ 0.0,
14758+ 0.0,
14759+ 0.0,
14760+ 0.0,
14761+ 0.0,
14762+ 0.0,
14763+ 0.0,
14764+ 0.0,
14765+ 0.0,
14766+ 0.0,
14767+ 0.0,
14768+ 0.0,
14769+ 0.0,
14770+ 0.0,
14771+ 0.0,
14772+ 0.0
14773+ ]
14774+ },
14775+ "cca|L2|a2.0": {
14776+ "accuracy": 0.0,
14777+ "gain_vs_zero": {
14778+ "estimate": 0.0,
14779+ "low": 0.0,
14780+ "high": 0.0,
14781+ "level": 0.95,
14782+ "n_items": 35,
14783+ "n_clusters": 35,
14784+ "n_boot": 2000
14785+ },
14786+ "mapped_norm": 6.255377769470215,
14787+ "outputs_sample": [
14788+ " 7\n",
14789+ " 12\n",
14790+ " 83\n",
14791+ " 19\n",
14792+ " 71\n"
14793+ ],
14794+ "correct": [
14795+ 0.0,
14796+ 0.0,
14797+ 0.0,
14798+ 0.0,
14799+ 0.0,
14800+ 0.0,
14801+ 0.0,
14802+ 0.0,
14803+ 0.0,
14804+ 0.0,
14805+ 0.0,
14806+ 0.0,
14807+ 0.0,
14808+ 0.0,
14809+ 0.0,
14810+ 0.0,
14811+ 0.0,
14812+ 0.0,
14813+ 0.0,
14814+ 0.0,
14815+ 0.0,
14816+ 0.0,
14817+ 0.0,
14818+ 0.0,
14819+ 0.0,
14820+ 0.0,
14821+ 0.0,
14822+ 0.0,
14823+ 0.0,
14824+ 0.0,
14825+ 0.0,
14826+ 0.0,
14827+ 0.0,
14828+ 0.0,
14829+ 0.0
14830+ ]
14831+ },
14832+ "random_orth|L2|a1.0": {
14833+ "accuracy": 0.0,
14834+ "gain_vs_zero": {
14835+ "estimate": 0.0,
14836+ "low": 0.0,
14837+ "high": 0.0,
14838+ "level": 0.95,
14839+ "n_items": 35,
14840+ "n_clusters": 35,
14841+ "n_boot": 2000
14842+ },
14843+ "mapped_norm": 6.401248931884766,
14844+ "outputs_sample": [
14845+ " 7\n",
14846+ " 12\n",
14847+ " 83\n",
14848+ " 19\n",
14849+ " 71\n"
14850+ ],
14851+ "correct": [
14852+ 0.0,
14853+ 0.0,
14854+ 0.0,
14855+ 0.0,
14856+ 0.0,
14857+ 0.0,
14858+ 0.0,
14859+ 0.0,
14860+ 0.0,
14861+ 0.0,
14862+ 0.0,
14863+ 0.0,
14864+ 0.0,
14865+ 0.0,
14866+ 0.0,
14867+ 0.0,
14868+ 0.0,
14869+ 0.0,
14870+ 0.0,
14871+ 0.0,
14872+ 0.0,
14873+ 0.0,
14874+ 0.0,
14875+ 0.0,
14876+ 0.0,
14877+ 0.0,
14878+ 0.0,
14879+ 0.0,
14880+ 0.0,
14881+ 0.0,
14882+ 0.0,
14883+ 0.0,
14884+ 0.0,
14885+ 0.0,
14886+ 0.0
14887+ ]
14888+ },
14889+ "random_orth|L2|a2.0": {
14890+ "accuracy": 0.0,
14891+ "gain_vs_zero": {
14892+ "estimate": 0.0,
14893+ "low": 0.0,
14894+ "high": 0.0,
14895+ "level": 0.95,
14896+ "n_items": 35,
14897+ "n_clusters": 35,
14898+ "n_boot": 2000
14899+ },
14900+ "mapped_norm": 6.401248931884766,
14901+ "outputs_sample": [
14902+ " 7\n",
14903+ " 12\n",
14904+ " 83\n",
14905+ " 19\n",
14906+ " 71\n"
14907+ ],
14908+ "correct": [
14909+ 0.0,
14910+ 0.0,
14911+ 0.0,
14912+ 0.0,
14913+ 0.0,
14914+ 0.0,
14915+ 0.0,
14916+ 0.0,
14917+ 0.0,
14918+ 0.0,
14919+ 0.0,
14920+ 0.0,
14921+ 0.0,
14922+ 0.0,
14923+ 0.0,
14924+ 0.0,
14925+ 0.0,
14926+ 0.0,
14927+ 0.0,
14928+ 0.0,
14929+ 0.0,
14930+ 0.0,
14931+ 0.0,
14932+ 0.0,
14933+ 0.0,
14934+ 0.0,
14935+ 0.0,
14936+ 0.0,
14937+ 0.0,
14938+ 0.0,
14939+ 0.0,
14940+ 0.0,
14941+ 0.0,
14942+ 0.0,
14943+ 0.0
14944+ ]
14945+ },
14946+ "replace_donor_fewshot|procrustes|L2": {
14947+ "accuracy": 0.0,
14948+ "gain_vs_zero": {
14949+ "estimate": 0.0,
14950+ "low": 0.0,
14951+ "high": 0.0,
14952+ "level": 0.95,
14953+ "n_items": 35,
14954+ "n_clusters": 35,
14955+ "n_boot": 2000
14956+ },
14957+ "outputs_sample": [
14958+ " 7\n",
14959+ " 12\n",
14960+ " 83\n",
14961+ " 19\n",
14962+ " 71\n"
14963+ ],
14964+ "correct": [
14965+ 0.0,
14966+ 0.0,
14967+ 0.0,
14968+ 0.0,
14969+ 0.0,
14970+ 0.0,
14971+ 0.0,
14972+ 0.0,
14973+ 0.0,
14974+ 0.0,
14975+ 0.0,
14976+ 0.0,
14977+ 0.0,
14978+ 0.0,
14979+ 0.0,
14980+ 0.0,
14981+ 0.0,
14982+ 0.0,
14983+ 0.0,
14984+ 0.0,
14985+ 0.0,
14986+ 0.0,
14987+ 0.0,
14988+ 0.0,
14989+ 0.0,
14990+ 0.0,
14991+ 0.0,
14992+ 0.0,
14993+ 0.0,
14994+ 0.0,
14995+ 0.0,
14996+ 0.0,
14997+ 0.0,
14998+ 0.0,
14999+ 0.0
15000+ ]
15001+ },
15002+ "ctl_replace_donor_zeroshot|procrustes|L2": {
15003+ "accuracy": 0.0,
15004+ "gain_vs_zero": {
15005+ "estimate": 0.0,
15006+ "low": 0.0,
15007+ "high": 0.0,
15008+ "level": 0.95,
15009+ "n_items": 35,
15010+ "n_clusters": 35,
15011+ "n_boot": 2000
15012+ },
15013+ "outputs_sample": [
15014+ " 7\n",
15015+ " 12\n",
15016+ " 83\n",
15017+ " 19\n",
15018+ " 71\n"
15019+ ],
15020+ "correct": [
15021+ 0.0,
15022+ 0.0,
15023+ 0.0,
15024+ 0.0,
15025+ 0.0,
15026+ 0.0,
15027+ 0.0,
15028+ 0.0,
15029+ 0.0,
15030+ 0.0,
15031+ 0.0,
15032+ 0.0,
15033+ 0.0,
15034+ 0.0,
15035+ 0.0,
15036+ 0.0,
15037+ 0.0,
15038+ 0.0,
15039+ 0.0,
15040+ 0.0,
15041+ 0.0,
15042+ 0.0,
15043+ 0.0,
15044+ 0.0,
15045+ 0.0,
15046+ 0.0,
15047+ 0.0,
15048+ 0.0,
15049+ 0.0,
15050+ 0.0,
15051+ 0.0,
15052+ 0.0,
15053+ 0.0,
15054+ 0.0,
15055+ 0.0
15056+ ]
15057+ },
15058+ "ctl_replace_donor_fewshot_shuffled_query|procrustes|L2": {
15059+ "accuracy": 0.0,
15060+ "gain_vs_zero": {
15061+ "estimate": 0.0,
15062+ "low": 0.0,
15063+ "high": 0.0,
15064+ "level": 0.95,
15065+ "n_items": 35,
15066+ "n_clusters": 35,
15067+ "n_boot": 2000
15068+ },
15069+ "outputs_sample": [
15070+ " 7\n",
15071+ " 12\n",
15072+ " 83\n",
15073+ " 19\n",
15074+ " 71\n"
15075+ ],
15076+ "correct": [
15077+ 0.0,
15078+ 0.0,
15079+ 0.0,
15080+ 0.0,
15081+ 0.0,
15082+ 0.0,
15083+ 0.0,
15084+ 0.0,
15085+ 0.0,
15086+ 0.0,
15087+ 0.0,
15088+ 0.0,
15089+ 0.0,
15090+ 0.0,
15091+ 0.0,
15092+ 0.0,
15093+ 0.0,
15094+ 0.0,
15095+ 0.0,
15096+ 0.0,
15097+ 0.0,
15098+ 0.0,
15099+ 0.0,
15100+ 0.0,
15101+ 0.0,
15102+ 0.0,
15103+ 0.0,
15104+ 0.0,
15105+ 0.0,
15106+ 0.0,
15107+ 0.0,
15108+ 0.0,
15109+ 0.0,
15110+ 0.0,
15111+ 0.0
15112+ ]
15113+ },
15114+ "replace_donor_fewshot|ridge|L2": {
15115+ "accuracy": 0.0,
15116+ "gain_vs_zero": {
15117+ "estimate": 0.0,
15118+ "low": 0.0,
15119+ "high": 0.0,
15120+ "level": 0.95,
15121+ "n_items": 35,
15122+ "n_clusters": 35,
15123+ "n_boot": 2000
15124+ },
15125+ "outputs_sample": [
15126+ " 7\n",
15127+ " 12\n",
15128+ " 83\n",
15129+ " 19\n",
15130+ " 71\n"
15131+ ],
15132+ "correct": [
15133+ 0.0,
15134+ 0.0,
15135+ 0.0,
15136+ 0.0,
15137+ 0.0,
15138+ 0.0,
15139+ 0.0,
15140+ 0.0,
15141+ 0.0,
15142+ 0.0,
15143+ 0.0,
15144+ 0.0,
15145+ 0.0,
15146+ 0.0,
15147+ 0.0,
15148+ 0.0,
15149+ 0.0,
15150+ 0.0,
15151+ 0.0,
15152+ 0.0,
15153+ 0.0,
15154+ 0.0,
15155+ 0.0,
15156+ 0.0,
15157+ 0.0,
15158+ 0.0,
15159+ 0.0,
15160+ 0.0,
15161+ 0.0,
15162+ 0.0,
15163+ 0.0,
15164+ 0.0,
15165+ 0.0,
15166+ 0.0,
15167+ 0.0
15168+ ]
15169+ },
15170+ "ctl_replace_donor_zeroshot|ridge|L2": {
15171+ "accuracy": 0.0,
15172+ "gain_vs_zero": {
15173+ "estimate": 0.0,
15174+ "low": 0.0,
15175+ "high": 0.0,
15176+ "level": 0.95,
15177+ "n_items": 35,
15178+ "n_clusters": 35,
15179+ "n_boot": 2000
15180+ },
15181+ "outputs_sample": [
15182+ " 7\n",
15183+ " 24\n",
15184+ " 83\n",
15185+ " 19\n",
15186+ " 71\n"
15187+ ],
15188+ "correct": [
15189+ 0.0,
15190+ 0.0,
15191+ 0.0,
15192+ 0.0,
15193+ 0.0,
15194+ 0.0,
15195+ 0.0,
15196+ 0.0,
15197+ 0.0,
15198+ 0.0,
15199+ 0.0,
15200+ 0.0,
15201+ 0.0,
15202+ 0.0,
15203+ 0.0,
15204+ 0.0,
15205+ 0.0,
15206+ 0.0,
15207+ 0.0,
15208+ 0.0,
15209+ 0.0,
15210+ 0.0,
15211+ 0.0,
15212+ 0.0,
15213+ 0.0,
15214+ 0.0,
15215+ 0.0,
15216+ 0.0,
15217+ 0.0,
15218+ 0.0,
15219+ 0.0,
15220+ 0.0,
15221+ 0.0,
15222+ 0.0,
15223+ 0.0
15224+ ]
15225+ },
15226+ "ctl_replace_donor_fewshot_shuffled_query|ridge|L2": {
15227+ "accuracy": 0.0,
15228+ "gain_vs_zero": {
15229+ "estimate": 0.0,
15230+ "low": 0.0,
15231+ "high": 0.0,
15232+ "level": 0.95,
15233+ "n_items": 35,
15234+ "n_clusters": 35,
15235+ "n_boot": 2000
15236+ },
15237+ "outputs_sample": [
15238+ " 7\n",
15239+ " 12\n",
15240+ " 83\n",
15241+ " 19\n",
15242+ " 71\n"
15243+ ],
15244+ "correct": [
15245+ 0.0,
15246+ 0.0,
15247+ 0.0,
15248+ 0.0,
15249+ 0.0,
15250+ 0.0,
15251+ 0.0,
15252+ 0.0,
15253+ 0.0,
15254+ 0.0,
15255+ 0.0,
15256+ 0.0,
15257+ 0.0,
15258+ 0.0,
15259+ 0.0,
15260+ 0.0,
15261+ 0.0,
15262+ 0.0,
15263+ 0.0,
15264+ 0.0,
15265+ 0.0,
15266+ 0.0,
15267+ 0.0,
15268+ 0.0,
15269+ 0.0,
15270+ 0.0,
15271+ 0.0,
15272+ 0.0,
15273+ 0.0,
15274+ 0.0,
15275+ 0.0,
15276+ 0.0,
15277+ 0.0,
15278+ 0.0,
15279+ 0.0
15280+ ]
15281+ },
15282+ "ctl_replace_donor_fewshot|sham_map|L2": {
15283+ "accuracy": 0.0,
15284+ "gain_vs_zero": {
15285+ "estimate": 0.0,
15286+ "low": 0.0,
15287+ "high": 0.0,
15288+ "level": 0.95,
15289+ "n_items": 35,
15290+ "n_clusters": 35,
15291+ "n_boot": 2000
15292+ },
15293+ "outputs_sample": [
15294+ " 7\n",
15295+ " 12\n",
15296+ " 83\n",
15297+ " 19\n",
15298+ " 71\n"
15299+ ],
15300+ "correct": [
15301+ 0.0,
15302+ 0.0,
15303+ 0.0,
15304+ 0.0,
15305+ 0.0,
15306+ 0.0,
15307+ 0.0,
15308+ 0.0,
15309+ 0.0,
15310+ 0.0,
15311+ 0.0,
15312+ 0.0,
15313+ 0.0,
15314+ 0.0,
15315+ 0.0,
15316+ 0.0,
15317+ 0.0,
15318+ 0.0,
15319+ 0.0,
15320+ 0.0,
15321+ 0.0,
15322+ 0.0,
15323+ 0.0,
15324+ 0.0,
15325+ 0.0,
15326+ 0.0,
15327+ 0.0,
15328+ 0.0,
15329+ 0.0,
15330+ 0.0,
15331+ 0.0,
15332+ 0.0,
15333+ 0.0,
15334+ 0.0,
15335+ 0.0
15336+ ]
15337+ },
15338+ "ctl_replace_donor_zeroshot|sham_map|L2": {
15339+ "accuracy": 0.0,
15340+ "gain_vs_zero": {
15341+ "estimate": 0.0,
15342+ "low": 0.0,
15343+ "high": 0.0,
15344+ "level": 0.95,
15345+ "n_items": 35,
15346+ "n_clusters": 35,
15347+ "n_boot": 2000
15348+ },
15349+ "outputs_sample": [
15350+ " 7\n",
15351+ " 24\n",
15352+ " 83\n",
15353+ " 19\n",
15354+ " 71\n"
15355+ ],
15356+ "correct": [
15357+ 0.0,
15358+ 0.0,
15359+ 0.0,
15360+ 0.0,
15361+ 0.0,
15362+ 0.0,
15363+ 0.0,
15364+ 0.0,
15365+ 0.0,
15366+ 0.0,
15367+ 0.0,
15368+ 0.0,
15369+ 0.0,
15370+ 0.0,
15371+ 0.0,
15372+ 0.0,
15373+ 0.0,
15374+ 0.0,
15375+ 0.0,
15376+ 0.0,
15377+ 0.0,
15378+ 0.0,
15379+ 0.0,
15380+ 0.0,
15381+ 0.0,
15382+ 0.0,
15383+ 0.0,
15384+ 0.0,
15385+ 0.0,
15386+ 0.0,
15387+ 0.0,
15388+ 0.0,
15389+ 0.0,
15390+ 0.0,
15391+ 0.0
15392+ ]
15393+ },
15394+ "ctl_replace_donor_fewshot_shuffled_query|sham_map|L2": {
15395+ "accuracy": 0.0,
15396+ "gain_vs_zero": {
15397+ "estimate": 0.0,
15398+ "low": 0.0,
15399+ "high": 0.0,
15400+ "level": 0.95,
15401+ "n_items": 35,
15402+ "n_clusters": 35,
15403+ "n_boot": 2000
15404+ },
15405+ "outputs_sample": [
15406+ " 7\n",
15407+ " 24\n",
15408+ " 83\n",
15409+ " 19\n",
15410+ " 71\n"
15411+ ],
15412+ "correct": [
15413+ 0.0,
15414+ 0.0,
15415+ 0.0,
15416+ 0.0,
15417+ 0.0,
15418+ 0.0,
15419+ 0.0,
15420+ 0.0,
15421+ 0.0,
15422+ 0.0,
15423+ 0.0,
15424+ 0.0,
15425+ 0.0,
15426+ 0.0,
15427+ 0.0,
15428+ 0.0,
15429+ 0.0,
15430+ 0.0,
15431+ 0.0,
15432+ 0.0,
15433+ 0.0,
15434+ 0.0,
15435+ 0.0,
15436+ 0.0,
15437+ 0.0,
15438+ 0.0,
15439+ 0.0,
15440+ 0.0,
15441+ 0.0,
15442+ 0.0,
15443+ 0.0,
15444+ 0.0,
15445+ 0.0,
15446+ 0.0,
15447+ 0.0
15448+ ]
15449+ },
15450+ "ctl_random_norm_matched|L2": {
15451+ "accuracy": 0.0,
15452+ "gain_vs_zero": {
15453+ "estimate": 0.0,
15454+ "low": 0.0,
15455+ "high": 0.0,
15456+ "level": 0.95,
15457+ "n_items": 35,
15458+ "n_clusters": 35,
15459+ "n_boot": 2000
15460+ },
15461+ "correct": [
15462+ 0.0,
15463+ 0.0,
15464+ 0.0,
15465+ 0.0,
15466+ 0.0,
15467+ 0.0,
15468+ 0.0,
15469+ 0.0,
15470+ 0.0,
15471+ 0.0,
15472+ 0.0,
15473+ 0.0,
15474+ 0.0,
15475+ 0.0,
15476+ 0.0,
15477+ 0.0,
15478+ 0.0,
15479+ 0.0,
15480+ 0.0,
15481+ 0.0,
15482+ 0.0,
15483+ 0.0,
15484+ 0.0,
15485+ 0.0,
15486+ 0.0,
15487+ 0.0,
15488+ 0.0,
15489+ 0.0,
15490+ 0.0,
15491+ 0.0,
15492+ 0.0,
15493+ 0.0,
15494+ 0.0,
15495+ 0.0,
15496+ 0.0
15497+ ]
15498+ },
15499+ "ctl_unrelated_task_vector(antonym)|L2": {
15500+ "accuracy": 0.0,
15501+ "gain_vs_zero": {
15502+ "estimate": 0.0,
15503+ "low": 0.0,
15504+ "high": 0.0,
15505+ "level": 0.95,
15506+ "n_items": 35,
15507+ "n_clusters": 35,
15508+ "n_boot": 2000
15509+ },
15510+ "correct": [
15511+ 0.0,
15512+ 0.0,
15513+ 0.0,
15514+ 0.0,
15515+ 0.0,
15516+ 0.0,
15517+ 0.0,
15518+ 0.0,
15519+ 0.0,
15520+ 0.0,
15521+ 0.0,
15522+ 0.0,
15523+ 0.0,
15524+ 0.0,
15525+ 0.0,
15526+ 0.0,
15527+ 0.0,
15528+ 0.0,
15529+ 0.0,
15530+ 0.0,
15531+ 0.0,
15532+ 0.0,
15533+ 0.0,
15534+ 0.0,
15535+ 0.0,
15536+ 0.0,
15537+ 0.0,
15538+ 0.0,
15539+ 0.0,
15540+ 0.0,
15541+ 0.0,
15542+ 0.0,
15543+ 0.0,
15544+ 0.0,
15545+ 0.0
15546+ ]
15547+ },
15548+ "procrustes|L3|a1.0": {
15549+ "accuracy": 0.0,
15550+ "gain_vs_zero": {
15551+ "estimate": 0.0,
15552+ "low": 0.0,
15553+ "high": 0.0,
15554+ "level": 0.95,
15555+ "n_items": 35,
15556+ "n_clusters": 35,
15557+ "n_boot": 2000
15558+ },
15559+ "mapped_norm": 9.446496963500977,
15560+ "outputs_sample": [
15561+ " 7\n",
15562+ " 12\n",
15563+ " 83\n",
15564+ " 19\n",
15565+ " 71\n"
15566+ ],
15567+ "correct": [
15568+ 0.0,
15569+ 0.0,
15570+ 0.0,
15571+ 0.0,
15572+ 0.0,
15573+ 0.0,
15574+ 0.0,
15575+ 0.0,
15576+ 0.0,
15577+ 0.0,
15578+ 0.0,
15579+ 0.0,
15580+ 0.0,
15581+ 0.0,
15582+ 0.0,
15583+ 0.0,
15584+ 0.0,
15585+ 0.0,
15586+ 0.0,
15587+ 0.0,
15588+ 0.0,
15589+ 0.0,
15590+ 0.0,
15591+ 0.0,
15592+ 0.0,
15593+ 0.0,
15594+ 0.0,
15595+ 0.0,
15596+ 0.0,
15597+ 0.0,
15598+ 0.0,
15599+ 0.0,
15600+ 0.0,
15601+ 0.0,
15602+ 0.0
15603+ ]
15604+ },
15605+ "procrustes|L3|a2.0": {
15606+ "accuracy": 0.0,
15607+ "gain_vs_zero": {
15608+ "estimate": 0.0,
15609+ "low": 0.0,
15610+ "high": 0.0,
15611+ "level": 0.95,
15612+ "n_items": 35,
15613+ "n_clusters": 35,
15614+ "n_boot": 2000
15615+ },
15616+ "mapped_norm": 9.446496963500977,
15617+ "outputs_sample": [
15618+ " 7\n",
15619+ " 12\n",
15620+ " 83\n",
15621+ " 19\n",
15622+ " 71\n"
15623+ ],
15624+ "correct": [
15625+ 0.0,
15626+ 0.0,
15627+ 0.0,
15628+ 0.0,
15629+ 0.0,
15630+ 0.0,
15631+ 0.0,
15632+ 0.0,
15633+ 0.0,
15634+ 0.0,
15635+ 0.0,
15636+ 0.0,
15637+ 0.0,
15638+ 0.0,
15639+ 0.0,
15640+ 0.0,
15641+ 0.0,
15642+ 0.0,
15643+ 0.0,
15644+ 0.0,
15645+ 0.0,
15646+ 0.0,
15647+ 0.0,
15648+ 0.0,
15649+ 0.0,
15650+ 0.0,
15651+ 0.0,
15652+ 0.0,
15653+ 0.0,
15654+ 0.0,
15655+ 0.0,
15656+ 0.0,
15657+ 0.0,
15658+ 0.0,
15659+ 0.0
15660+ ]
15661+ },
15662+ "procrustes_rescaled|L3|a1.0": {
15663+ "accuracy": 0.0,
15664+ "gain_vs_zero": {
15665+ "estimate": 0.0,
15666+ "low": 0.0,
15667+ "high": 0.0,
15668+ "level": 0.95,
15669+ "n_items": 35,
15670+ "n_clusters": 35,
15671+ "n_boot": 2000
15672+ },
15673+ "mapped_norm": 5.985179901123047,
15674+ "outputs_sample": [
15675+ " 7\n",
15676+ " 12\n",
15677+ " 83\n",
15678+ " 19\n",
15679+ " 71\n"
15680+ ],
15681+ "correct": [
15682+ 0.0,
15683+ 0.0,
15684+ 0.0,
15685+ 0.0,
15686+ 0.0,
15687+ 0.0,
15688+ 0.0,
15689+ 0.0,
15690+ 0.0,
15691+ 0.0,
15692+ 0.0,
15693+ 0.0,
15694+ 0.0,
15695+ 0.0,
15696+ 0.0,
15697+ 0.0,
15698+ 0.0,
15699+ 0.0,
15700+ 0.0,
15701+ 0.0,
15702+ 0.0,
15703+ 0.0,
15704+ 0.0,
15705+ 0.0,
15706+ 0.0,
15707+ 0.0,
15708+ 0.0,
15709+ 0.0,
15710+ 0.0,
15711+ 0.0,
15712+ 0.0,
15713+ 0.0,
15714+ 0.0,
15715+ 0.0,
15716+ 0.0
15717+ ]
15718+ },
15719+ "ridge|L3|a1.0": {
15720+ "accuracy": 0.0,
15721+ "gain_vs_zero": {
15722+ "estimate": 0.0,
15723+ "low": 0.0,
15724+ "high": 0.0,
15725+ "level": 0.95,
15726+ "n_items": 35,
15727+ "n_clusters": 35,
15728+ "n_boot": 2000
15729+ },
15730+ "mapped_norm": 9.311967849731445,
15731+ "outputs_sample": [
15732+ " 7\n",
15733+ " 24\n",
15734+ " 83\n",
15735+ " 19\n",
15736+ " 71\n"
15737+ ],
15738+ "correct": [
15739+ 0.0,
15740+ 0.0,
15741+ 0.0,
15742+ 0.0,
15743+ 0.0,
15744+ 0.0,
15745+ 0.0,
15746+ 0.0,
15747+ 0.0,
15748+ 0.0,
15749+ 0.0,
15750+ 0.0,
15751+ 0.0,
15752+ 0.0,
15753+ 0.0,
15754+ 0.0,
15755+ 0.0,
15756+ 0.0,
15757+ 0.0,
15758+ 0.0,
15759+ 0.0,
15760+ 0.0,
15761+ 0.0,
15762+ 0.0,
15763+ 0.0,
15764+ 0.0,
15765+ 0.0,
15766+ 0.0,
15767+ 0.0,
15768+ 0.0,
15769+ 0.0,
15770+ 0.0,
15771+ 0.0,
15772+ 0.0,
15773+ 0.0
15774+ ]
15775+ },
15776+ "ridge|L3|a2.0": {
15777+ "accuracy": 0.0,
15778+ "gain_vs_zero": {
15779+ "estimate": 0.0,
15780+ "low": 0.0,
15781+ "high": 0.0,
15782+ "level": 0.95,
15783+ "n_items": 35,
15784+ "n_clusters": 35,
15785+ "n_boot": 2000
15786+ },
15787+ "mapped_norm": 9.311967849731445,
15788+ "outputs_sample": [
15789+ " 7\n",
15790+ " 12\n",
15791+ " 83\n",
15792+ " 19\n",
15793+ " 71\n"
15794+ ],
15795+ "correct": [
15796+ 0.0,
15797+ 0.0,
15798+ 0.0,
15799+ 0.0,
15800+ 0.0,
15801+ 0.0,
15802+ 0.0,
15803+ 0.0,
15804+ 0.0,
15805+ 0.0,
15806+ 0.0,
15807+ 0.0,
15808+ 0.0,
15809+ 0.0,
15810+ 0.0,
15811+ 0.0,
15812+ 0.0,
15813+ 0.0,
15814+ 0.0,
15815+ 0.0,
15816+ 0.0,
15817+ 0.0,
15818+ 0.0,
15819+ 0.0,
15820+ 0.0,
15821+ 0.0,
15822+ 0.0,
15823+ 0.0,
15824+ 0.0,
15825+ 0.0,
15826+ 0.0,
15827+ 0.0,
15828+ 0.0,
15829+ 0.0,
15830+ 0.0
15831+ ]
15832+ },
15833+ "ridge_rescaled|L3|a1.0": {
15834+ "accuracy": 0.0,
15835+ "gain_vs_zero": {
15836+ "estimate": 0.0,
15837+ "low": 0.0,
15838+ "high": 0.0,
15839+ "level": 0.95,
15840+ "n_items": 35,
15841+ "n_clusters": 35,
15842+ "n_boot": 2000
15843+ },
15844+ "mapped_norm": 5.985179901123047,
15845+ "outputs_sample": [
15846+ " 7\n",
15847+ " 12\n",
15848+ " 83\n",
15849+ " 19\n",
15850+ " 71\n"
15851+ ],
15852+ "correct": [
15853+ 0.0,
15854+ 0.0,
15855+ 0.0,
15856+ 0.0,
15857+ 0.0,
15858+ 0.0,
15859+ 0.0,
15860+ 0.0,
15861+ 0.0,
15862+ 0.0,
15863+ 0.0,
15864+ 0.0,
15865+ 0.0,
15866+ 0.0,
15867+ 0.0,
15868+ 0.0,
15869+ 0.0,
15870+ 0.0,
15871+ 0.0,
15872+ 0.0,
15873+ 0.0,
15874+ 0.0,
15875+ 0.0,
15876+ 0.0,
15877+ 0.0,
15878+ 0.0,
15879+ 0.0,
15880+ 0.0,
15881+ 0.0,
15882+ 0.0,
15883+ 0.0,
15884+ 0.0,
15885+ 0.0,
15886+ 0.0,
15887+ 0.0
15888+ ]
15889+ },
15890+ "cca|L3|a1.0": {
15891+ "accuracy": 0.0,
15892+ "gain_vs_zero": {
15893+ "estimate": 0.0,
15894+ "low": 0.0,
15895+ "high": 0.0,
15896+ "level": 0.95,
15897+ "n_items": 35,
15898+ "n_clusters": 35,
15899+ "n_boot": 2000
15900+ },
15901+ "mapped_norm": 10.181699752807617,
15902+ "outputs_sample": [
15903+ " 7\n",
15904+ " 12\n",
15905+ " 83\n",
15906+ " 19\n",
15907+ " 71\n"
15908+ ],
15909+ "correct": [
15910+ 0.0,
15911+ 0.0,
15912+ 0.0,
15913+ 0.0,
15914+ 0.0,
15915+ 0.0,
15916+ 0.0,
15917+ 0.0,
15918+ 0.0,
15919+ 0.0,
15920+ 0.0,
15921+ 0.0,
15922+ 0.0,
15923+ 0.0,
15924+ 0.0,
15925+ 0.0,
15926+ 0.0,
15927+ 0.0,
15928+ 0.0,
15929+ 0.0,
15930+ 0.0,
15931+ 0.0,
15932+ 0.0,
15933+ 0.0,
15934+ 0.0,
15935+ 0.0,
15936+ 0.0,
15937+ 0.0,
15938+ 0.0,
15939+ 0.0,
15940+ 0.0,
15941+ 0.0,
15942+ 0.0,
15943+ 0.0,
15944+ 0.0
15945+ ]
15946+ },
15947+ "cca|L3|a2.0": {
15948+ "accuracy": 0.0,
15949+ "gain_vs_zero": {
15950+ "estimate": 0.0,
15951+ "low": 0.0,
15952+ "high": 0.0,
15953+ "level": 0.95,
15954+ "n_items": 35,
15955+ "n_clusters": 35,
15956+ "n_boot": 2000
15957+ },
15958+ "mapped_norm": 10.181699752807617,
15959+ "outputs_sample": [
15960+ " 7\n",
15961+ " 12\n",
15962+ " 83\n",
15963+ " 19\n",
15964+ " 71\n"
15965+ ],
15966+ "correct": [
15967+ 0.0,
15968+ 0.0,
15969+ 0.0,
15970+ 0.0,
15971+ 0.0,
15972+ 0.0,
15973+ 0.0,
15974+ 0.0,
15975+ 0.0,
15976+ 0.0,
15977+ 0.0,
15978+ 0.0,
15979+ 0.0,
15980+ 0.0,
15981+ 0.0,
15982+ 0.0,
15983+ 0.0,
15984+ 0.0,
15985+ 0.0,
15986+ 0.0,
15987+ 0.0,
15988+ 0.0,
15989+ 0.0,
15990+ 0.0,
15991+ 0.0,
15992+ 0.0,
15993+ 0.0,
15994+ 0.0,
15995+ 0.0,
15996+ 0.0,
15997+ 0.0,
15998+ 0.0,
15999+ 0.0,
16000+ 0.0,
16001+ 0.0
16002+ ]
16003+ },
16004+ "random_orth|L3|a1.0": {
16005+ "accuracy": 0.0,
16006+ "gain_vs_zero": {
16007+ "estimate": 0.0,
16008+ "low": 0.0,
16009+ "high": 0.0,
16010+ "level": 0.95,
16011+ "n_items": 35,
16012+ "n_clusters": 35,
16013+ "n_boot": 2000
16014+ },
16015+ "mapped_norm": 10.008575439453125,
16016+ "outputs_sample": [
16017+ " 7\n",
16018+ " 12\n",
16019+ " 83\n",
16020+ " 19\n",
16021+ " 71\n"
16022+ ],
16023+ "correct": [
16024+ 0.0,
16025+ 0.0,
16026+ 0.0,
16027+ 0.0,
16028+ 0.0,
16029+ 0.0,
16030+ 0.0,
16031+ 0.0,
16032+ 0.0,
16033+ 0.0,
16034+ 0.0,
16035+ 0.0,
16036+ 0.0,
16037+ 0.0,
16038+ 0.0,
16039+ 0.0,
16040+ 0.0,
16041+ 0.0,
16042+ 0.0,
16043+ 0.0,
16044+ 0.0,
16045+ 0.0,
16046+ 0.0,
16047+ 0.0,
16048+ 0.0,
16049+ 0.0,
16050+ 0.0,
16051+ 0.0,
16052+ 0.0,
16053+ 0.0,
16054+ 0.0,
16055+ 0.0,
16056+ 0.0,
16057+ 0.0,
16058+ 0.0
16059+ ]
16060+ },
16061+ "random_orth|L3|a2.0": {
16062+ "accuracy": 0.0,
16063+ "gain_vs_zero": {
16064+ "estimate": 0.0,
16065+ "low": 0.0,
16066+ "high": 0.0,
16067+ "level": 0.95,
16068+ "n_items": 35,
16069+ "n_clusters": 35,
16070+ "n_boot": 2000
16071+ },
16072+ "mapped_norm": 10.008575439453125,
16073+ "outputs_sample": [
16074+ " 7\n",
16075+ " 12\n",
16076+ " 83\n",
16077+ " 19\n",
16078+ " 71\n"
16079+ ],
16080+ "correct": [
16081+ 0.0,
16082+ 0.0,
16083+ 0.0,
16084+ 0.0,
16085+ 0.0,
16086+ 0.0,
16087+ 0.0,
16088+ 0.0,
16089+ 0.0,
16090+ 0.0,
16091+ 0.0,
16092+ 0.0,
16093+ 0.0,
16094+ 0.0,
16095+ 0.0,
16096+ 0.0,
16097+ 0.0,
16098+ 0.0,
16099+ 0.0,
16100+ 0.0,
16101+ 0.0,
16102+ 0.0,
16103+ 0.0,
16104+ 0.0,
16105+ 0.0,
16106+ 0.0,
16107+ 0.0,
16108+ 0.0,
16109+ 0.0,
16110+ 0.0,
16111+ 0.0,
16112+ 0.0,
16113+ 0.0,
16114+ 0.0,
16115+ 0.0
16116+ ]
16117+ },
16118+ "replace_donor_fewshot|procrustes|L3": {
16119+ "accuracy": 0.0,
16120+ "gain_vs_zero": {
16121+ "estimate": 0.0,
16122+ "low": 0.0,
16123+ "high": 0.0,
16124+ "level": 0.95,
16125+ "n_items": 35,
16126+ "n_clusters": 35,
16127+ "n_boot": 2000
16128+ },
16129+ "outputs_sample": [
16130+ " 7\n",
16131+ " 12\n",
16132+ " 83\n",
16133+ " 19\n",
16134+ " 71\n"
16135+ ],
16136+ "correct": [
16137+ 0.0,
16138+ 0.0,
16139+ 0.0,
16140+ 0.0,
16141+ 0.0,
16142+ 0.0,
16143+ 0.0,
16144+ 0.0,
16145+ 0.0,
16146+ 0.0,
16147+ 0.0,
16148+ 0.0,
16149+ 0.0,
16150+ 0.0,
16151+ 0.0,
16152+ 0.0,
16153+ 0.0,
16154+ 0.0,
16155+ 0.0,
16156+ 0.0,
16157+ 0.0,
16158+ 0.0,
16159+ 0.0,
16160+ 0.0,
16161+ 0.0,
16162+ 0.0,
16163+ 0.0,
16164+ 0.0,
16165+ 0.0,
16166+ 0.0,
16167+ 0.0,
16168+ 0.0,
16169+ 0.0,
16170+ 0.0,
16171+ 0.0
16172+ ]
16173+ },
16174+ "ctl_replace_donor_zeroshot|procrustes|L3": {
16175+ "accuracy": 0.0,
16176+ "gain_vs_zero": {
16177+ "estimate": 0.0,
16178+ "low": 0.0,
16179+ "high": 0.0,
16180+ "level": 0.95,
16181+ "n_items": 35,
16182+ "n_clusters": 35,
16183+ "n_boot": 2000
16184+ },
16185+ "outputs_sample": [
16186+ " 7\n",
16187+ " 12\n",
16188+ " 83\n",
16189+ " 19\n",
16190+ " 71\n"
16191+ ],
16192+ "correct": [
16193+ 0.0,
16194+ 0.0,
16195+ 0.0,
16196+ 0.0,
16197+ 0.0,
16198+ 0.0,
16199+ 0.0,
16200+ 0.0,
16201+ 0.0,
16202+ 0.0,
16203+ 0.0,
16204+ 0.0,
16205+ 0.0,
16206+ 0.0,
16207+ 0.0,
16208+ 0.0,
16209+ 0.0,
16210+ 0.0,
16211+ 0.0,
16212+ 0.0,
16213+ 0.0,
16214+ 0.0,
16215+ 0.0,
16216+ 0.0,
16217+ 0.0,
16218+ 0.0,
16219+ 0.0,
16220+ 0.0,
16221+ 0.0,
16222+ 0.0,
16223+ 0.0,
16224+ 0.0,
16225+ 0.0,
16226+ 0.0,
16227+ 0.0
16228+ ]
16229+ },
16230+ "ctl_replace_donor_fewshot_shuffled_query|procrustes|L3": {
16231+ "accuracy": 0.0,
16232+ "gain_vs_zero": {
16233+ "estimate": 0.0,
16234+ "low": 0.0,
16235+ "high": 0.0,
16236+ "level": 0.95,
16237+ "n_items": 35,
16238+ "n_clusters": 35,
16239+ "n_boot": 2000
16240+ },
16241+ "outputs_sample": [
16242+ " 7\n",
16243+ " 12\n",
16244+ " 83\n",
16245+ " 19\n",
16246+ " 71\n"
16247+ ],
16248+ "correct": [
16249+ 0.0,
16250+ 0.0,
16251+ 0.0,
16252+ 0.0,
16253+ 0.0,
16254+ 0.0,
16255+ 0.0,
16256+ 0.0,
16257+ 0.0,
16258+ 0.0,
16259+ 0.0,
16260+ 0.0,
16261+ 0.0,
16262+ 0.0,
16263+ 0.0,
16264+ 0.0,
16265+ 0.0,
16266+ 0.0,
16267+ 0.0,
16268+ 0.0,
16269+ 0.0,
16270+ 0.0,
16271+ 0.0,
16272+ 0.0,
16273+ 0.0,
16274+ 0.0,
16275+ 0.0,
16276+ 0.0,
16277+ 0.0,
16278+ 0.0,
16279+ 0.0,
16280+ 0.0,
16281+ 0.0,
16282+ 0.0,
16283+ 0.0
16284+ ]
16285+ },
16286+ "replace_donor_fewshot|ridge|L3": {
16287+ "accuracy": 0.0,
16288+ "gain_vs_zero": {
16289+ "estimate": 0.0,
16290+ "low": 0.0,
16291+ "high": 0.0,
16292+ "level": 0.95,
16293+ "n_items": 35,
16294+ "n_clusters": 35,
16295+ "n_boot": 2000
16296+ },
16297+ "outputs_sample": [
16298+ " 7\n",
16299+ " 12\n",
16300+ " 83\n",
16301+ " 19\n",
16302+ " 71\n"
16303+ ],
16304+ "correct": [
16305+ 0.0,
16306+ 0.0,
16307+ 0.0,
16308+ 0.0,
16309+ 0.0,
16310+ 0.0,
16311+ 0.0,
16312+ 0.0,
16313+ 0.0,
16314+ 0.0,
16315+ 0.0,
16316+ 0.0,
16317+ 0.0,
16318+ 0.0,
16319+ 0.0,
16320+ 0.0,
16321+ 0.0,
16322+ 0.0,
16323+ 0.0,
16324+ 0.0,
16325+ 0.0,
16326+ 0.0,
16327+ 0.0,
16328+ 0.0,
16329+ 0.0,
16330+ 0.0,
16331+ 0.0,
16332+ 0.0,
16333+ 0.0,
16334+ 0.0,
16335+ 0.0,
16336+ 0.0,
16337+ 0.0,
16338+ 0.0,
16339+ 0.0
16340+ ]
16341+ },
16342+ "ctl_replace_donor_zeroshot|ridge|L3": {
16343+ "accuracy": 0.0,
16344+ "gain_vs_zero": {
16345+ "estimate": 0.0,
16346+ "low": 0.0,
16347+ "high": 0.0,
16348+ "level": 0.95,
16349+ "n_items": 35,
16350+ "n_clusters": 35,
16351+ "n_boot": 2000
16352+ },
16353+ "outputs_sample": [
16354+ " 7\n",
16355+ " 12\n",
16356+ " 83\n",
16357+ " 19\n",
16358+ " 71\n"
16359+ ],
16360+ "correct": [
16361+ 0.0,
16362+ 0.0,
16363+ 0.0,
16364+ 0.0,
16365+ 0.0,
16366+ 0.0,
16367+ 0.0,
16368+ 0.0,
16369+ 0.0,
16370+ 0.0,
16371+ 0.0,
16372+ 0.0,
16373+ 0.0,
16374+ 0.0,
16375+ 0.0,
16376+ 0.0,
16377+ 0.0,
16378+ 0.0,
16379+ 0.0,
16380+ 0.0,
16381+ 0.0,
16382+ 0.0,
16383+ 0.0,
16384+ 0.0,
16385+ 0.0,
16386+ 0.0,
16387+ 0.0,
16388+ 0.0,
16389+ 0.0,
16390+ 0.0,
16391+ 0.0,
16392+ 0.0,
16393+ 0.0,
16394+ 0.0,
16395+ 0.0
16396+ ]
16397+ },
16398+ "ctl_replace_donor_fewshot_shuffled_query|ridge|L3": {
16399+ "accuracy": 0.0,
16400+ "gain_vs_zero": {
16401+ "estimate": 0.0,
16402+ "low": 0.0,
16403+ "high": 0.0,
16404+ "level": 0.95,
16405+ "n_items": 35,
16406+ "n_clusters": 35,
16407+ "n_boot": 2000
16408+ },
16409+ "outputs_sample": [
16410+ " 7\n",
16411+ " 12\n",
16412+ " 83\n",
16413+ " 19\n",
16414+ " 71\n"
16415+ ],
16416+ "correct": [
16417+ 0.0,
16418+ 0.0,
16419+ 0.0,
16420+ 0.0,
16421+ 0.0,
16422+ 0.0,
16423+ 0.0,
16424+ 0.0,
16425+ 0.0,
16426+ 0.0,
16427+ 0.0,
16428+ 0.0,
16429+ 0.0,
16430+ 0.0,
16431+ 0.0,
16432+ 0.0,
16433+ 0.0,
16434+ 0.0,
16435+ 0.0,
16436+ 0.0,
16437+ 0.0,
16438+ 0.0,
16439+ 0.0,
16440+ 0.0,
16441+ 0.0,
16442+ 0.0,
16443+ 0.0,
16444+ 0.0,
16445+ 0.0,
16446+ 0.0,
16447+ 0.0,
16448+ 0.0,
16449+ 0.0,
16450+ 0.0,
16451+ 0.0
16452+ ]
16453+ },
16454+ "ctl_replace_donor_fewshot|sham_map|L3": {
16455+ "accuracy": 0.0,
16456+ "gain_vs_zero": {
16457+ "estimate": 0.0,
16458+ "low": 0.0,
16459+ "high": 0.0,
16460+ "level": 0.95,
16461+ "n_items": 35,
16462+ "n_clusters": 35,
16463+ "n_boot": 2000
16464+ },
16465+ "outputs_sample": [
16466+ " 7\n",
16467+ " 12\n",
16468+ " 83\n",
16469+ " 19\n",
16470+ " 71\n"
16471+ ],
16472+ "correct": [
16473+ 0.0,
16474+ 0.0,
16475+ 0.0,
16476+ 0.0,
16477+ 0.0,
16478+ 0.0,
16479+ 0.0,
16480+ 0.0,
16481+ 0.0,
16482+ 0.0,
16483+ 0.0,
16484+ 0.0,
16485+ 0.0,
16486+ 0.0,
16487+ 0.0,
16488+ 0.0,
16489+ 0.0,
16490+ 0.0,
16491+ 0.0,
16492+ 0.0,
16493+ 0.0,
16494+ 0.0,
16495+ 0.0,
16496+ 0.0,
16497+ 0.0,
16498+ 0.0,
16499+ 0.0,
16500+ 0.0,
16501+ 0.0,
16502+ 0.0,
16503+ 0.0,
16504+ 0.0,
16505+ 0.0,
16506+ 0.0,
16507+ 0.0
16508+ ]
16509+ },
16510+ "ctl_replace_donor_zeroshot|sham_map|L3": {
16511+ "accuracy": 0.0,
16512+ "gain_vs_zero": {
16513+ "estimate": 0.0,
16514+ "low": 0.0,
16515+ "high": 0.0,
16516+ "level": 0.95,
16517+ "n_items": 35,
16518+ "n_clusters": 35,
16519+ "n_boot": 2000
16520+ },
16521+ "outputs_sample": [
16522+ " 7\n",
16523+ " 24\n",
16524+ " 83\n",
16525+ " 19\n",
16526+ " 71\n"
16527+ ],
16528+ "correct": [
16529+ 0.0,
16530+ 0.0,
16531+ 0.0,
16532+ 0.0,
16533+ 0.0,
16534+ 0.0,
16535+ 0.0,
16536+ 0.0,
16537+ 0.0,
16538+ 0.0,
16539+ 0.0,
16540+ 0.0,
16541+ 0.0,
16542+ 0.0,
16543+ 0.0,
16544+ 0.0,
16545+ 0.0,
16546+ 0.0,
16547+ 0.0,
16548+ 0.0,
16549+ 0.0,
16550+ 0.0,
16551+ 0.0,
16552+ 0.0,
16553+ 0.0,
16554+ 0.0,
16555+ 0.0,
16556+ 0.0,
16557+ 0.0,
16558+ 0.0,
16559+ 0.0,
16560+ 0.0,
16561+ 0.0,
16562+ 0.0,
16563+ 0.0
16564+ ]
16565+ },
16566+ "ctl_replace_donor_fewshot_shuffled_query|sham_map|L3": {
16567+ "accuracy": 0.0,
16568+ "gain_vs_zero": {
16569+ "estimate": 0.0,
16570+ "low": 0.0,
16571+ "high": 0.0,
16572+ "level": 0.95,
16573+ "n_items": 35,
16574+ "n_clusters": 35,
16575+ "n_boot": 2000
16576+ },
16577+ "outputs_sample": [
16578+ " 7\n",
16579+ " 12\n",
16580+ " 83\n",
16581+ " 19\n",
16582+ " 71\n"
16583+ ],
16584+ "correct": [
16585+ 0.0,
16586+ 0.0,
16587+ 0.0,
16588+ 0.0,
16589+ 0.0,
16590+ 0.0,
16591+ 0.0,
16592+ 0.0,
16593+ 0.0,
16594+ 0.0,
16595+ 0.0,
16596+ 0.0,
16597+ 0.0,
16598+ 0.0,
16599+ 0.0,
16600+ 0.0,
16601+ 0.0,
16602+ 0.0,
16603+ 0.0,
16604+ 0.0,
16605+ 0.0,
16606+ 0.0,
16607+ 0.0,
16608+ 0.0,
16609+ 0.0,
16610+ 0.0,
16611+ 0.0,
16612+ 0.0,
16613+ 0.0,
16614+ 0.0,
16615+ 0.0,
16616+ 0.0,
16617+ 0.0,
16618+ 0.0,
16619+ 0.0
16620+ ]
16621+ },
16622+ "ctl_random_norm_matched|L3": {
16623+ "accuracy": 0.0,
16624+ "gain_vs_zero": {
16625+ "estimate": 0.0,
16626+ "low": 0.0,
16627+ "high": 0.0,
16628+ "level": 0.95,
16629+ "n_items": 35,
16630+ "n_clusters": 35,
16631+ "n_boot": 2000
16632+ },
16633+ "correct": [
16634+ 0.0,
16635+ 0.0,
16636+ 0.0,
16637+ 0.0,
16638+ 0.0,
16639+ 0.0,
16640+ 0.0,
16641+ 0.0,
16642+ 0.0,
16643+ 0.0,
16644+ 0.0,
16645+ 0.0,
16646+ 0.0,
16647+ 0.0,
16648+ 0.0,
16649+ 0.0,
16650+ 0.0,
16651+ 0.0,
16652+ 0.0,
16653+ 0.0,
16654+ 0.0,
16655+ 0.0,
16656+ 0.0,
16657+ 0.0,
16658+ 0.0,
16659+ 0.0,
16660+ 0.0,
16661+ 0.0,
16662+ 0.0,
16663+ 0.0,
16664+ 0.0,
16665+ 0.0,
16666+ 0.0,
16667+ 0.0,
16668+ 0.0
16669+ ]
16670+ },
16671+ "ctl_unrelated_task_vector(antonym)|L3": {
16672+ "accuracy": 0.0,
16673+ "gain_vs_zero": {
16674+ "estimate": 0.0,
16675+ "low": 0.0,
16676+ "high": 0.0,
16677+ "level": 0.95,
16678+ "n_items": 35,
16679+ "n_clusters": 35,
16680+ "n_boot": 2000
16681+ },
16682+ "correct": [
16683+ 0.0,
16684+ 0.0,
16685+ 0.0,
16686+ 0.0,
16687+ 0.0,
16688+ 0.0,
16689+ 0.0,
16690+ 0.0,
16691+ 0.0,
16692+ 0.0,
16693+ 0.0,
16694+ 0.0,
16695+ 0.0,
16696+ 0.0,
16697+ 0.0,
16698+ 0.0,
16699+ 0.0,
16700+ 0.0,
16701+ 0.0,
16702+ 0.0,
16703+ 0.0,
16704+ 0.0,
16705+ 0.0,
16706+ 0.0,
16707+ 0.0,
16708+ 0.0,
16709+ 0.0,
16710+ 0.0,
16711+ 0.0,
16712+ 0.0,
16713+ 0.0,
16714+ 0.0,
16715+ 0.0,
16716+ 0.0,
16717+ 0.0
16718+ ]
16719+ }
16720+ },
16721+ "items": {
16722+ "zero": [
16723+ 0.0,
16724+ 0.0,
16725+ 0.0,
16726+ 0.0,
16727+ 0.0,
16728+ 0.0,
16729+ 0.0,
16730+ 0.0,
16731+ 0.0,
16732+ 0.0,
16733+ 0.0,
16734+ 0.0,
16735+ 0.0,
16736+ 0.0,
16737+ 0.0,
16738+ 0.0,
16739+ 0.0,
16740+ 0.0,
16741+ 0.0,
16742+ 0.0,
16743+ 0.0,
16744+ 0.0,
16745+ 0.0,
16746+ 0.0,
16747+ 0.0,
16748+ 0.0,
16749+ 0.0,
16750+ 0.0,
16751+ 0.0,
16752+ 0.0,
16753+ 0.0,
16754+ 0.0,
16755+ 0.0,
16756+ 0.0,
16757+ 0.0
16758+ ],
16759+ "few": [
16760+ 1.0,
16761+ 1.0,
16762+ 1.0,
16763+ 1.0,
16764+ 1.0,
16765+ 1.0,
16766+ 1.0,
16767+ 1.0,
16768+ 1.0,
16769+ 1.0,
16770+ 1.0,
16771+ 1.0,
16772+ 1.0,
16773+ 1.0,
16774+ 1.0,
16775+ 1.0,
16776+ 1.0,
16777+ 1.0,
16778+ 1.0,
16779+ 1.0,
16780+ 1.0,
16781+ 1.0,
16782+ 1.0,
16783+ 1.0,
16784+ 1.0,
16785+ 1.0,
16786+ 1.0,
16787+ 1.0,
16788+ 1.0,
16789+ 1.0,
16790+ 1.0,
16791+ 1.0,
16792+ 1.0,
16793+ 1.0,
16794+ 1.0
16795+ ],
16796+ "own": [
16797+ 0.0,
16798+ 0.0,
16799+ 0.0,
16800+ 0.0,
16801+ 0.0,
16802+ 0.0,
16803+ 0.0,
16804+ 0.0,
16805+ 0.0,
16806+ 0.0,
16807+ 0.0,
16808+ 0.0,
16809+ 0.0,
16810+ 0.0,
16811+ 0.0,
16812+ 0.0,
16813+ 0.0,
16814+ 0.0,
16815+ 0.0,
16816+ 0.0,
16817+ 0.0,
16818+ 0.0,
16819+ 0.0,
16820+ 0.0,
16821+ 0.0,
16822+ 0.0,
16823+ 0.0,
16824+ 0.0,
16825+ 0.0,
16826+ 0.0,
16827+ 0.0,
16828+ 0.0,
16829+ 0.0,
16830+ 0.0,
16831+ 0.0
16832+ ]
16833+ }
16834+ }
16835+ },
16836+ "maps": {
16837+ "antonym|L16->L21|procrustes": {
16838+ "r2_fit": 0.8242908699345535,
16839+ "r2_heldout": 0.5913933873878174,
16840+ "n_params": 3147776,
16841+ "n_fit": 700
16842+ },
16843+ "antonym|L16->L21|ridge": {
16844+ "r2_fit": 0.9840400567727121,
16845+ "r2_heldout": 0.689455885937327,
16846+ "n_params": 3147776,
16847+ "n_fit": 700
16848+ },
16849+ "antonym|L16->L21|cca": {
16850+ "r2_fit": 1.0,
16851+ "r2_heldout": 0.5377708371911856,
16852+ "n_params": 3147776,
16853+ "n_fit": 700
16854+ },
16855+ "antonym|L16->L21|random_orth": {
16856+ "r2_fit": -1.0213353367698672,
16857+ "r2_heldout": -1.0271048022420954,
16858+ "n_params": 3147776,
16859+ "n_fit": 700
16860+ },
16861+ "antonym|L16->L25|procrustes": {
16862+ "r2_fit": 0.7789317263345014,
16863+ "r2_heldout": 0.5189323512035198,
16864+ "n_params": 3147776,
16865+ "n_fit": 700
16866+ },
16867+ "antonym|L16->L25|ridge": {
16868+ "r2_fit": 0.9768372484231601,
16869+ "r2_heldout": 0.561849639296945,
16870+ "n_params": 3147776,
16871+ "n_fit": 700
16872+ },
16873+ "antonym|L16->L25|cca": {
16874+ "r2_fit": 1.0,
16875+ "r2_heldout": 0.3522291325781527,
16876+ "n_params": 3147776,
16877+ "n_fit": 700
16878+ },
16879+ "antonym|L16->L25|random_orth": {
16880+ "r2_fit": -1.013307727170727,
16881+ "r2_heldout": -0.9742140107957578,
16882+ "n_params": 3147776,
16883+ "n_fit": 700
16884+ },
16885+ "capital|L22->L25|procrustes": {
16886+ "r2_fit": 0.6812579149842342,
16887+ "r2_heldout": 0.33049999614906345,
16888+ "n_params": 3147776,
16889+ "n_fit": 700
16890+ },
16891+ "capital|L22->L25|ridge": {
16892+ "r2_fit": 0.9980958684653297,
16893+ "r2_heldout": 0.2900994499441236,
16894+ "n_params": 3147776,
16895+ "n_fit": 700
16896+ },
16897+ "capital|L22->L25|cca": {
16898+ "r2_fit": 1.0,
16899+ "r2_heldout": 0.1727963417103383,
16900+ "n_params": 3147776,
16901+ "n_fit": 700
16902+ },
16903+ "capital|L22->L25|random_orth": {
16904+ "r2_fit": -1.0198097338466052,
16905+ "r2_heldout": -1.0727224352191658,
16906+ "n_params": 3147776,
16907+ "n_fit": 700
16908+ },
16909+ "capital|L22->L28|procrustes": {
16910+ "r2_fit": 0.7170739703394544,
16911+ "r2_heldout": 0.36713744532122183,
16912+ "n_params": 3147776,
16913+ "n_fit": 700
16914+ },
16915+ "capital|L22->L28|ridge": {
16916+ "r2_fit": 0.9979072175196985,
16917+ "r2_heldout": 0.2220964886238158,
16918+ "n_params": 3147776,
16919+ "n_fit": 700
16920+ },
16921+ "capital|L22->L28|cca": {
16922+ "r2_fit": 1.0,
16923+ "r2_heldout": 0.0975991245741894,
16924+ "n_params": 3147776,
16925+ "n_fit": 700
16926+ },
16927+ "capital|L22->L28|random_orth": {
16928+ "r2_fit": -1.0068048344805685,
16929+ "r2_heldout": -1.034999214455036,
16930+ "n_params": 3147776,
16931+ "n_fit": 700
16932+ },
16933+ "morph|L2->L2|procrustes": {
16934+ "r2_fit": 0.8768402596923065,
16935+ "r2_heldout": 0.8272276534578493,
16936+ "n_params": 3147776,
16937+ "n_fit": 700
16938+ },
16939+ "morph|L2->L2|ridge": {
16940+ "r2_fit": 0.9550618175123223,
16941+ "r2_heldout": 0.9249065149517056,
16942+ "n_params": 3147776,
16943+ "n_fit": 700
16944+ },
16945+ "morph|L2->L2|cca": {
16946+ "r2_fit": 1.0,
16947+ "r2_heldout": 0.9277687231418891,
16948+ "n_params": 3147776,
16949+ "n_fit": 700
16950+ },
16951+ "morph|L2->L2|random_orth": {
16952+ "r2_fit": -0.9796428978182967,
16953+ "r2_heldout": -0.9881587693428178,
16954+ "n_params": 3147776,
16955+ "n_fit": 700
16956+ },
16957+ "morph|L2->L3|procrustes": {
16958+ "r2_fit": 0.8908344763747743,
16959+ "r2_heldout": 0.8456872924889355,
16960+ "n_params": 3147776,
16961+ "n_fit": 700
16962+ },
16963+ "morph|L2->L3|ridge": {
16964+ "r2_fit": 0.9602412595525736,
16965+ "r2_heldout": 0.9332928632300228,
16966+ "n_params": 3147776,
16967+ "n_fit": 700
16968+ },
16969+ "morph|L2->L3|cca": {
16970+ "r2_fit": 1.0,
16971+ "r2_heldout": 0.9298938096912243,
16972+ "n_params": 3147776,
16973+ "n_fit": 700
16974+ },
16975+ "morph|L2->L3|random_orth": {
16976+ "r2_fit": -0.979687803645922,
16977+ "r2_heldout": -0.9987808883929721,
16978+ "n_params": 3147776,
16979+ "n_fit": 700
16980+ },
16981+ "addthree|L2->L2|procrustes": {
16982+ "r2_fit": 0.8768402596923065,
16983+ "r2_heldout": 0.8272276534578493,
16984+ "n_params": 3147776,
16985+ "n_fit": 700
16986+ },
16987+ "addthree|L2->L2|ridge": {
16988+ "r2_fit": 0.9550618175123223,
16989+ "r2_heldout": 0.9249065149517056,
16990+ "n_params": 3147776,
16991+ "n_fit": 700
16992+ },
16993+ "addthree|L2->L2|cca": {
16994+ "r2_fit": 1.0,
16995+ "r2_heldout": 0.9277687231418891,
16996+ "n_params": 3147776,
16997+ "n_fit": 700
16998+ },
16999+ "addthree|L2->L2|random_orth": {
17000+ "r2_fit": -0.9796428978182967,
17001+ "r2_heldout": -0.9881587693428178,
17002+ "n_params": 3147776,
17003+ "n_fit": 700
17004+ },
17005+ "addthree|L2->L3|procrustes": {
17006+ "r2_fit": 0.8908344763747743,
17007+ "r2_heldout": 0.8456872924889355,
17008+ "n_params": 3147776,
17009+ "n_fit": 700
17010+ },
17011+ "addthree|L2->L3|ridge": {
17012+ "r2_fit": 0.9602412595525736,
17013+ "r2_heldout": 0.9332928632300228,
17014+ "n_params": 3147776,
17015+ "n_fit": 700
17016+ },
17017+ "addthree|L2->L3|cca": {
17018+ "r2_fit": 1.0,
17019+ "r2_heldout": 0.9298938096912243,
17020+ "n_params": 3147776,
17021+ "n_fit": 700
17022+ },
17023+ "addthree|L2->L3|random_orth": {
17024+ "r2_fit": -0.979687803645922,
17025+ "r2_heldout": -0.9987808883929721,
17026+ "n_params": 3147776,
17027+ "n_fit": 700
17028+ }
17029+ },
17030+ "collateral": {
17031+ "antonym": {
17032+ "condition": "procrustes|L25|a1.0",
17033+ "heldout_nll_base": 1.9591156323750814,
17034+ "heldout_nll_with_vector": 1.8864750544230142,
17035+ "cross_task": {
17036+ "capital": {
17037+ "zero": 0.13636363636363635,
17038+ "with_vector": 0.0
17039+ },
17040+ "morph": {
17041+ "zero": 0.0,
17042+ "with_vector": 0.0
17043+ },
17044+ "addthree": {
17045+ "zero": 0.0,
17046+ "with_vector": 0.0
17047+ }
17048+ }
17049+ },
17050+ "capital": {
17051+ "condition": "procrustes|L25|a1.0",
17052+ "heldout_nll_base": 1.9591156323750814,
17053+ "heldout_nll_with_vector": 1.9340380668640136,
17054+ "cross_task": {
17055+ "antonym": {
17056+ "zero": 0.09375,
17057+ "with_vector": 0.0625
17058+ },
17059+ "morph": {
17060+ "zero": 0.0,
17061+ "with_vector": 0.0
17062+ },
17063+ "addthree": {
17064+ "zero": 0.0,
17065+ "with_vector": 0.0
17066+ }
17067+ }
17068+ },
17069+ "morph": {
17070+ "condition": "procrustes|L2|a1.0",
17071+ "heldout_nll_base": 1.9591156323750814,
17072+ "heldout_nll_with_vector": 1.929586378733317,
17073+ "cross_task": {
17074+ "antonym": {
17075+ "zero": 0.09375,
17076+ "with_vector": 0.0625
17077+ },
17078+ "capital": {
17079+ "zero": 0.13636363636363635,
17080+ "with_vector": 0.045454545454545456
17081+ },
17082+ "addthree": {
17083+ "zero": 0.0,
17084+ "with_vector": 0.0
17085+ }
17086+ }
17087+ },
17088+ "addthree": {
17089+ "condition": "procrustes|L2|a1.0",
17090+ "heldout_nll_base": 1.9591156323750814,
17091+ "heldout_nll_with_vector": 1.950550619761149,
17092+ "cross_task": {
17093+ "antonym": {
17094+ "zero": 0.09375,
17095+ "with_vector": 0.09375
17096+ },
17097+ "capital": {
17098+ "zero": 0.13636363636363635,
17099+ "with_vector": 0.045454545454545456
17100+ },
17101+ "morph": {
17102+ "zero": 0.0,
17103+ "with_vector": 0.0
17104+ }
17105+ }
17106+ }
17107+ }
17108+ },
17109+ "llama3b->qwen3b": {
17110+ "donor": "llama3b",
17111+ "recipient": "qwen3b",
17112+ "tasks": {
17113+ "antonym": {
17114+ "recipient_zero": 0.09375,
17115+ "recipient_few": 0.9375,
17116+ "recipient_own_vector": 0.90625,
17117+ "donor_layer": 14,
17118+ "conditions": {
17119+ "procrustes|L18|a1.0": {
17120+ "accuracy": 0.15625,
17121+ "gain_vs_zero": {
17122+ "estimate": 0.0625,
17123+ "low": -0.0625,
17124+ "high": 0.1875,
17125+ "level": 0.95,
17126+ "n_items": 32,
17127+ "n_clusters": 32,
17128+ "n_boot": 2000
17129+ },
17130+ "mapped_norm": 24.069671630859375,
17131+ "outputs_sample": [
17132+ " 3\n",
17133+ " 1\n",
17134+ " bright\n",
17135+ " cAaLm\n",
17136+ " under\n"
17137+ ],
17138+ "correct": [
17139+ 0.0,
17140+ 0.0,
17141+ 0.0,
17142+ 0.0,
17143+ 1.0,
17144+ 0.0,
17145+ 0.0,
17146+ 0.0,
17147+ 0.0,
17148+ 0.0,
17149+ 0.0,
17150+ 0.0,
17151+ 0.0,
17152+ 0.0,
17153+ 0.0,
17154+ 1.0,
17155+ 0.0,
17156+ 1.0,
17157+ 0.0,
17158+ 1.0,
17159+ 0.0,
17160+ 0.0,
17161+ 0.0,
17162+ 0.0,
17163+ 0.0,
17164+ 0.0,
17165+ 0.0,
17166+ 0.0,
17167+ 1.0,
17168+ 0.0,
17169+ 0.0,
17170+ 0.0
17171+ ]
17172+ },
17173+ "procrustes|L18|a2.0": {
17174+ "accuracy": 0.25,
17175+ "gain_vs_zero": {
17176+ "estimate": 0.15625,
17177+ "low": 0.0,
17178+ "high": 0.3125,
17179+ "level": 0.95,
17180+ "n_items": 32,
17181+ "n_clusters": 32,
17182+ "n_boot": 2000
17183+ },
17184+ "mapped_norm": 24.069671630859375,
17185+ "outputs_sample": [
17186+ " 4\n",
17187+ " arrive\n",
17188+ " bright\n",
17189+ " calm\n",
17190+ " over\n"
17191+ ],
17192+ "correct": [
17193+ 0.0,
17194+ 0.0,
17195+ 0.0,
17196+ 0.0,
17197+ 0.0,
17198+ 0.0,
17199+ 0.0,
17200+ 0.0,
17201+ 0.0,
17202+ 0.0,
17203+ 1.0,
17204+ 0.0,
17205+ 1.0,
17206+ 0.0,
17207+ 0.0,
17208+ 1.0,
17209+ 0.0,
17210+ 1.0,
17211+ 0.0,
17212+ 1.0,
17213+ 0.0,
17214+ 0.0,
17215+ 0.0,
17216+ 1.0,
17217+ 1.0,
17218+ 0.0,
17219+ 0.0,
17220+ 0.0,
17221+ 1.0,
17222+ 0.0,
17223+ 0.0,
17224+ 0.0
17225+ ]
17226+ },
17227+ "procrustes_rescaled|L18|a1.0": {
17228+ "accuracy": 0.25,
17229+ "gain_vs_zero": {
17230+ "estimate": 0.15625,
17231+ "low": 0.0,
17232+ "high": 0.3125,
17233+ "level": 0.95,
17234+ "n_items": 32,
17235+ "n_clusters": 32,
17236+ "n_boot": 2000
17237+ },
17238+ "mapped_norm": 57.11780548095703,
17239+ "outputs_sample": [
17240+ " happy\n",
17241+ " arrive\n",
17242+ " bright\n",
17243+ " calm\n",
17244+ " over\n"
17245+ ],
17246+ "correct": [
17247+ 0.0,
17248+ 0.0,
17249+ 0.0,
17250+ 0.0,
17251+ 0.0,
17252+ 0.0,
17253+ 0.0,
17254+ 0.0,
17255+ 0.0,
17256+ 0.0,
17257+ 1.0,
17258+ 0.0,
17259+ 1.0,
17260+ 0.0,
17261+ 0.0,
17262+ 1.0,
17263+ 0.0,
17264+ 1.0,
17265+ 0.0,
17266+ 1.0,
17267+ 0.0,
17268+ 0.0,
17269+ 0.0,
17270+ 1.0,
17271+ 1.0,
17272+ 0.0,
17273+ 0.0,
17274+ 0.0,
17275+ 1.0,
17276+ 0.0,
17277+ 0.0,
17278+ 0.0
17279+ ]
17280+ },
17281+ "ridge|L18|a1.0": {
17282+ "accuracy": 0.25,
17283+ "gain_vs_zero": {
17284+ "estimate": 0.15625,
17285+ "low": 0.03125,
17286+ "high": 0.28125,
17287+ "level": 0.95,
17288+ "n_items": 32,
17289+ "n_clusters": 32,
17290+ "n_boot": 2000
17291+ },
17292+ "mapped_norm": 31.35213279724121,
17293+ "outputs_sample": [
17294+ " h-a-p-p-y\n",
17295+ " 1\n",
17296+ " bright\n",
17297+ " cAml\n",
17298+ " under\n"
17299+ ],
17300+ "correct": [
17301+ 0.0,
17302+ 0.0,
17303+ 0.0,
17304+ 0.0,
17305+ 1.0,
17306+ 0.0,
17307+ 0.0,
17308+ 0.0,
17309+ 0.0,
17310+ 0.0,
17311+ 0.0,
17312+ 1.0,
17313+ 1.0,
17314+ 0.0,
17315+ 0.0,
17316+ 1.0,
17317+ 0.0,
17318+ 1.0,
17319+ 0.0,
17320+ 1.0,
17321+ 0.0,
17322+ 0.0,
17323+ 0.0,
17324+ 0.0,
17325+ 1.0,
17326+ 0.0,
17327+ 0.0,
17328+ 0.0,
17329+ 1.0,
17330+ 0.0,
17331+ 0.0,
17332+ 0.0
17333+ ]
17334+ },
17335+ "ridge|L18|a2.0": {
17336+ "accuracy": 0.3125,
17337+ "gain_vs_zero": {
17338+ "estimate": 0.21875,
17339+ "low": 0.0625,
17340+ "high": 0.375,
17341+ "level": 0.95,
17342+ "n_items": 32,
17343+ "n_clusters": 32,
17344+ "n_boot": 2000
17345+ },
17346+ "mapped_norm": 31.35213279724121,
17347+ "outputs_sample": [
17348+ " sad\n",
17349+ " 1\n",
17350+ " light\n",
17351+ " calm\n",
17352+ " over\n"
17353+ ],
17354+ "correct": [
17355+ 1.0,
17356+ 0.0,
17357+ 0.0,
17358+ 0.0,
17359+ 0.0,
17360+ 0.0,
17361+ 0.0,
17362+ 0.0,
17363+ 1.0,
17364+ 0.0,
17365+ 1.0,
17366+ 0.0,
17367+ 0.0,
17368+ 0.0,
17369+ 0.0,
17370+ 1.0,
17371+ 0.0,
17372+ 1.0,
17373+ 0.0,
17374+ 1.0,
17375+ 1.0,
17376+ 0.0,
17377+ 0.0,
17378+ 1.0,
17379+ 1.0,
17380+ 0.0,
17381+ 0.0,
17382+ 0.0,
17383+ 1.0,
17384+ 0.0,
17385+ 0.0,
17386+ 0.0
17387+ ]
17388+ },
17389+ "ridge_rescaled|L18|a1.0": {
17390+ "accuracy": 0.4375,
17391+ "gain_vs_zero": {
17392+ "estimate": 0.34375,
17393+ "low": 0.15625,
17394+ "high": 0.53125,
17395+ "level": 0.95,
17396+ "n_items": 32,
17397+ "n_clusters": 32,
17398+ "n_boot": 2000
17399+ },
17400+ "mapped_norm": 57.1178092956543,
17401+ "outputs_sample": [
17402+ " sad\n",
17403+ " 1\n",
17404+ " light\n",
17405+ " calm\n",
17406+ " over\n"
17407+ ],
17408+ "correct": [
17409+ 1.0,
17410+ 0.0,
17411+ 0.0,
17412+ 0.0,
17413+ 0.0,
17414+ 0.0,
17415+ 0.0,
17416+ 0.0,
17417+ 1.0,
17418+ 0.0,
17419+ 1.0,
17420+ 0.0,
17421+ 1.0,
17422+ 1.0,
17423+ 0.0,
17424+ 1.0,
17425+ 1.0,
17426+ 1.0,
17427+ 0.0,
17428+ 1.0,
17429+ 1.0,
17430+ 0.0,
17431+ 0.0,
17432+ 1.0,
17433+ 1.0,
17434+ 0.0,
17435+ 0.0,
17436+ 0.0,
17437+ 1.0,
17438+ 1.0,
17439+ 0.0,
17440+ 0.0
17441+ ]
17442+ },
17443+ "cca|L18|a1.0": {
17444+ "accuracy": 0.46875,
17445+ "gain_vs_zero": {
17446+ "estimate": 0.375,
17447+ "low": 0.21875,
17448+ "high": 0.5320312499999957,
17449+ "level": 0.95,
17450+ "n_items": 32,
17451+ "n_clusters": 32,
17452+ "n_boot": 2000
17453+ },
17454+ "mapped_norm": 34.392704010009766,
17455+ "outputs_sample": [
17456+ " 3\n",
17457+ " 1\n",
17458+ " light\n",
17459+ " Calm\n",
17460+ " under\n"
17461+ ],
17462+ "correct": [
17463+ 0.0,
17464+ 0.0,
17465+ 0.0,
17466+ 0.0,
17467+ 1.0,
17468+ 0.0,
17469+ 0.0,
17470+ 0.0,
17471+ 0.0,
17472+ 0.0,
17473+ 1.0,
17474+ 1.0,
17475+ 1.0,
17476+ 1.0,
17477+ 0.0,
17478+ 1.0,
17479+ 1.0,
17480+ 1.0,
17481+ 1.0,
17482+ 1.0,
17483+ 1.0,
17484+ 0.0,
17485+ 0.0,
17486+ 1.0,
17487+ 1.0,
17488+ 0.0,
17489+ 0.0,
17490+ 1.0,
17491+ 1.0,
17492+ 0.0,
17493+ 0.0,
17494+ 0.0
17495+ ]
17496+ },
17497+ "cca|L18|a2.0": {
17498+ "accuracy": 0.375,
17499+ "gain_vs_zero": {
17500+ "estimate": 0.28125,
17501+ "low": 0.125,
17502+ "high": 0.46875,
17503+ "level": 0.95,
17504+ "n_items": 32,
17505+ "n_clusters": 32,
17506+ "n_boot": 2000
17507+ },
17508+ "mapped_norm": 34.392704010009766,
17509+ "outputs_sample": [
17510+ " sad\n",
17511+ " arrive\n",
17512+ " dark\n",
17513+ " calm\n",
17514+ " over\n"
17515+ ],
17516+ "correct": [
17517+ 1.0,
17518+ 0.0,
17519+ 1.0,
17520+ 0.0,
17521+ 0.0,
17522+ 0.0,
17523+ 0.0,
17524+ 0.0,
17525+ 0.0,
17526+ 0.0,
17527+ 1.0,
17528+ 0.0,
17529+ 1.0,
17530+ 1.0,
17531+ 0.0,
17532+ 1.0,
17533+ 0.0,
17534+ 1.0,
17535+ 0.0,
17536+ 1.0,
17537+ 1.0,
17538+ 0.0,
17539+ 0.0,
17540+ 1.0,
17541+ 1.0,
17542+ 0.0,
17543+ 0.0,
17544+ 0.0,
17545+ 1.0,
17546+ 0.0,
17547+ 0.0,
17548+ 0.0
17549+ ]
17550+ },
17551+ "random_orth|L18|a1.0": {
17552+ "accuracy": 0.1875,
17553+ "gain_vs_zero": {
17554+ "estimate": 0.09375,
17555+ "low": 0.0,
17556+ "high": 0.1875,
17557+ "level": 0.95,
17558+ "n_items": 32,
17559+ "n_clusters": 32,
17560+ "n_boot": 2000
17561+ },
17562+ "mapped_norm": 25.001222610473633,
17563+ "outputs_sample": [
17564+ " 5\n",
17565+ " 1\n",
17566+ " The word \"bright\" is",
17567+ " 3\n",
17568+ " The word \"over\" is"
17569+ ],
17570+ "correct": [
17571+ 0.0,
17572+ 0.0,
17573+ 0.0,
17574+ 0.0,
17575+ 0.0,
17576+ 0.0,
17577+ 0.0,
17578+ 0.0,
17579+ 0.0,
17580+ 0.0,
17581+ 0.0,
17582+ 1.0,
17583+ 0.0,
17584+ 0.0,
17585+ 0.0,
17586+ 1.0,
17587+ 0.0,
17588+ 1.0,
17589+ 0.0,
17590+ 1.0,
17591+ 0.0,
17592+ 0.0,
17593+ 0.0,
17594+ 1.0,
17595+ 1.0,
17596+ 0.0,
17597+ 0.0,
17598+ 0.0,
17599+ 0.0,
17600+ 0.0,
17601+ 0.0,
17602+ 0.0
17603+ ]
17604+ },
17605+ "random_orth|L18|a2.0": {
17606+ "accuracy": 0.21875,
17607+ "gain_vs_zero": {
17608+ "estimate": 0.125,
17609+ "low": 0.03125,
17610+ "high": 0.25,
17611+ "level": 0.95,
17612+ "n_items": 32,
17613+ "n_clusters": 32,
17614+ "n_boot": 2000
17615+ },
17616+ "mapped_norm": 25.001222610473633,
17617+ "outputs_sample": [
17618+ " sad\n",
17619+ " 1\n",
17620+ " \"Bright\"\n",
17621+ " \"aCML\"\n",
17622+ " The word \"over\" is"
17623+ ],
17624+ "correct": [
17625+ 1.0,
17626+ 0.0,
17627+ 0.0,
17628+ 0.0,
17629+ 0.0,
17630+ 0.0,
17631+ 0.0,
17632+ 0.0,
17633+ 0.0,
17634+ 0.0,
17635+ 1.0,
17636+ 1.0,
17637+ 0.0,
17638+ 0.0,
17639+ 0.0,
17640+ 1.0,
17641+ 0.0,
17642+ 1.0,
17643+ 0.0,
17644+ 1.0,
17645+ 0.0,
17646+ 0.0,
17647+ 0.0,
17648+ 0.0,
17649+ 1.0,
17650+ 0.0,
17651+ 0.0,
17652+ 0.0,
17653+ 0.0,
17654+ 0.0,
17655+ 0.0,
17656+ 0.0
17657+ ]
17658+ },
17659+ "replace_donor_fewshot|procrustes|L18": {
17660+ "accuracy": 0.28125,
17661+ "gain_vs_zero": {
17662+ "estimate": 0.1875,
17663+ "low": 0.03125,
17664+ "high": 0.34375,
17665+ "level": 0.95,
17666+ "n_items": 32,
17667+ "n_clusters": 32,
17668+ "n_boot": 2000
17669+ },
17670+ "outputs_sample": [
17671+ " 3\n",
17672+ " 1\n",
17673+ " 1\n",
17674+ " cAml\n",
17675+ " over\n"
17676+ ],
17677+ "correct": [
17678+ 0.0,
17679+ 0.0,
17680+ 0.0,
17681+ 0.0,
17682+ 0.0,
17683+ 0.0,
17684+ 0.0,
17685+ 0.0,
17686+ 0.0,
17687+ 0.0,
17688+ 1.0,
17689+ 0.0,
17690+ 1.0,
17691+ 0.0,
17692+ 0.0,
17693+ 1.0,
17694+ 1.0,
17695+ 1.0,
17696+ 0.0,
17697+ 1.0,
17698+ 0.0,
17699+ 0.0,
17700+ 0.0,
17701+ 1.0,
17702+ 1.0,
17703+ 0.0,
17704+ 0.0,
17705+ 0.0,
17706+ 1.0,
17707+ 0.0,
17708+ 0.0,
17709+ 0.0
17710+ ]
17711+ },
17712+ "ctl_replace_donor_zeroshot|procrustes|L18": {
17713+ "accuracy": 0.125,
17714+ "gain_vs_zero": {
17715+ "estimate": 0.03125,
17716+ "low": 0.0,
17717+ "high": 0.09375,
17718+ "level": 0.95,
17719+ "n_items": 32,
17720+ "n_clusters": 32,
17721+ "n_boot": 2000
17722+ },
17723+ "outputs_sample": [
17724+ " 4\n",
17725+ " 1\n",
17726+ " The word \"bright\" is",
17727+ " a\n",
17728+ " 1\n"
17729+ ],
17730+ "correct": [
17731+ 0.0,
17732+ 0.0,
17733+ 0.0,
17734+ 0.0,
17735+ 0.0,
17736+ 0.0,
17737+ 0.0,
17738+ 0.0,
17739+ 0.0,
17740+ 0.0,
17741+ 0.0,
17742+ 1.0,
17743+ 0.0,
17744+ 0.0,
17745+ 0.0,
17746+ 0.0,
17747+ 0.0,
17748+ 1.0,
17749+ 0.0,
17750+ 1.0,
17751+ 0.0,
17752+ 0.0,
17753+ 0.0,
17754+ 0.0,
17755+ 0.0,
17756+ 0.0,
17757+ 0.0,
17758+ 1.0,
17759+ 0.0,
17760+ 0.0,
17761+ 0.0,
17762+ 0.0
17763+ ]
17764+ },
17765+ "ctl_replace_donor_fewshot_shuffled_query|procrustes|L18": {
17766+ "accuracy": 0.25,
17767+ "gain_vs_zero": {
17768+ "estimate": 0.15625,
17769+ "low": 0.0,
17770+ "high": 0.3125,
17771+ "level": 0.95,
17772+ "n_items": 32,
17773+ "n_clusters": 32,
17774+ "n_boot": 2000
17775+ },
17776+ "outputs_sample": [
17777+ " 3\n",
17778+ " 1\n",
17779+ " \"Bright\"\n",
17780+ " True\n",
17781+ " under\n"
17782+ ],
17783+ "correct": [
17784+ 0.0,
17785+ 0.0,
17786+ 0.0,
17787+ 0.0,
17788+ 1.0,
17789+ 0.0,
17790+ 0.0,
17791+ 0.0,
17792+ 0.0,
17793+ 0.0,
17794+ 1.0,
17795+ 0.0,
17796+ 0.0,
17797+ 0.0,
17798+ 0.0,
17799+ 1.0,
17800+ 1.0,
17801+ 1.0,
17802+ 0.0,
17803+ 1.0,
17804+ 0.0,
17805+ 0.0,
17806+ 0.0,
17807+ 0.0,
17808+ 1.0,
17809+ 0.0,
17810+ 0.0,
17811+ 0.0,
17812+ 1.0,
17813+ 0.0,
17814+ 0.0,
17815+ 0.0
17816+ ]
17817+ },
17818+ "replace_donor_fewshot|ridge|L18": {
17819+ "accuracy": 0.21875,
17820+ "gain_vs_zero": {
17821+ "estimate": 0.125,
17822+ "low": 0.0,
17823+ "high": 0.28125,
17824+ "level": 0.95,
17825+ "n_items": 32,
17826+ "n_clusters": 32,
17827+ "n_boot": 2000
17828+ },
17829+ "outputs_sample": [
17830+ " 3\n",
17831+ " 1\n",
17832+ " light\n",
17833+ " False\n",
17834+ " over\n"
17835+ ],
17836+ "correct": [
17837+ 0.0,
17838+ 0.0,
17839+ 0.0,
17840+ 0.0,
17841+ 0.0,
17842+ 0.0,
17843+ 0.0,
17844+ 0.0,
17845+ 0.0,
17846+ 0.0,
17847+ 0.0,
17848+ 0.0,
17849+ 1.0,
17850+ 0.0,
17851+ 0.0,
17852+ 1.0,
17853+ 0.0,
17854+ 1.0,
17855+ 1.0,
17856+ 1.0,
17857+ 0.0,
17858+ 0.0,
17859+ 0.0,
17860+ 0.0,
17861+ 1.0,
17862+ 0.0,
17863+ 0.0,
17864+ 0.0,
17865+ 1.0,
17866+ 0.0,
17867+ 0.0,
17868+ 0.0
17869+ ]
17870+ },
17871+ "ctl_replace_donor_zeroshot|ridge|L18": {
17872+ "accuracy": 0.09375,
17873+ "gain_vs_zero": {
17874+ "estimate": 0.0,
17875+ "low": 0.0,
17876+ "high": 0.0,
17877+ "level": 0.95,
17878+ "n_items": 32,
17879+ "n_clusters": 32,
17880+ "n_boot": 2000
17881+ },
17882+ "outputs_sample": [
17883+ " 4\n",
17884+ " 1\n",
17885+ " 4\n",
17886+ " a\n",
17887+ " 1\n"
17888+ ],
17889+ "correct": [
17890+ 0.0,
17891+ 0.0,
17892+ 0.0,
17893+ 0.0,
17894+ 0.0,
17895+ 0.0,
17896+ 0.0,
17897+ 0.0,
17898+ 0.0,
17899+ 0.0,
17900+ 0.0,
17901+ 1.0,
17902+ 0.0,
17903+ 0.0,
17904+ 0.0,
17905+ 0.0,
17906+ 0.0,
17907+ 1.0,
17908+ 0.0,
17909+ 1.0,
17910+ 0.0,
17911+ 0.0,
17912+ 0.0,
17913+ 0.0,
17914+ 0.0,
17915+ 0.0,
17916+ 0.0,
17917+ 0.0,
17918+ 0.0,
17919+ 0.0,
17920+ 0.0,
17921+ 0.0
17922+ ]
17923+ },
17924+ "ctl_replace_donor_fewshot_shuffled_query|ridge|L18": {
17925+ "accuracy": 0.15625,
17926+ "gain_vs_zero": {
17927+ "estimate": 0.0625,
17928+ "low": -0.0625,
17929+ "high": 0.1875,
17930+ "level": 0.95,
17931+ "n_items": 32,
17932+ "n_clusters": 32,
17933+ "n_boot": 2000
17934+ },
17935+ "outputs_sample": [
17936+ " 3\n",
17937+ " 1\n",
17938+ " True\n",
17939+ " True\n",
17940+ " 1\n"
17941+ ],
17942+ "correct": [
17943+ 0.0,
17944+ 0.0,
17945+ 0.0,
17946+ 0.0,
17947+ 0.0,
17948+ 0.0,
17949+ 0.0,
17950+ 0.0,
17951+ 0.0,
17952+ 0.0,
17953+ 0.0,
17954+ 0.0,
17955+ 0.0,
17956+ 0.0,
17957+ 0.0,
17958+ 1.0,
17959+ 0.0,
17960+ 1.0,
17961+ 0.0,
17962+ 1.0,
17963+ 0.0,
17964+ 0.0,
17965+ 0.0,
17966+ 0.0,
17967+ 1.0,
17968+ 0.0,
17969+ 0.0,
17970+ 0.0,
17971+ 1.0,
17972+ 0.0,
17973+ 0.0,
17974+ 0.0
17975+ ]
17976+ },
17977+ "ctl_replace_donor_fewshot|sham_map|L18": {
17978+ "accuracy": 0.21875,
17979+ "gain_vs_zero": {
17980+ "estimate": 0.125,
17981+ "low": 0.03125,
17982+ "high": 0.25,
17983+ "level": 0.95,
17984+ "n_items": 32,
17985+ "n_clusters": 32,
17986+ "n_boot": 2000
17987+ },
17988+ "outputs_sample": [
17989+ " The word \"happy\" is",
17990+ " 1\n",
17991+ " The word \"bright\" is",
17992+ " The word \"calm\"",
17993+ " 1\n"
17994+ ],
17995+ "correct": [
17996+ 0.0,
17997+ 0.0,
17998+ 0.0,
17999+ 0.0,
18000+ 0.0,
18001+ 0.0,
18002+ 0.0,
18003+ 0.0,
18004+ 0.0,
18005+ 0.0,
18006+ 1.0,
18007+ 1.0,
18008+ 0.0,
18009+ 0.0,
18010+ 0.0,
18011+ 1.0,
18012+ 0.0,
18013+ 1.0,
18014+ 0.0,
18015+ 1.0,
18016+ 0.0,
18017+ 0.0,
18018+ 0.0,
18019+ 0.0,
18020+ 0.0,
18021+ 0.0,
18022+ 0.0,
18023+ 1.0,
18024+ 1.0,
18025+ 0.0,
18026+ 0.0,
18027+ 0.0
18028+ ]
18029+ },
18030+ "ctl_replace_donor_zeroshot|sham_map|L18": {
18031+ "accuracy": 0.125,
18032+ "gain_vs_zero": {
18033+ "estimate": 0.03125,
18034+ "low": -0.0625,
18035+ "high": 0.125,
18036+ "level": 0.95,
18037+ "n_items": 32,
18038+ "n_clusters": 32,
18039+ "n_boot": 2000
18040+ },
18041+ "outputs_sample": [
18042+ " 4\n",
18043+ " 1\n",
18044+ " The word \"bright\" is",
18045+ " \"aCML\"\n",
18046+ " 1\n"
18047+ ],
18048+ "correct": [
18049+ 0.0,
18050+ 0.0,
18051+ 0.0,
18052+ 0.0,
18053+ 0.0,
18054+ 0.0,
18055+ 0.0,
18056+ 0.0,
18057+ 0.0,
18058+ 0.0,
18059+ 1.0,
18060+ 0.0,
18061+ 0.0,
18062+ 0.0,
18063+ 0.0,
18064+ 1.0,
18065+ 0.0,
18066+ 1.0,
18067+ 0.0,
18068+ 1.0,
18069+ 0.0,
18070+ 0.0,
18071+ 0.0,
18072+ 0.0,
18073+ 0.0,
18074+ 0.0,
18075+ 0.0,
18076+ 0.0,
18077+ 0.0,
18078+ 0.0,
18079+ 0.0,
18080+ 0.0
18081+ ]
18082+ },
18083+ "ctl_replace_donor_fewshot_shuffled_query|sham_map|L18": {
18084+ "accuracy": 0.21875,
18085+ "gain_vs_zero": {
18086+ "estimate": 0.125,
18087+ "low": 0.0,
18088+ "high": 0.28125,
18089+ "level": 0.95,
18090+ "n_items": 32,
18091+ "n_clusters": 32,
18092+ "n_boot": 2000
18093+ },
18094+ "outputs_sample": [
18095+ " The word \"happy\" is",
18096+ " 1\n",
18097+ " The word \"bright\" is",
18098+ " The word \"calm\"",
18099+ " 1\n"
18100+ ],
18101+ "correct": [
18102+ 0.0,
18103+ 0.0,
18104+ 0.0,
18105+ 0.0,
18106+ 0.0,
18107+ 0.0,
18108+ 0.0,
18109+ 0.0,
18110+ 0.0,
18111+ 0.0,
18112+ 1.0,
18113+ 0.0,
18114+ 1.0,
18115+ 0.0,
18116+ 0.0,
18117+ 1.0,
18118+ 0.0,
18119+ 1.0,
18120+ 0.0,
18121+ 1.0,
18122+ 0.0,
18123+ 0.0,
18124+ 0.0,
18125+ 0.0,
18126+ 0.0,
18127+ 0.0,
18128+ 0.0,
18129+ 1.0,
18130+ 1.0,
18131+ 0.0,
18132+ 0.0,
18133+ 0.0
18134+ ]
18135+ },
18136+ "ctl_random_norm_matched|L18": {
18137+ "accuracy": 0.25,
18138+ "gain_vs_zero": {
18139+ "estimate": 0.15625,
18140+ "low": 0.03125,
18141+ "high": 0.28125,
18142+ "level": 0.95,
18143+ "n_items": 32,
18144+ "n_clusters": 32,
18145+ "n_boot": 2000
18146+ },
18147+ "correct": [
18148+ 0.0,
18149+ 0.0,
18150+ 0.0,
18151+ 0.0,
18152+ 0.0,
18153+ 0.0,
18154+ 0.0,
18155+ 0.0,
18156+ 0.0,
18157+ 0.0,
18158+ 1.0,
18159+ 1.0,
18160+ 0.0,
18161+ 0.0,
18162+ 0.0,
18163+ 1.0,
18164+ 0.0,
18165+ 1.0,
18166+ 0.0,
18167+ 1.0,
18168+ 0.0,
18169+ 0.0,
18170+ 0.0,
18171+ 1.0,
18172+ 0.0,
18173+ 0.0,
18174+ 0.0,
18175+ 1.0,
18176+ 0.0,
18177+ 1.0,
18178+ 0.0,
18179+ 0.0
18180+ ]
18181+ },
18182+ "ctl_unrelated_task_vector(capital)|L18": {
18183+ "accuracy": 0.15625,
18184+ "gain_vs_zero": {
18185+ "estimate": 0.0625,
18186+ "low": -0.0625,
18187+ "high": 0.1875,
18188+ "level": 0.95,
18189+ "n_items": 32,
18190+ "n_clusters": 32,
18191+ "n_boot": 2000
18192+ },
18193+ "correct": [
18194+ 0.0,
18195+ 0.0,
18196+ 0.0,
18197+ 0.0,
18198+ 0.0,
18199+ 0.0,
18200+ 0.0,
18201+ 0.0,
18202+ 0.0,
18203+ 0.0,
18204+ 0.0,
18205+ 0.0,
18206+ 0.0,
18207+ 0.0,
18208+ 0.0,
18209+ 1.0,
18210+ 0.0,
18211+ 1.0,
18212+ 0.0,
18213+ 1.0,
18214+ 0.0,
18215+ 0.0,
18216+ 0.0,
18217+ 0.0,
18218+ 0.0,
18219+ 0.0,
18220+ 0.0,
18221+ 1.0,
18222+ 1.0,
18223+ 0.0,
18224+ 0.0,
18225+ 0.0
18226+ ]
18227+ },
18228+ "procrustes|L25|a1.0": {
18229+ "accuracy": 0.78125,
18230+ "gain_vs_zero": {
18231+ "estimate": 0.6875,
18232+ "low": 0.53125,
18233+ "high": 0.84375,
18234+ "level": 0.95,
18235+ "n_items": 32,
18236+ "n_clusters": 32,
18237+ "n_boot": 2000
18238+ },
18239+ "mapped_norm": 40.60661697387695,
18240+ "outputs_sample": [
18241+ " sad\n",
18242+ " depart\n",
18243+ " dark\n",
18244+ " panick\n",
18245+ " under\n"
18246+ ],
18247+ "correct": [
18248+ 1.0,
18249+ 1.0,
18250+ 1.0,
18251+ 0.0,
18252+ 1.0,
18253+ 0.0,
18254+ 0.0,
18255+ 1.0,
18256+ 1.0,
18257+ 1.0,
18258+ 1.0,
18259+ 1.0,
18260+ 1.0,
18261+ 0.0,
18262+ 1.0,
18263+ 1.0,
18264+ 0.0,
18265+ 1.0,
18266+ 1.0,
18267+ 1.0,
18268+ 1.0,
18269+ 1.0,
18270+ 1.0,
18271+ 1.0,
18272+ 1.0,
18273+ 0.0,
18274+ 0.0,
18275+ 1.0,
18276+ 1.0,
18277+ 1.0,
18278+ 1.0,
18279+ 1.0
18280+ ]
18281+ },
18282+ "procrustes|L25|a2.0": {
18283+ "accuracy": 0.78125,
18284+ "gain_vs_zero": {
18285+ "estimate": 0.6875,
18286+ "low": 0.53125,
18287+ "high": 0.84375,
18288+ "level": 0.95,
18289+ "n_items": 32,
18290+ "n_clusters": 32,
18291+ "n_boot": 2000
18292+ },
18293+ "mapped_norm": 40.60661697387695,
18294+ "outputs_sample": [
18295+ " sad\n",
18296+ " leave\n\n",
18297+ " dark\n",
18298+ " storm\n",
18299+ " under\n"
18300+ ],
18301+ "correct": [
18302+ 1.0,
18303+ 0.0,
18304+ 1.0,
18305+ 0.0,
18306+ 1.0,
18307+ 0.0,
18308+ 1.0,
18309+ 1.0,
18310+ 1.0,
18311+ 1.0,
18312+ 1.0,
18313+ 1.0,
18314+ 1.0,
18315+ 1.0,
18316+ 1.0,
18317+ 1.0,
18318+ 0.0,
18319+ 1.0,
18320+ 1.0,
18321+ 1.0,
18322+ 1.0,
18323+ 0.0,
18324+ 1.0,
18325+ 1.0,
18326+ 1.0,
18327+ 1.0,
18328+ 0.0,
18329+ 1.0,
18330+ 1.0,
18331+ 0.0,
18332+ 1.0,
18333+ 1.0
18334+ ]
18335+ },
18336+ "procrustes_rescaled|L25|a1.0": {
18337+ "accuracy": 0.78125,
18338+ "gain_vs_zero": {
18339+ "estimate": 0.6875,
18340+ "low": 0.53125,
18341+ "high": 0.84375,
18342+ "level": 0.95,
18343+ "n_items": 32,
18344+ "n_clusters": 32,
18345+ "n_boot": 2000
18346+ },
18347+ "mapped_norm": 57.1178092956543,
18348+ "outputs_sample": [
18349+ " sad\n",
18350+ " depart\n",
18351+ " dark\n",
18352+ " storm\n",
18353+ " under\n"
18354+ ],
18355+ "correct": [
18356+ 1.0,
18357+ 1.0,
18358+ 1.0,
18359+ 0.0,
18360+ 1.0,
18361+ 0.0,
18362+ 1.0,
18363+ 1.0,
18364+ 1.0,
18365+ 1.0,
18366+ 1.0,
18367+ 1.0,
18368+ 1.0,
18369+ 1.0,
18370+ 1.0,
18371+ 1.0,
18372+ 0.0,
18373+ 1.0,
18374+ 1.0,
18375+ 1.0,
18376+ 1.0,
18377+ 0.0,
18378+ 1.0,
18379+ 1.0,
18380+ 1.0,
18381+ 0.0,
18382+ 0.0,
18383+ 1.0,
18384+ 1.0,
18385+ 0.0,
18386+ 1.0,
18387+ 1.0
18388+ ]
18389+ },
18390+ "ridge|L25|a1.0": {
18391+ "accuracy": 0.6875,
18392+ "gain_vs_zero": {
18393+ "estimate": 0.59375,
18394+ "low": 0.4375,
18395+ "high": 0.75,
18396+ "level": 0.95,
18397+ "n_items": 32,
18398+ "n_clusters": 32,
18399+ "n_boot": 2000
18400+ },
18401+ "mapped_norm": 46.85785675048828,
18402+ "outputs_sample": [
18403+ " sad\n",
18404+ " leave\n\n",
18405+ " dark\n",
18406+ " warp\n",
18407+ " under\n"
18408+ ],
18409+ "correct": [
18410+ 1.0,
18411+ 0.0,
18412+ 1.0,
18413+ 0.0,
18414+ 1.0,
18415+ 0.0,
18416+ 0.0,
18417+ 1.0,
18418+ 1.0,
18419+ 1.0,
18420+ 1.0,
18421+ 1.0,
18422+ 1.0,
18423+ 1.0,
18424+ 0.0,
18425+ 1.0,
18426+ 0.0,
18427+ 1.0,
18428+ 1.0,
18429+ 1.0,
18430+ 1.0,
18431+ 0.0,
18432+ 1.0,
18433+ 1.0,
18434+ 1.0,
18435+ 1.0,
18436+ 0.0,
18437+ 1.0,
18438+ 1.0,
18439+ 0.0,
18440+ 0.0,
18441+ 1.0
18442+ ]
18443+ },
18444+ "ridge|L25|a2.0": {
18445+ "accuracy": 0.25,
18446+ "gain_vs_zero": {
18447+ "estimate": 0.15625,
18448+ "low": 0.0,
18449+ "high": 0.3125,
18450+ "level": 0.95,
18451+ "n_items": 32,
18452+ "n_clusters": 32,
18453+ "n_boot": 2000
18454+ },
18455+ "mapped_norm": 46.85785675048828,
18456+ "outputs_sample": [
18457+ " cool\n",
18458+ " kite\n",
18459+ " red\n",
18460+ " shy\n",
18461+ " under\n"
18462+ ],
18463+ "correct": [
18464+ 0.0,
18465+ 0.0,
18466+ 0.0,
18467+ 0.0,
18468+ 1.0,
18469+ 0.0,
18470+ 0.0,
18471+ 0.0,
18472+ 1.0,
18473+ 0.0,
18474+ 0.0,
18475+ 1.0,
18476+ 0.0,
18477+ 0.0,
18478+ 0.0,
18479+ 1.0,
18480+ 0.0,
18481+ 1.0,
18482+ 0.0,
18483+ 0.0,
18484+ 1.0,
18485+ 0.0,
18486+ 0.0,
18487+ 1.0,
18488+ 1.0,
18489+ 0.0,
18490+ 0.0,
18491+ 0.0,
18492+ 0.0,
18493+ 0.0,
18494+ 0.0,
18495+ 0.0
18496+ ]
18497+ },
18498+ "ridge_rescaled|L25|a1.0": {
18499+ "accuracy": 0.6875,
18500+ "gain_vs_zero": {
18501+ "estimate": 0.59375,
18502+ "low": 0.4375,
18503+ "high": 0.75,
18504+ "level": 0.95,
18505+ "n_items": 32,
18506+ "n_clusters": 32,
18507+ "n_boot": 2000
18508+ },
18509+ "mapped_norm": 57.11780548095703,
18510+ "outputs_sample": [
18511+ " sad\n",
18512+ " leave\n",
18513+ " dark\n",
18514+ " flash\n",
18515+ " under\n"
18516+ ],
18517+ "correct": [
18518+ 1.0,
18519+ 0.0,
18520+ 1.0,
18521+ 0.0,
18522+ 1.0,
18523+ 0.0,
18524+ 0.0,
18525+ 1.0,
18526+ 1.0,
18527+ 1.0,
18528+ 1.0,
18529+ 1.0,
18530+ 1.0,
18531+ 1.0,
18532+ 1.0,
18533+ 1.0,
18534+ 0.0,
18535+ 1.0,
18536+ 1.0,
18537+ 1.0,
18538+ 1.0,
18539+ 0.0,
18540+ 0.0,
18541+ 1.0,
18542+ 1.0,
18543+ 1.0,
18544+ 0.0,
18545+ 1.0,
18546+ 1.0,
18547+ 0.0,
18548+ 0.0,
18549+ 1.0
18550+ ]
18551+ },
18552+ "cca|L25|a1.0": {
18553+ "accuracy": 0.8125,
18554+ "gain_vs_zero": {
18555+ "estimate": 0.71875,
18556+ "low": 0.5625,
18557+ "high": 0.875,
18558+ "level": 0.95,
18559+ "n_items": 32,
18560+ "n_clusters": 32,
18561+ "n_boot": 2000
18562+ },
18563+ "mapped_norm": 58.244014739990234,
18564+ "outputs_sample": [
18565+ " sad\n",
18566+ " leave\n",
18567+ " dark\n",
18568+ " storm\n",
18569+ " under\n"
18570+ ],
18571+ "correct": [
18572+ 1.0,
18573+ 0.0,
18574+ 1.0,
18575+ 0.0,
18576+ 1.0,
18577+ 0.0,
18578+ 1.0,
18579+ 1.0,
18580+ 1.0,
18581+ 1.0,
18582+ 1.0,
18583+ 1.0,
18584+ 1.0,
18585+ 1.0,
18586+ 1.0,
18587+ 1.0,
18588+ 0.0,
18589+ 1.0,
18590+ 1.0,
18591+ 1.0,
18592+ 1.0,
18593+ 1.0,
18594+ 1.0,
18595+ 1.0,
18596+ 1.0,
18597+ 1.0,
18598+ 0.0,
18599+ 1.0,
18600+ 1.0,
18601+ 0.0,
18602+ 1.0,
18603+ 1.0
18604+ ]
18605+ },
18606+ "cca|L25|a2.0": {
18607+ "accuracy": 0.03125,
18608+ "gain_vs_zero": {
18609+ "estimate": -0.0625,
18610+ "low": -0.15625,
18611+ "high": 0.0,
18612+ "level": 0.95,
18613+ "n_items": 32,
18614+ "n_clusters": 32,
18615+ "n_boot": 2000
18616+ },
18617+ "mapped_norm": 58.244014739990234,
18618+ "outputs_sample": [
18619+ " cloud\n",
18620+ " duck\n\n",
18621+ " cloud\n",
18622+ " duck\n",
18623+ " duck\n"
18624+ ],
18625+ "correct": [
18626+ 0.0,
18627+ 0.0,
18628+ 0.0,
18629+ 0.0,
18630+ 0.0,
18631+ 0.0,
18632+ 0.0,
18633+ 0.0,
18634+ 0.0,
18635+ 0.0,
18636+ 0.0,
18637+ 0.0,
18638+ 0.0,
18639+ 0.0,
18640+ 0.0,
18641+ 0.0,
18642+ 0.0,
18643+ 1.0,
18644+ 0.0,
18645+ 0.0,
18646+ 0.0,
18647+ 0.0,
18648+ 0.0,
18649+ 0.0,
18650+ 0.0,
18651+ 0.0,
18652+ 0.0,
18653+ 0.0,
18654+ 0.0,
18655+ 0.0,
18656+ 0.0,
18657+ 0.0
18658+ ]
18659+ },
18660+ "random_orth|L25|a1.0": {
18661+ "accuracy": 0.03125,
18662+ "gain_vs_zero": {
18663+ "estimate": -0.0625,
18664+ "low": -0.1875,
18665+ "high": 0.0625,
18666+ "level": 0.95,
18667+ "n_items": 32,
18668+ "n_clusters": 32,
18669+ "n_boot": 2000
18670+ },
18671+ "mapped_norm": 41.031681060791016,
18672+ "outputs_sample": [
18673+ " 5\n",
18674+ " 1\n",
18675+ " 4\n",
18676+ " 3\n",
18677+ " 5\n"
18678+ ],
18679+ "correct": [
18680+ 0.0,
18681+ 0.0,
18682+ 0.0,
18683+ 0.0,
18684+ 0.0,
18685+ 0.0,
18686+ 0.0,
18687+ 0.0,
18688+ 1.0,
18689+ 0.0,
18690+ 0.0,
18691+ 0.0,
18692+ 0.0,
18693+ 0.0,
18694+ 0.0,
18695+ 0.0,
18696+ 0.0,
18697+ 0.0,
18698+ 0.0,
18699+ 0.0,
18700+ 0.0,
18701+ 0.0,
18702+ 0.0,
18703+ 0.0,
18704+ 0.0,
18705+ 0.0,
18706+ 0.0,
18707+ 0.0,
18708+ 0.0,
18709+ 0.0,
18710+ 0.0,
18711+ 0.0
18712+ ]
18713+ },
18714+ "random_orth|L25|a2.0": {
18715+ "accuracy": 0.03125,
18716+ "gain_vs_zero": {
18717+ "estimate": -0.0625,
18718+ "low": -0.1875,
18719+ "high": 0.0625,
18720+ "level": 0.95,
18721+ "n_items": 32,
18722+ "n_clusters": 32,
18723+ "n_boot": 2000
18724+ },
18725+ "mapped_norm": 41.031681060791016,
18726+ "outputs_sample": [
18727+ " 5\n",
18728+ " 1\n",
18729+ " 4\n",
18730+ " 3\n",
18731+ " 5\n"
18732+ ],
18733+ "correct": [
18734+ 0.0,
18735+ 0.0,
18736+ 0.0,
18737+ 0.0,
18738+ 0.0,
18739+ 0.0,
18740+ 0.0,
18741+ 0.0,
18742+ 1.0,
18743+ 0.0,
18744+ 0.0,
18745+ 0.0,
18746+ 0.0,
18747+ 0.0,
18748+ 0.0,
18749+ 0.0,
18750+ 0.0,
18751+ 0.0,
18752+ 0.0,
18753+ 0.0,
18754+ 0.0,
18755+ 0.0,
18756+ 0.0,
18757+ 0.0,
18758+ 0.0,
18759+ 0.0,
18760+ 0.0,
18761+ 0.0,
18762+ 0.0,
18763+ 0.0,
18764+ 0.0,
18765+ 0.0
18766+ ]
18767+ },
18768+ "replace_donor_fewshot|procrustes|L25": {
18769+ "accuracy": 0.84375,
18770+ "gain_vs_zero": {
18771+ "estimate": 0.75,
18772+ "low": 0.59375,
18773+ "high": 0.875,
18774+ "level": 0.95,
18775+ "n_items": 32,
18776+ "n_clusters": 32,
18777+ "n_boot": 2000
18778+ },
18779+ "outputs_sample": [
18780+ " sad\n",
18781+ " depart\n\n",
18782+ " dark\n",
18783+ " excited\n",
18784+ " under\n"
18785+ ],
18786+ "correct": [
18787+ 1.0,
18788+ 1.0,
18789+ 1.0,
18790+ 0.0,
18791+ 1.0,
18792+ 0.0,
18793+ 1.0,
18794+ 1.0,
18795+ 1.0,
18796+ 1.0,
18797+ 1.0,
18798+ 1.0,
18799+ 1.0,
18800+ 1.0,
18801+ 1.0,
18802+ 1.0,
18803+ 0.0,
18804+ 1.0,
18805+ 1.0,
18806+ 1.0,
18807+ 1.0,
18808+ 1.0,
18809+ 1.0,
18810+ 1.0,
18811+ 1.0,
18812+ 0.0,
18813+ 0.0,
18814+ 1.0,
18815+ 1.0,
18816+ 1.0,
18817+ 1.0,
18818+ 1.0
18819+ ]
18820+ },
18821+ "ctl_replace_donor_zeroshot|procrustes|L25": {
18822+ "accuracy": 0.15625,
18823+ "gain_vs_zero": {
18824+ "estimate": 0.0625,
18825+ "low": -0.0625,
18826+ "high": 0.1875,
18827+ "level": 0.95,
18828+ "n_items": 32,
18829+ "n_clusters": 32,
18830+ "n_boot": 2000
18831+ },
18832+ "outputs_sample": [
18833+ " 4\n",
18834+ " 1\n",
18835+ " The word \"bright\" is",
18836+ " The word \"calm\"",
18837+ " over\n"
18838+ ],
18839+ "correct": [
18840+ 0.0,
18841+ 0.0,
18842+ 0.0,
18843+ 0.0,
18844+ 0.0,
18845+ 0.0,
18846+ 0.0,
18847+ 0.0,
18848+ 0.0,
18849+ 0.0,
18850+ 1.0,
18851+ 0.0,
18852+ 0.0,
18853+ 0.0,
18854+ 0.0,
18855+ 1.0,
18856+ 0.0,
18857+ 1.0,
18858+ 0.0,
18859+ 1.0,
18860+ 0.0,
18861+ 0.0,
18862+ 0.0,
18863+ 0.0,
18864+ 1.0,
18865+ 0.0,
18866+ 0.0,
18867+ 0.0,
18868+ 0.0,
18869+ 0.0,
18870+ 0.0,
18871+ 0.0
18872+ ]
18873+ },
18874+ "ctl_replace_donor_fewshot_shuffled_query|procrustes|L25": {
18875+ "accuracy": 0.8125,
18876+ "gain_vs_zero": {
18877+ "estimate": 0.71875,
18878+ "low": 0.5625,
18879+ "high": 0.875,
18880+ "level": 0.95,
18881+ "n_items": 32,
18882+ "n_clusters": 32,
18883+ "n_boot": 2000
18884+ },
18885+ "outputs_sample": [
18886+ " sad\n",
18887+ " depart\n",
18888+ " dark\n",
18889+ " excited\n",
18890+ " under\n"
18891+ ],
18892+ "correct": [
18893+ 1.0,
18894+ 1.0,
18895+ 1.0,
18896+ 0.0,
18897+ 1.0,
18898+ 0.0,
18899+ 1.0,
18900+ 1.0,
18901+ 1.0,
18902+ 1.0,
18903+ 1.0,
18904+ 1.0,
18905+ 1.0,
18906+ 1.0,
18907+ 1.0,
18908+ 1.0,
18909+ 1.0,
18910+ 1.0,
18911+ 1.0,
18912+ 1.0,
18913+ 1.0,
18914+ 1.0,
18915+ 1.0,
18916+ 1.0,
18917+ 1.0,
18918+ 0.0,
18919+ 0.0,
18920+ 1.0,
18921+ 1.0,
18922+ 0.0,
18923+ 0.0,
18924+ 1.0
18925+ ]
18926+ },
18927+ "replace_donor_fewshot|ridge|L25": {
18928+ "accuracy": 0.75,
18929+ "gain_vs_zero": {
18930+ "estimate": 0.65625,
18931+ "low": 0.5,
18932+ "high": 0.8125,
18933+ "level": 0.95,
18934+ "n_items": 32,
18935+ "n_clusters": 32,
18936+ "n_boot": 2000
18937+ },
18938+ "outputs_sample": [
18939+ " sad\n",
18940+ " depart\n\n",
18941+ " dark\n",
18942+ " storm\n",
18943+ " under\n"
18944+ ],
18945+ "correct": [
18946+ 1.0,
18947+ 1.0,
18948+ 1.0,
18949+ 0.0,
18950+ 1.0,
18951+ 0.0,
18952+ 1.0,
18953+ 1.0,
18954+ 1.0,
18955+ 1.0,
18956+ 1.0,
18957+ 1.0,
18958+ 1.0,
18959+ 1.0,
18960+ 1.0,
18961+ 1.0,
18962+ 0.0,
18963+ 1.0,
18964+ 1.0,
18965+ 1.0,
18966+ 1.0,
18967+ 0.0,
18968+ 0.0,
18969+ 1.0,
18970+ 1.0,
18971+ 0.0,
18972+ 0.0,
18973+ 1.0,
18974+ 1.0,
18975+ 0.0,
18976+ 1.0,
18977+ 1.0
18978+ ]
18979+ },
18980+ "ctl_replace_donor_zeroshot|ridge|L25": {
18981+ "accuracy": 0.0,
18982+ "gain_vs_zero": {
18983+ "estimate": -0.09375,
18984+ "low": -0.1875,
18985+ "high": 0.0,
18986+ "level": 0.95,
18987+ "n_items": 32,
18988+ "n_clusters": 32,
18989+ "n_boot": 2000
18990+ },
18991+ "outputs_sample": [
18992+ " 5\n",
18993+ " The word \"arrive\"",
18994+ " The word \"bright\" is",
18995+ " ['a', 'c',",
18996+ " The word \"over\" is"
18997+ ],
18998+ "correct": [
18999+ 0.0,
19000+ 0.0,
19001+ 0.0,
19002+ 0.0,
19003+ 0.0,
19004+ 0.0,
19005+ 0.0,
19006+ 0.0,
19007+ 0.0,
19008+ 0.0,
19009+ 0.0,
19010+ 0.0,
19011+ 0.0,
19012+ 0.0,
19013+ 0.0,
19014+ 0.0,
19015+ 0.0,
19016+ 0.0,
19017+ 0.0,
19018+ 0.0,
19019+ 0.0,
19020+ 0.0,
19021+ 0.0,
19022+ 0.0,
19023+ 0.0,
19024+ 0.0,
19025+ 0.0,
19026+ 0.0,
19027+ 0.0,
19028+ 0.0,
19029+ 0.0,
19030+ 0.0
19031+ ]
19032+ },
19033+ "ctl_replace_donor_fewshot_shuffled_query|ridge|L25": {
19034+ "accuracy": 0.75,
19035+ "gain_vs_zero": {
19036+ "estimate": 0.65625,
19037+ "low": 0.5,
19038+ "high": 0.8125,
19039+ "level": 0.95,
19040+ "n_items": 32,
19041+ "n_clusters": 32,
19042+ "n_boot": 2000
19043+ },
19044+ "outputs_sample": [
19045+ " sad\n",
19046+ " depart\n",
19047+ " dark\n",
19048+ " wave\n",
19049+ " under\n"
19050+ ],
19051+ "correct": [
19052+ 1.0,
19053+ 1.0,
19054+ 1.0,
19055+ 0.0,
19056+ 1.0,
19057+ 0.0,
19058+ 1.0,
19059+ 1.0,
19060+ 1.0,
19061+ 1.0,
19062+ 1.0,
19063+ 1.0,
19064+ 1.0,
19065+ 1.0,
19066+ 1.0,
19067+ 1.0,
19068+ 0.0,
19069+ 1.0,
19070+ 1.0,
19071+ 1.0,
19072+ 1.0,
19073+ 0.0,
19074+ 1.0,
19075+ 1.0,
19076+ 1.0,
19077+ 0.0,
19078+ 0.0,
19079+ 1.0,
19080+ 1.0,
19081+ 0.0,
19082+ 0.0,
19083+ 1.0
19084+ ]
19085+ },
19086+ "ctl_replace_donor_fewshot|sham_map|L25": {
19087+ "accuracy": 0.125,
19088+ "gain_vs_zero": {
19089+ "estimate": 0.03125,
19090+ "low": -0.0625,
19091+ "high": 0.125,
19092+ "level": 0.95,
19093+ "n_items": 32,
19094+ "n_clusters": 32,
19095+ "n_boot": 2000
19096+ },
19097+ "outputs_sample": [
19098+ " sad\n",
19099+ " 1\n",
19100+ " The word \"bright\" is",
19101+ " The word \"calm\"",
19102+ " 5\n\n"
19103+ ],
19104+ "correct": [
19105+ 1.0,
19106+ 0.0,
19107+ 0.0,
19108+ 0.0,
19109+ 0.0,
19110+ 0.0,
19111+ 0.0,
19112+ 0.0,
19113+ 1.0,
19114+ 0.0,
19115+ 0.0,
19116+ 1.0,
19117+ 0.0,
19118+ 0.0,
19119+ 0.0,
19120+ 0.0,
19121+ 0.0,
19122+ 0.0,
19123+ 0.0,
19124+ 1.0,
19125+ 0.0,
19126+ 0.0,
19127+ 0.0,
19128+ 0.0,
19129+ 0.0,
19130+ 0.0,
19131+ 0.0,
19132+ 0.0,
19133+ 0.0,
19134+ 0.0,
19135+ 0.0,
19136+ 0.0
19137+ ]
19138+ },
19139+ "ctl_replace_donor_zeroshot|sham_map|L25": {
19140+ "accuracy": 0.09375,
19141+ "gain_vs_zero": {
19142+ "estimate": 0.0,
19143+ "low": -0.125,
19144+ "high": 0.125,
19145+ "level": 0.95,
19146+ "n_items": 32,
19147+ "n_clusters": 32,
19148+ "n_boot": 2000
19149+ },
19150+ "outputs_sample": [
19151+ " happy\n",
19152+ " The word \"arrive\"",
19153+ " The word \"bright\" is",
19154+ " The word \"calm\"",
19155+ " The word \"over\" is"
19156+ ],
19157+ "correct": [
19158+ 0.0,
19159+ 0.0,
19160+ 0.0,
19161+ 0.0,
19162+ 0.0,
19163+ 0.0,
19164+ 0.0,
19165+ 0.0,
19166+ 0.0,
19167+ 0.0,
19168+ 0.0,
19169+ 0.0,
19170+ 0.0,
19171+ 0.0,
19172+ 0.0,
19173+ 1.0,
19174+ 0.0,
19175+ 0.0,
19176+ 0.0,
19177+ 1.0,
19178+ 0.0,
19179+ 0.0,
19180+ 0.0,
19181+ 0.0,
19182+ 0.0,
19183+ 0.0,
19184+ 0.0,
19185+ 0.0,
19186+ 1.0,
19187+ 0.0,
19188+ 0.0,
19189+ 0.0
19190+ ]
19191+ },
19192+ "ctl_replace_donor_fewshot_shuffled_query|sham_map|L25": {
19193+ "accuracy": 0.09375,
19194+ "gain_vs_zero": {
19195+ "estimate": 0.0,
19196+ "low": -0.125,
19197+ "high": 0.125,
19198+ "level": 0.95,
19199+ "n_items": 32,
19200+ "n_clusters": 32,
19201+ "n_boot": 2000
19202+ },
19203+ "outputs_sample": [
19204+ " 5\n",
19205+ " 1\n",
19206+ " The word \"bright\" is",
19207+ " 3\n",
19208+ " over\n"
19209+ ],
19210+ "correct": [
19211+ 0.0,
19212+ 0.0,
19213+ 0.0,
19214+ 0.0,
19215+ 0.0,
19216+ 0.0,
19217+ 0.0,
19218+ 0.0,
19219+ 1.0,
19220+ 0.0,
19221+ 0.0,
19222+ 0.0,
19223+ 0.0,
19224+ 0.0,
19225+ 0.0,
19226+ 1.0,
19227+ 0.0,
19228+ 0.0,
19229+ 0.0,
19230+ 1.0,
19231+ 0.0,
19232+ 0.0,
19233+ 0.0,
19234+ 0.0,
19235+ 0.0,
19236+ 0.0,
19237+ 0.0,
19238+ 0.0,
19239+ 0.0,
19240+ 0.0,
19241+ 0.0,
19242+ 0.0
19243+ ]
19244+ },
19245+ "ctl_random_norm_matched|L25": {
19246+ "accuracy": 0.03125,
19247+ "gain_vs_zero": {
19248+ "estimate": -0.0625,
19249+ "low": -0.15625,
19250+ "high": 0.0,
19251+ "level": 0.95,
19252+ "n_items": 32,
19253+ "n_clusters": 32,
19254+ "n_boot": 2000
19255+ },
19256+ "correct": [
19257+ 0.0,
19258+ 0.0,
19259+ 0.0,
19260+ 0.0,
19261+ 0.0,
19262+ 0.0,
19263+ 0.0,
19264+ 0.0,
19265+ 0.0,
19266+ 0.0,
19267+ 0.0,
19268+ 0.0,
19269+ 0.0,
19270+ 0.0,
19271+ 0.0,
19272+ 0.0,
19273+ 0.0,
19274+ 1.0,
19275+ 0.0,
19276+ 0.0,
19277+ 0.0,
19278+ 0.0,
19279+ 0.0,
19280+ 0.0,
19281+ 0.0,
19282+ 0.0,
19283+ 0.0,
19284+ 0.0,
19285+ 0.0,
19286+ 0.0,
19287+ 0.0,
19288+ 0.0
19289+ ]
19290+ },
19291+ "ctl_unrelated_task_vector(capital)|L25": {
19292+ "accuracy": 0.3125,
19293+ "gain_vs_zero": {
19294+ "estimate": 0.21875,
19295+ "low": 0.09375,
19296+ "high": 0.375,
19297+ "level": 0.95,
19298+ "n_items": 32,
19299+ "n_clusters": 32,
19300+ "n_boot": 2000
19301+ },
19302+ "correct": [
19303+ 0.0,
19304+ 0.0,
19305+ 0.0,
19306+ 0.0,
19307+ 0.0,
19308+ 0.0,
19309+ 0.0,
19310+ 0.0,
19311+ 1.0,
19312+ 0.0,
19313+ 1.0,
19314+ 1.0,
19315+ 0.0,
19316+ 0.0,
19317+ 0.0,
19318+ 1.0,
19319+ 1.0,
19320+ 1.0,
19321+ 0.0,
19322+ 1.0,
19323+ 0.0,
19324+ 0.0,
19325+ 0.0,
19326+ 1.0,
19327+ 1.0,
19328+ 0.0,
19329+ 0.0,
19330+ 0.0,
19331+ 1.0,
19332+ 0.0,
19333+ 0.0,
19334+ 0.0
19335+ ]
19336+ }
19337+ },
19338+ "items": {
19339+ "zero": [
19340+ 0.0,
19341+ 0.0,
19342+ 0.0,
19343+ 0.0,
19344+ 0.0,
19345+ 0.0,
19346+ 0.0,
19347+ 0.0,
19348+ 0.0,
19349+ 0.0,
19350+ 0.0,
19351+ 1.0,
19352+ 0.0,
19353+ 0.0,
19354+ 0.0,
19355+ 0.0,
19356+ 0.0,
19357+ 1.0,
19358+ 0.0,
19359+ 1.0,
19360+ 0.0,
19361+ 0.0,
19362+ 0.0,
19363+ 0.0,
19364+ 0.0,
19365+ 0.0,
19366+ 0.0,
19367+ 0.0,
19368+ 0.0,
19369+ 0.0,
19370+ 0.0,
19371+ 0.0
19372+ ],
19373+ "few": [
19374+ 1.0,
19375+ 1.0,
19376+ 1.0,
19377+ 0.0,
19378+ 1.0,
19379+ 1.0,
19380+ 1.0,
19381+ 1.0,
19382+ 1.0,
19383+ 1.0,
19384+ 1.0,
19385+ 1.0,
19386+ 1.0,
19387+ 1.0,
19388+ 1.0,
19389+ 1.0,
19390+ 1.0,
19391+ 1.0,
19392+ 1.0,
19393+ 1.0,
19394+ 1.0,
19395+ 1.0,
19396+ 0.0,
19397+ 1.0,
19398+ 1.0,
19399+ 1.0,
19400+ 1.0,
19401+ 1.0,
19402+ 1.0,
19403+ 1.0,
19404+ 1.0,
19405+ 1.0
19406+ ],
19407+ "own": [
19408+ 1.0,
19409+ 0.0,
19410+ 1.0,
19411+ 0.0,
19412+ 1.0,
19413+ 1.0,
19414+ 1.0,
19415+ 1.0,
19416+ 1.0,
19417+ 1.0,
19418+ 1.0,
19419+ 1.0,
19420+ 1.0,
19421+ 1.0,
19422+ 1.0,
19423+ 1.0,
19424+ 0.0,
19425+ 1.0,
19426+ 1.0,
19427+ 1.0,
19428+ 1.0,
19429+ 1.0,
19430+ 1.0,
19431+ 1.0,
19432+ 1.0,
19433+ 1.0,
19434+ 1.0,
19435+ 1.0,
19436+ 1.0,
19437+ 1.0,
19438+ 1.0,
19439+ 1.0
19440+ ]
19441+ }
19442+ },
19443+ "capital": {
19444+ "recipient_zero": 0.13636363636363635,
19445+ "recipient_few": 1.0,
19446+ "recipient_own_vector": 0.8181818181818182,
19447+ "donor_layer": 14,
19448+ "conditions": {
19449+ "procrustes|L18|a1.0": {
19450+ "accuracy": 0.5454545454545454,
19451+ "gain_vs_zero": {
19452+ "estimate": 0.4090909090909091,
19453+ "low": 0.22727272727272727,
19454+ "high": 0.6363636363636364,
19455+ "level": 0.95,
19456+ "n_items": 22,
19457+ "n_clusters": 22,
19458+ "n_boot": 2000
19459+ },
19460+ "mapped_norm": 25.164409637451172,
19461+ "outputs_sample": [
19462+ " Caracas\n\n",
19463+ " 5.9\n",
19464+ " Casablanca\n\n",
19465+ " 100\n",
19466+ " Tokyo\n\n"
19467+ ],
19468+ "correct": [
19469+ 1.0,
19470+ 0.0,
19471+ 0.0,
19472+ 0.0,
19473+ 1.0,
19474+ 0.0,
19475+ 1.0,
19476+ 1.0,
19477+ 0.0,
19478+ 0.0,
19479+ 1.0,
19480+ 1.0,
19481+ 0.0,
19482+ 1.0,
19483+ 1.0,
19484+ 0.0,
19485+ 0.0,
19486+ 1.0,
19487+ 0.0,
19488+ 1.0,
19489+ 1.0,
19490+ 1.0
19491+ ]
19492+ },
19493+ "procrustes|L18|a2.0": {
19494+ "accuracy": 0.13636363636363635,
19495+ "gain_vs_zero": {
19496+ "estimate": 0.0,
19497+ "low": -0.22727272727272727,
19498+ "high": 0.22727272727272727,
19499+ "level": 0.95,
19500+ "n_items": 22,
19501+ "n_clusters": 22,
19502+ "n_boot": 2000
19503+ },
19504+ "mapped_norm": 25.164409637451172,
19505+ "outputs_sample": [
19506+ " Venezuela\n\n",
19507+ " 5.9\n",
19508+ " Moroccan\n\n",
19509+ " Turkiye\n\n",
19510+ " Tokyo\n\n"
19511+ ],
19512+ "correct": [
19513+ 0.0,
19514+ 0.0,
19515+ 0.0,
19516+ 0.0,
19517+ 1.0,
19518+ 0.0,
19519+ 0.0,
19520+ 0.0,
19521+ 0.0,
19522+ 0.0,
19523+ 0.0,
19524+ 0.0,
19525+ 0.0,
19526+ 0.0,
19527+ 1.0,
19528+ 0.0,
19529+ 0.0,
19530+ 0.0,
19531+ 0.0,
19532+ 0.0,
19533+ 0.0,
19534+ 1.0
19535+ ]
19536+ },
19537+ "procrustes_rescaled|L18|a1.0": {
19538+ "accuracy": 0.09090909090909091,
19539+ "gain_vs_zero": {
19540+ "estimate": -0.045454545454545456,
19541+ "low": -0.22727272727272727,
19542+ "high": 0.13636363636363635,
19543+ "level": 0.95,
19544+ "n_items": 22,
19545+ "n_clusters": 22,
19546+ "n_boot": 2000
19547+ },
19548+ "mapped_norm": 56.586326599121094,
19549+ "outputs_sample": [
19550+ " Venezuela\n\n",
19551+ " Finland\n\n",
19552+ " Moroccan\n\n",
19553+ " Turkey\n\n",
19554+ " Japanese\n\n"
19555+ ],
19556+ "correct": [
19557+ 0.0,
19558+ 0.0,
19559+ 0.0,
19560+ 0.0,
19561+ 0.0,
19562+ 0.0,
19563+ 0.0,
19564+ 0.0,
19565+ 0.0,
19566+ 0.0,
19567+ 0.0,
19568+ 0.0,
19569+ 0.0,
19570+ 0.0,
19571+ 1.0,
19572+ 0.0,
19573+ 0.0,
19574+ 0.0,
19575+ 0.0,
19576+ 0.0,
19577+ 0.0,
19578+ 1.0
19579+ ]
19580+ },
19581+ "ridge|L18|a1.0": {
19582+ "accuracy": 0.5454545454545454,
19583+ "gain_vs_zero": {
19584+ "estimate": 0.4090909090909091,
19585+ "low": 0.22727272727272727,
19586+ "high": 0.6363636363636364,
19587+ "level": 0.95,
19588+ "n_items": 22,
19589+ "n_clusters": 22,
19590+ "n_boot": 2000
19591+ },
19592+ "mapped_norm": 33.83639907836914,
19593+ "outputs_sample": [
19594+ " Caracas\n\n",
19595+ " Finnish\n\n",
19596+ " Casablanca\n\n",
19597+ " Turkey\n\n",

Diff truncated — file too large.

Menu

Theme
↑↓ navigate ↵ open esc close / or ⌘K anywhere