SPB Git

spb/wp30_uqo

Public

This looks like a research repository (LaTeX, bibliography, figures). Preview Research Mode· enable it with research: true on the API.

History
NameLast commitUpdated
configs WP30: core campaign complete (E1 13,280 trials), hosted core, router evaluation,...
data WP30: runner, chains, fan-in, transport, smoke runs (Qwen, Llama), pilot plan
evidence WP30: final analysis (E7 exploratory), paper layout pass, FINAL_REPORT, index...
literature WP30: analysis, router, mapper, hosted track, protocol/audit/reproduce modules,...
paper WP30: final analysis (E7 exploratory), paper layout pass, FINAL_REPORT, index...
protocol WP30: core campaign complete (E1 13,280 trials), hosted core, router evaluation,...
reproduction WP30: core campaign complete (E1 13,280 trials), hosted core, router evaluation,...
results WP30: final analysis (E7 exploratory), paper layout pass, FINAL_REPORT, index...
runs WP30: final analysis (E7 exploratory), paper layout pass, FINAL_REPORT, index...
scripts WP30: core campaign complete (E1 13,280 trials), hosted core, router evaluation,...
src WP30: E3 transfer complete, all results sections, abstract, conclusion, claim...
tests WP30: analysis, router, mapper, hosted track, protocol/audit/reproduce modules,...
.gitignore WP30: harness scaffold, cache adapters, datasets, literature audit
DECISIONS.md WP30: core campaign complete (E1 13,280 trials), hosted core, router evaluation,...
FINAL_REPORT.md WP30: final analysis (E7 exploratory), paper layout pass, FINAL_REPORT, index...
Makefile WP30: E4 chains (7,200 trials) and E5 fan-in (1,600) complete, results sections...
pyproject.toml WP30: harness scaffold, cache adapters, datasets, literature audit
README.md WP30: analysis, router, mapper, hosted track, protocol/audit/reproduce modules,...
STATUS.md WP30: final status, compiled PDF (49 p.), page evidence
README.md source

# 🧠 Beyond Text: Cache Compression and Knowledge Transfer in Multi-Agent Systems

UQO Working Paper No. 30 — A Reproducible Study of Fidelity, Communication Cost, and Repeated Handoffs

TL;DR — Under which task, model, cache, network and reuse conditions does each communication representation (raw text, summaries, structured evidence, lossless codecs, learned prompt compression, native/quantized/evicted KV caches, learned cache mappings) preserve useful information at the lowest measured end-to-end cost? Real experiments on Apple Silicon (MLX) with Qwen2.5-3B / Llama-3.2-3B, genuine two-node cache transfer over a 1 GbE LAN, repeated-handoff chains with an evaluator-only fact ledger, fan-in with conflicting evidence, a same-family learned KV mapper, hosted-API receivers, and a development-fitted router.

# 📌 Status

See STATUS.md (phase gates), DECISIONS.md (dated decisions), FINAL_REPORT.md (completion status and limitations).

# 🗂 Repository layout

text
protocol/        hypotheses.md (registered), analysis_plan.md, frozen.json (protocol hash), run matrices
literature/      sources.csv (34 verified sources), audit_group{1,2,3}.md, method_notes.md
configs/         models, data, resources (budgets/timeouts), pilot/core experiment configs
src/wp30/        backends (MLX), cache adapters (sparse/quantized/serialize/selection), methods (A0–A8), runner, chains, fanin,
                 transport (two-node worker), hosted (API track), mapper (Track C), router (E8), analysis, CLI
tests/           cache correctness (12), leakage (3), scoring/data (5)
data/            manifests (splits, licences), generated/docs (agent-visible), generated/keys (evaluator-only), raw/longbench
runs/raw         per-attempt JSONL records (schema wp30-attempt-1), chains/ hop messages ; runs/logs ; runs/checkpoints (mapper, router)
results/         tables/ figures/ provenance.json claim_ledger.csv
paper/           LaTeX source + compiled PDF
reproduction/    requirements-lock.txt, minimal.yaml, report.json

# 🚀 Quick start (analysis-only reproduction, no inference)

bash
uv venv --python 3.12 .venv && source .venv/bin/activate && uv pip install -r reproduction/requirements-lock.txt && uv pip install -e .
make reproduce-analysis        # rebuilds results/tables and results/figures from runs/raw
make paper                     # compiles paper/main.pdf

# 🔁 Inference reproduction (Apple Silicon, ~15 GB of checkpoints from Hugging Face mlx-community)

bash
python -m wp30 doctor --output evidence/environment.json
python -m wp30 data prepare --config configs/data.yaml && python -m wp30 data validate --manifest data/manifests/splits.json
python -m wp30 models probe --config configs/models.yaml
python -m pytest -q                                   # cache correctness suite runs a real 1.5B model
python -m wp30 run --config configs/core.yaml --resume
python -m wp30 reproduce --profile reproduction/minimal.yaml

Two-node experiments need a second Mac with the same checkpoint revision: python -m wp30 worker --port 9430 --model <repo> on the receiver node, then python scripts/e6_network.py --host <ip> ... on the sender node. Hosted-API experiments need ANTHROPIC_API_KEY / OPENAI_API_KEY and are capped by configs/resources.yaml.

# 📄 Citation

Boucher, S.-P. (2026). Beyond Text: Cache Compression and Knowledge Transfer in Multi-Agent Systems. UQO Working Paper No. 30.

Clone wp30_uqo

Anonymous clone and fetch. Pushing requires the owner's personal access token.

ZIP tar.gz snapshot of main
Files · main
Menu

Theme