SPB Git

Repository Public Research preview

Commit

L1/L4 post-pull run 2 (seeds, budget and ablations_h3 partial, lookahead66 baselines): compute ledger with the node/chip of every review run (32 runs, 10.3 GPU-h incl. the 6.0 of the baseline study), seeds tables, seed band and per-seed H1 pairs in inline_numbers.json (WP41-EDIT-07, WP41-ADVE-13, WP41-AI_C-03, WP41-AI_C-16, WP41-DATA-13)

Per-seed H1 (seed k full vs seed k 1m-only, scaled CRPS, 2024): negative in all five seeds at every H; mean -0.081/-0.117/-0.152/-0.214 %
(min..max -0.146..-0.039 / -0.260..-0.047 / -0.336..-0.065 / -0.413..-0.127), t_seed (4 df) -4.53/-3.18/-3.20/-4.05; unscaled t_seed
-3.54/-2.47/-2.34/-2.84. Seed half-band of MRPT-S scaled CRPS 0.055-0.062 %. The official seed-aware contrast (seeds/seed_contrast.csv,
P3 on N1) supersedes these leaderboard-derived numbers when it lands. latexmk 42 p., 0 errors, 0 overfull.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Simon-Pierre Boucher committed · Nov 6, 2026 parent 76401fd
11 changed files +2,421 −25 Browse files
modified paper/inline_macros.tex +48 −0
@@ -203,6 +203,54 @@
203 203 \newcommand{\DirAccBestFinalHeldoutFifteen}{0.507}
204 204 \newcommand{\DirAccBestFinalHeldoutThirty}{0.506}
205 205 \newcommand{\DirAccBestFinalHeldoutSixty}{0.502}
206 +\newcommand{\SeedBandSmallFive}{0.4526--0.4531}
207 +\newcommand{\SeedHalfBandPctSmallFive}{0.06}
208 +\newcommand{\SeedNSmallFive}{5}
209 +\newcommand{\SeedBandSmallFifteen}{0.4409--0.4414}
210 +\newcommand{\SeedHalfBandPctSmallFifteen}{0.05}
211 +\newcommand{\SeedNSmallFifteen}{5}
212 +\newcommand{\SeedBandSmallThirty}{0.4309--0.4314}
213 +\newcommand{\SeedHalfBandPctSmallThirty}{0.06}
214 +\newcommand{\SeedNSmallThirty}{5}
215 +\newcommand{\SeedBandSmallSixty}{0.4186--0.4191}
216 +\newcommand{\SeedHalfBandPctSmallSixty}{0.06}
217 +\newcommand{\SeedNSmallSixty}{5}
218 +\newcommand{\SeedBandOneMinFive}{0.4529--0.4535}
219 +\newcommand{\SeedHalfBandPctOneMinFive}{0.07}
220 +\newcommand{\SeedNOneMinFive}{5}
221 +\newcommand{\SeedBandOneMinFifteen}{0.4414--0.4422}
222 +\newcommand{\SeedHalfBandPctOneMinFifteen}{0.09}
223 +\newcommand{\SeedNOneMinFifteen}{5}
224 +\newcommand{\SeedBandOneMinThirty}{0.4314--0.4324}
225 +\newcommand{\SeedHalfBandPctOneMinThirty}{0.12}
226 +\newcommand{\SeedNOneMinThirty}{5}
227 +\newcommand{\SeedBandOneMinSixty}{0.4192--0.4204}
228 +\newcommand{\SeedHalfBandPctOneMinSixty}{0.14}
229 +\newcommand{\SeedNOneMinSixty}{5}
230 +\newcommand{\HOneSeedMeanUnscaledFive}{-0.088}
231 +\newcommand{\HOneSeedRangeUnscaledFive}{-0.18\,\%\ to -0.04\,\%}
232 +\newcommand{\HOneTseedUnscaledFive}{-3.54}
233 +\newcommand{\HOneSeedMeanUnscaledFifteen}{-0.132}
234 +\newcommand{\HOneSeedRangeUnscaledFifteen}{-0.34\,\%\ to -0.04\,\%}
235 +\newcommand{\HOneTseedUnscaledFifteen}{-2.47}
236 +\newcommand{\HOneSeedMeanUnscaledThirty}{-0.168}
237 +\newcommand{\HOneSeedRangeUnscaledThirty}{-0.45\,\%\ to -0.05\,\%}
238 +\newcommand{\HOneTseedUnscaledThirty}{-2.34}
239 +\newcommand{\HOneSeedMeanUnscaledSixty}{-0.231}
240 +\newcommand{\HOneSeedRangeUnscaledSixty}{-0.55\,\%\ to -0.10\,\%}
241 +\newcommand{\HOneTseedUnscaledSixty}{-2.84}
242 +\newcommand{\HOneSeedMeanScaledFive}{-0.081}
243 +\newcommand{\HOneSeedRangeScaledFive}{-0.15\,\%\ to -0.04\,\%}
244 +\newcommand{\HOneTseedScaledFive}{-4.53}
245 +\newcommand{\HOneSeedMeanScaledFifteen}{-0.117}
246 +\newcommand{\HOneSeedRangeScaledFifteen}{-0.26\,\%\ to -0.05\,\%}
247 +\newcommand{\HOneTseedScaledFifteen}{-3.18}
248 +\newcommand{\HOneSeedMeanScaledThirty}{-0.152}
249 +\newcommand{\HOneSeedRangeScaledThirty}{-0.34\,\%\ to -0.07\,\%}
250 +\newcommand{\HOneTseedScaledThirty}{-3.20}
251 +\newcommand{\HOneSeedMeanScaledSixty}{-0.214}
252 +\newcommand{\HOneSeedRangeScaledSixty}{-0.41\,\%\ to -0.13\,\%}
253 +\newcommand{\HOneTseedScaledSixty}{-4.05}
206 254 \newcommand{\PilotGainRwUnscaled}{-3.2--3.4}
207 255 \newcommand{\PilotGainRwScaled}{-6.0--2.4}
208 256 \newcommand{\PilotNeuralSpreadScaledMax}{0.32}
modified paper/main.pdf +0 −0

Binary file not shown.

modified paper/results_macros.tex +736 −0
@@ -8594,4 +8594,740 @@
8594 8594 \newcommand{\pwunfinalheldoutharrvvsnaiverwHsixzero}{-3.88}
8595 8595 \newcommand{\tpwunfinalheldoutharrvvsnaiverwHsixzero}{-17.4}
8596 8596 \newcommand{\ppwunfinalheldoutharrvvsnaiverwHsixzero}{0}
8597 +\newcommand{\crpsseedsmrptsmallonemonlystwoHfive}{0.4532}
8598 +\newcommand{\crpsrawseedsmrptsmallonemonlystwoHfive}{7.935e-04}
8599 +\newcommand{\covfiftyseedsmrptsmallonemonlystwoHfive}{54}
8600 +\newcommand{\covninetyfiveseedsmrptsmallonemonlystwoHfive}{95.5}
8601 +\newcommand{\diraccseedsmrptsmallonemonlystwoHfive}{0.500}
8602 +\newcommand{\crpsseedsmrptsmallonemonlystwoHonefive}{0.4416}
8603 +\newcommand{\crpsrawseedsmrptsmallonemonlystwoHonefive}{1.337e-03}
8604 +\newcommand{\covfiftyseedsmrptsmallonemonlystwoHonefive}{56}
8605 +\newcommand{\covninetyfiveseedsmrptsmallonemonlystwoHonefive}{95.9}
8606 +\newcommand{\diraccseedsmrptsmallonemonlystwoHonefive}{0.502}
8607 +\newcommand{\crpsseedsmrptsmallonemonlystwoHthreezero}{0.4318}
8608 +\newcommand{\crpsrawseedsmrptsmallonemonlystwoHthreezero}{1.846e-03}
8609 +\newcommand{\covfiftyseedsmrptsmallonemonlystwoHthreezero}{57}
8610 +\newcommand{\covninetyfiveseedsmrptsmallonemonlystwoHthreezero}{96.1}
8611 +\newcommand{\diraccseedsmrptsmallonemonlystwoHthreezero}{0.502}
8612 +\newcommand{\crpsseedsmrptsmallonemonlystwoHsixzero}{0.4199}
8613 +\newcommand{\crpsrawseedsmrptsmallonemonlystwoHsixzero}{2.532e-03}
8614 +\newcommand{\covfiftyseedsmrptsmallonemonlystwoHsixzero}{58}
8615 +\newcommand{\covninetyfiveseedsmrptsmallonemonlystwoHsixzero}{96.3}
8616 +\newcommand{\diraccseedsmrptsmallonemonlystwoHsixzero}{0.503}
8617 +\newcommand{\crpsseedsmrptsmallonemonlysthreeHfive}{0.4535}
8618 +\newcommand{\crpsrawseedsmrptsmallonemonlysthreeHfive}{7.941e-04}
8619 +\newcommand{\covfiftyseedsmrptsmallonemonlysthreeHfive}{55}
8620 +\newcommand{\covninetyfiveseedsmrptsmallonemonlysthreeHfive}{95.9}
8621 +\newcommand{\diraccseedsmrptsmallonemonlysthreeHfive}{0.501}
8622 +\newcommand{\crpsseedsmrptsmallonemonlysthreeHonefive}{0.4422}
8623 +\newcommand{\crpsrawseedsmrptsmallonemonlysthreeHonefive}{1.339e-03}
8624 +\newcommand{\covfiftyseedsmrptsmallonemonlysthreeHonefive}{57}
8625 +\newcommand{\covninetyfiveseedsmrptsmallonemonlysthreeHonefive}{96.2}
8626 +\newcommand{\diraccseedsmrptsmallonemonlysthreeHonefive}{0.501}
8627 +\newcommand{\crpsseedsmrptsmallonemonlysthreeHthreezero}{0.4324}
8628 +\newcommand{\crpsrawseedsmrptsmallonemonlysthreeHthreezero}{1.849e-03}
8629 +\newcommand{\covfiftyseedsmrptsmallonemonlysthreeHthreezero}{58}
8630 +\newcommand{\covninetyfiveseedsmrptsmallonemonlysthreeHthreezero}{96.3}
8631 +\newcommand{\diraccseedsmrptsmallonemonlysthreeHthreezero}{0.501}
8632 +\newcommand{\crpsseedsmrptsmallonemonlysthreeHsixzero}{0.4204}
8633 +\newcommand{\crpsrawseedsmrptsmallonemonlysthreeHsixzero}{2.536e-03}
8634 +\newcommand{\covfiftyseedsmrptsmallonemonlysthreeHsixzero}{59}
8635 +\newcommand{\covninetyfiveseedsmrptsmallonemonlysthreeHsixzero}{96.4}
8636 +\newcommand{\diraccseedsmrptsmallonemonlysthreeHsixzero}{0.501}
8637 +\newcommand{\crpsseedsmrptsmallonemonlysfourHfive}{0.4529}
8638 +\newcommand{\crpsrawseedsmrptsmallonemonlysfourHfive}{7.930e-04}
8639 +\newcommand{\covfiftyseedsmrptsmallonemonlysfourHfive}{54}
8640 +\newcommand{\covninetyfiveseedsmrptsmallonemonlysfourHfive}{95.4}
8641 +\newcommand{\diraccseedsmrptsmallonemonlysfourHfive}{0.500}
8642 +\newcommand{\crpsseedsmrptsmallonemonlysfourHonefive}{0.4414}
8643 +\newcommand{\crpsrawseedsmrptsmallonemonlysfourHonefive}{1.336e-03}
8644 +\newcommand{\covfiftyseedsmrptsmallonemonlysfourHonefive}{56}
8645 +\newcommand{\covninetyfiveseedsmrptsmallonemonlysfourHonefive}{95.8}
8646 +\newcommand{\diraccseedsmrptsmallonemonlysfourHonefive}{0.500}
8647 +\newcommand{\crpsseedsmrptsmallonemonlysfourHthreezero}{0.4314}
8648 +\newcommand{\crpsrawseedsmrptsmallonemonlysfourHthreezero}{1.844e-03}
8649 +\newcommand{\covfiftyseedsmrptsmallonemonlysfourHthreezero}{57}
8650 +\newcommand{\covninetyfiveseedsmrptsmallonemonlysfourHthreezero}{96.0}
8651 +\newcommand{\diraccseedsmrptsmallonemonlysfourHthreezero}{0.501}
8652 +\newcommand{\crpsseedsmrptsmallonemonlysfourHsixzero}{0.4193}
8653 +\newcommand{\crpsrawseedsmrptsmallonemonlysfourHsixzero}{2.528e-03}
8654 +\newcommand{\covfiftyseedsmrptsmallonemonlysfourHsixzero}{58}
8655 +\newcommand{\covninetyfiveseedsmrptsmallonemonlysfourHsixzero}{96.1}
8656 +\newcommand{\diraccseedsmrptsmallonemonlysfourHsixzero}{0.502}
8657 +\newcommand{\crpsseedsmrptsmallonemonlysfiveHfive}{0.4533}
8658 +\newcommand{\crpsrawseedsmrptsmallonemonlysfiveHfive}{7.937e-04}
8659 +\newcommand{\covfiftyseedsmrptsmallonemonlysfiveHfive}{55}
8660 +\newcommand{\covninetyfiveseedsmrptsmallonemonlysfiveHfive}{95.7}
8661 +\newcommand{\diraccseedsmrptsmallonemonlysfiveHfive}{0.500}
8662 +\newcommand{\crpsseedsmrptsmallonemonlysfiveHonefive}{0.4418}
8663 +\newcommand{\crpsrawseedsmrptsmallonemonlysfiveHonefive}{1.337e-03}
8664 +\newcommand{\covfiftyseedsmrptsmallonemonlysfiveHonefive}{57}
8665 +\newcommand{\covninetyfiveseedsmrptsmallonemonlysfiveHonefive}{96.0}
8666 +\newcommand{\diraccseedsmrptsmallonemonlysfiveHonefive}{0.500}
8667 +\newcommand{\crpsseedsmrptsmallonemonlysfiveHthreezero}{0.4318}
8668 +\newcommand{\crpsrawseedsmrptsmallonemonlysfiveHthreezero}{1.845e-03}
8669 +\newcommand{\covfiftyseedsmrptsmallonemonlysfiveHthreezero}{58}
8670 +\newcommand{\covninetyfiveseedsmrptsmallonemonlysfiveHthreezero}{96.2}
8671 +\newcommand{\diraccseedsmrptsmallonemonlysfiveHthreezero}{0.501}
8672 +\newcommand{\crpsseedsmrptsmallonemonlysfiveHsixzero}{0.4197}
8673 +\newcommand{\crpsrawseedsmrptsmallonemonlysfiveHsixzero}{2.530e-03}
8674 +\newcommand{\covfiftyseedsmrptsmallonemonlysfiveHsixzero}{58}
8675 +\newcommand{\covninetyfiveseedsmrptsmallonemonlysfiveHsixzero}{96.3}
8676 +\newcommand{\diraccseedsmrptsmallonemonlysfiveHsixzero}{0.502}
8677 +\newcommand{\crpsseedsmrptsmallstwoHfive}{0.4529}
8678 +\newcommand{\crpsrawseedsmrptsmallstwoHfive}{7.930e-04}
8679 +\newcommand{\covfiftyseedsmrptsmallstwoHfive}{54}
8680 +\newcommand{\covninetyfiveseedsmrptsmallstwoHfive}{95.5}
8681 +\newcommand{\diraccseedsmrptsmallstwoHfive}{0.500}
8682 +\newcommand{\crpsseedsmrptsmallstwoHonefive}{0.4413}
8683 +\newcommand{\crpsrawseedsmrptsmallstwoHonefive}{1.336e-03}
8684 +\newcommand{\covfiftyseedsmrptsmallstwoHonefive}{56}
8685 +\newcommand{\covninetyfiveseedsmrptsmallstwoHonefive}{95.8}
8686 +\newcommand{\diraccseedsmrptsmallstwoHonefive}{0.502}
8687 +\newcommand{\crpsseedsmrptsmallstwoHthreezero}{0.4312}
8688 +\newcommand{\crpsrawseedsmrptsmallstwoHthreezero}{1.843e-03}
8689 +\newcommand{\covfiftyseedsmrptsmallstwoHthreezero}{57}
8690 +\newcommand{\covninetyfiveseedsmrptsmallstwoHthreezero}{96.0}
8691 +\newcommand{\diraccseedsmrptsmallstwoHthreezero}{0.502}
8692 +\newcommand{\crpsseedsmrptsmallstwoHsixzero}{0.4189}
8693 +\newcommand{\crpsrawseedsmrptsmallstwoHsixzero}{2.527e-03}
8694 +\newcommand{\covfiftyseedsmrptsmallstwoHsixzero}{58}
8695 +\newcommand{\covninetyfiveseedsmrptsmallstwoHsixzero}{96.2}
8696 +\newcommand{\diraccseedsmrptsmallstwoHsixzero}{0.503}
8697 +\newcommand{\crpsseedsmrptsmallsthreeHfive}{0.4528}
8698 +\newcommand{\crpsrawseedsmrptsmallsthreeHfive}{7.927e-04}
8699 +\newcommand{\covfiftyseedsmrptsmallsthreeHfive}{54}
8700 +\newcommand{\covninetyfiveseedsmrptsmallsthreeHfive}{95.3}
8701 +\newcommand{\diraccseedsmrptsmallsthreeHfive}{0.501}
8702 +\newcommand{\crpsseedsmrptsmallsthreeHonefive}{0.4411}
8703 +\newcommand{\crpsrawseedsmrptsmallsthreeHonefive}{1.335e-03}
8704 +\newcommand{\covfiftyseedsmrptsmallsthreeHonefive}{56}
8705 +\newcommand{\covninetyfiveseedsmrptsmallsthreeHonefive}{95.6}
8706 +\newcommand{\diraccseedsmrptsmallsthreeHonefive}{0.501}
8707 +\newcommand{\crpsseedsmrptsmallsthreeHthreezero}{0.4309}
8708 +\newcommand{\crpsrawseedsmrptsmallsthreeHthreezero}{1.841e-03}
8709 +\newcommand{\covfiftyseedsmrptsmallsthreeHthreezero}{56}
8710 +\newcommand{\covninetyfiveseedsmrptsmallsthreeHthreezero}{95.8}
8711 +\newcommand{\diraccseedsmrptsmallsthreeHthreezero}{0.501}
8712 +\newcommand{\crpsseedsmrptsmallsthreeHsixzero}{0.4187}
8713 +\newcommand{\crpsrawseedsmrptsmallsthreeHsixzero}{2.522e-03}
8714 +\newcommand{\covfiftyseedsmrptsmallsthreeHsixzero}{57}
8715 +\newcommand{\covninetyfiveseedsmrptsmallsthreeHsixzero}{95.9}
8716 +\newcommand{\diraccseedsmrptsmallsthreeHsixzero}{0.502}
8717 +\newcommand{\crpsseedsmrptsmallsfourHfive}{0.4526}
8718 +\newcommand{\crpsrawseedsmrptsmallsfourHfive}{7.925e-04}
8719 +\newcommand{\covfiftyseedsmrptsmallsfourHfive}{54}
8720 +\newcommand{\covninetyfiveseedsmrptsmallsfourHfive}{95.2}
8721 +\newcommand{\diraccseedsmrptsmallsfourHfive}{0.501}
8722 +\newcommand{\crpsseedsmrptsmallsfourHonefive}{0.4409}
8723 +\newcommand{\crpsrawseedsmrptsmallsfourHonefive}{1.335e-03}
8724 +\newcommand{\covfiftyseedsmrptsmallsfourHonefive}{55}
8725 +\newcommand{\covninetyfiveseedsmrptsmallsfourHonefive}{95.6}
8726 +\newcommand{\diraccseedsmrptsmallsfourHonefive}{0.500}
8727 +\newcommand{\crpsseedsmrptsmallsfourHthreezero}{0.4309}
8728 +\newcommand{\crpsrawseedsmrptsmallsfourHthreezero}{1.842e-03}
8729 +\newcommand{\covfiftyseedsmrptsmallsfourHthreezero}{56}
8730 +\newcommand{\covninetyfiveseedsmrptsmallsfourHthreezero}{95.8}
8731 +\newcommand{\diraccseedsmrptsmallsfourHthreezero}{0.501}
8732 +\newcommand{\crpsseedsmrptsmallsfourHsixzero}{0.4186}
8733 +\newcommand{\crpsrawseedsmrptsmallsfourHsixzero}{2.524e-03}
8734 +\newcommand{\covfiftyseedsmrptsmallsfourHsixzero}{57}
8735 +\newcommand{\covninetyfiveseedsmrptsmallsfourHsixzero}{95.9}
8736 +\newcommand{\diraccseedsmrptsmallsfourHsixzero}{0.503}
8737 +\newcommand{\crpsseedsmrptsmallsfiveHfive}{0.4529}
8738 +\newcommand{\crpsrawseedsmrptsmallsfiveHfive}{7.929e-04}
8739 +\newcommand{\covfiftyseedsmrptsmallsfiveHfive}{54}
8740 +\newcommand{\covninetyfiveseedsmrptsmallsfiveHfive}{95.5}
8741 +\newcommand{\diraccseedsmrptsmallsfiveHfive}{0.500}
8742 +\newcommand{\crpsseedsmrptsmallsfiveHonefive}{0.4414}
8743 +\newcommand{\crpsrawseedsmrptsmallsfiveHonefive}{1.336e-03}
8744 +\newcommand{\covfiftyseedsmrptsmallsfiveHonefive}{56}
8745 +\newcommand{\covninetyfiveseedsmrptsmallsfiveHonefive}{95.9}
8746 +\newcommand{\diraccseedsmrptsmallsfiveHonefive}{0.501}
8747 +\newcommand{\crpsseedsmrptsmallsfiveHthreezero}{0.4314}
8748 +\newcommand{\crpsrawseedsmrptsmallsfiveHthreezero}{1.844e-03}
8749 +\newcommand{\covfiftyseedsmrptsmallsfiveHthreezero}{57}
8750 +\newcommand{\covninetyfiveseedsmrptsmallsfiveHthreezero}{96.0}
8751 +\newcommand{\diraccseedsmrptsmallsfiveHthreezero}{0.502}
8752 +\newcommand{\crpsseedsmrptsmallsfiveHsixzero}{0.4191}
8753 +\newcommand{\crpsrawseedsmrptsmallsfiveHsixzero}{2.527e-03}
8754 +\newcommand{\covfiftyseedsmrptsmallsfiveHsixzero}{58}
8755 +\newcommand{\covninetyfiveseedsmrptsmallsfiveHsixzero}{96.2}
8756 +\newcommand{\diraccseedsmrptsmallsfiveHsixzero}{0.502}
8757 +\newcommand{\pwseedsmrptsmallstwovsharrvHfive}{-1.87}
8758 +\newcommand{\tpwseedsmrptsmallstwovsharrvHfive}{-51.4}
8759 +\newcommand{\ppwseedsmrptsmallstwovsharrvHfive}{0}
8760 +\newcommand{\dmpwseedsmrptsmallstwovsharrvHfive}{-58.6}
8761 +\newcommand{\tclpwseedsmrptsmallstwovsharrvHfive}{-51.4}
8762 +\newcommand{\tdailypwseedsmrptsmallstwovsharrvHfive}{-46.4}
8763 +\newcommand{\pclpwseedsmrptsmallstwovsharrvHfive}{0}
8764 +\newcommand{\lopwseedsmrptsmallstwovsharrvHfive}{-1.94}
8765 +\newcommand{\hipwseedsmrptsmallstwovsharrvHfive}{-1.80}
8766 +\newcommand{\pwseedsmrptsmallstwovsharrvHonefive}{+0.21}
8767 +\newcommand{\tpwseedsmrptsmallstwovsharrvHonefive}{5.5}
8768 +\newcommand{\ppwseedsmrptsmallstwovsharrvHonefive}{2.04e-07}
8769 +\newcommand{\dmpwseedsmrptsmallstwovsharrvHonefive}{7.3}
8770 +\newcommand{\tclpwseedsmrptsmallstwovsharrvHonefive}{5.5}
8771 +\newcommand{\tdailypwseedsmrptsmallstwovsharrvHonefive}{5.6}
8772 +\newcommand{\pclpwseedsmrptsmallstwovsharrvHonefive}{4.09e-08}
8773 +\newcommand{\lopwseedsmrptsmallstwovsharrvHonefive}{+0.13}
8774 +\newcommand{\hipwseedsmrptsmallstwovsharrvHonefive}{+0.29}
8775 +\newcommand{\pwseedsmrptsmallstwovsharrvHthreezero}{+0.39}
8776 +\newcommand{\tpwseedsmrptsmallstwovsharrvHthreezero}{6.5}
8777 +\newcommand{\ppwseedsmrptsmallstwovsharrvHthreezero}{7.53e-10}
8778 +\newcommand{\dmpwseedsmrptsmallstwovsharrvHthreezero}{8.6}
8779 +\newcommand{\tclpwseedsmrptsmallstwovsharrvHthreezero}{6.5}
8780 +\newcommand{\tdailypwseedsmrptsmallstwovsharrvHthreezero}{7.0}
8781 +\newcommand{\pclpwseedsmrptsmallstwovsharrvHthreezero}{7.53e-11}
8782 +\newcommand{\lopwseedsmrptsmallstwovsharrvHthreezero}{+0.27}
8783 +\newcommand{\hipwseedsmrptsmallstwovsharrvHthreezero}{+0.51}
8784 +\newcommand{\pwseedsmrptsmallstwovsharrvHsixzero}{+0.56}
8785 +\newcommand{\tpwseedsmrptsmallstwovsharrvHsixzero}{6.8}
8786 +\newcommand{\ppwseedsmrptsmallstwovsharrvHsixzero}{1.35e-10}
8787 +\newcommand{\dmpwseedsmrptsmallstwovsharrvHsixzero}{7.7}
8788 +\newcommand{\tclpwseedsmrptsmallstwovsharrvHsixzero}{6.8}
8789 +\newcommand{\tdailypwseedsmrptsmallstwovsharrvHsixzero}{7.2}
8790 +\newcommand{\pclpwseedsmrptsmallstwovsharrvHsixzero}{9.01e-12}
8791 +\newcommand{\lopwseedsmrptsmallstwovsharrvHsixzero}{+0.40}
8792 +\newcommand{\hipwseedsmrptsmallstwovsharrvHsixzero}{+0.72}
8793 +\newcommand{\pwseedsmrptsmallsthreevsharrvHfive}{-1.88}
8794 +\newcommand{\tpwseedsmrptsmallsthreevsharrvHfive}{-51.1}
8795 +\newcommand{\ppwseedsmrptsmallsthreevsharrvHfive}{0}
8796 +\newcommand{\dmpwseedsmrptsmallsthreevsharrvHfive}{-59.2}
8797 +\newcommand{\tclpwseedsmrptsmallsthreevsharrvHfive}{-51.1}
8798 +\newcommand{\tdailypwseedsmrptsmallsthreevsharrvHfive}{-45.6}
8799 +\newcommand{\pclpwseedsmrptsmallsthreevsharrvHfive}{0}
8800 +\newcommand{\lopwseedsmrptsmallsthreevsharrvHfive}{-1.95}
8801 +\newcommand{\hipwseedsmrptsmallsthreevsharrvHfive}{-1.80}
8802 +\newcommand{\pwseedsmrptsmallsthreevsharrvHonefive}{+0.17}
8803 +\newcommand{\tpwseedsmrptsmallsthreevsharrvHonefive}{4.7}
8804 +\newcommand{\ppwseedsmrptsmallsthreevsharrvHonefive}{7.58e-06}
8805 +\newcommand{\dmpwseedsmrptsmallsthreevsharrvHonefive}{6.3}
8806 +\newcommand{\tclpwseedsmrptsmallsthreevsharrvHonefive}{4.7}
8807 +\newcommand{\tdailypwseedsmrptsmallsthreevsharrvHonefive}{4.8}
8808 +\newcommand{\pclpwseedsmrptsmallsthreevsharrvHonefive}{2.53e-06}
8809 +\newcommand{\lopwseedsmrptsmallsthreevsharrvHonefive}{+0.09}
8810 +\newcommand{\hipwseedsmrptsmallsthreevsharrvHonefive}{+0.24}
8811 +\newcommand{\pwseedsmrptsmallsthreevsharrvHthreezero}{+0.33}
8812 +\newcommand{\tpwseedsmrptsmallsthreevsharrvHthreezero}{5.8}
8813 +\newcommand{\ppwseedsmrptsmallsthreevsharrvHthreezero}{4.1e-08}
8814 +\newcommand{\dmpwseedsmrptsmallsthreevsharrvHthreezero}{7.8}
8815 +\newcommand{\tclpwseedsmrptsmallsthreevsharrvHthreezero}{5.8}
8816 +\newcommand{\tdailypwseedsmrptsmallsthreevsharrvHthreezero}{6.2}
8817 +\newcommand{\pclpwseedsmrptsmallsthreevsharrvHthreezero}{5.86e-09}
8818 +\newcommand{\lopwseedsmrptsmallsthreevsharrvHthreezero}{+0.21}
8819 +\newcommand{\hipwseedsmrptsmallsthreevsharrvHthreezero}{+0.43}
8820 +\newcommand{\pwseedsmrptsmallsthreevsharrvHsixzero}{+0.49}
8821 +\newcommand{\tpwseedsmrptsmallsthreevsharrvHsixzero}{6.8}
8822 +\newcommand{\ppwseedsmrptsmallsthreevsharrvHsixzero}{1.29e-10}
8823 +\newcommand{\dmpwseedsmrptsmallsthreevsharrvHsixzero}{8.0}
8824 +\newcommand{\tclpwseedsmrptsmallsthreevsharrvHsixzero}{6.8}
8825 +\newcommand{\tdailypwseedsmrptsmallsthreevsharrvHsixzero}{7.2}
8826 +\newcommand{\pclpwseedsmrptsmallsthreevsharrvHsixzero}{8.03e-12}
8827 +\newcommand{\lopwseedsmrptsmallsthreevsharrvHsixzero}{+0.34}
8828 +\newcommand{\hipwseedsmrptsmallsthreevsharrvHsixzero}{+0.63}
8829 +\newcommand{\pwseedsmrptsmallsfourvsharrvHfive}{-1.93}
8830 +\newcommand{\tpwseedsmrptsmallsfourvsharrvHfive}{-49.8}
8831 +\newcommand{\ppwseedsmrptsmallsfourvsharrvHfive}{0}
8832 +\newcommand{\dmpwseedsmrptsmallsfourvsharrvHfive}{-57.6}
8833 +\newcommand{\tclpwseedsmrptsmallsfourvsharrvHfive}{-49.8}
8834 +\newcommand{\tdailypwseedsmrptsmallsfourvsharrvHfive}{-45.9}
8835 +\newcommand{\pclpwseedsmrptsmallsfourvsharrvHfive}{0}
8836 +\newcommand{\lopwseedsmrptsmallsfourvsharrvHfive}{-2.01}
8837 +\newcommand{\hipwseedsmrptsmallsfourvsharrvHfive}{-1.85}
8838 +\newcommand{\pwseedsmrptsmallsfourvsharrvHonefive}{+0.14}
8839 +\newcommand{\tpwseedsmrptsmallsfourvsharrvHonefive}{4.0}
8840 +\newcommand{\ppwseedsmrptsmallsfourvsharrvHonefive}{6.65e-05}
8841 +\newcommand{\dmpwseedsmrptsmallsfourvsharrvHonefive}{5.2}
8842 +\newcommand{\tclpwseedsmrptsmallsfourvsharrvHonefive}{4.0}
8843 +\newcommand{\tdailypwseedsmrptsmallsfourvsharrvHonefive}{4.3}
8844 +\newcommand{\pclpwseedsmrptsmallsfourvsharrvHonefive}{6.65e-05}
8845 +\newcommand{\lopwseedsmrptsmallsfourvsharrvHonefive}{+0.07}
8846 +\newcommand{\hipwseedsmrptsmallsfourvsharrvHonefive}{+0.20}
8847 +\newcommand{\pwseedsmrptsmallsfourvsharrvHthreezero}{+0.31}
8848 +\newcommand{\tpwseedsmrptsmallsfourvsharrvHthreezero}{5.5}
8849 +\newcommand{\ppwseedsmrptsmallsfourvsharrvHthreezero}{2.04e-07}
8850 +\newcommand{\dmpwseedsmrptsmallsfourvsharrvHthreezero}{7.4}
8851 +\newcommand{\tclpwseedsmrptsmallsfourvsharrvHthreezero}{5.5}
8852 +\newcommand{\tdailypwseedsmrptsmallsfourvsharrvHthreezero}{6.2}
8853 +\newcommand{\pclpwseedsmrptsmallsfourvsharrvHthreezero}{4.34e-08}
8854 +\newcommand{\lopwseedsmrptsmallsfourvsharrvHthreezero}{+0.19}
8855 +\newcommand{\hipwseedsmrptsmallsfourvsharrvHthreezero}{+0.42}
8856 +\newcommand{\pwseedsmrptsmallsfourvsharrvHsixzero}{+0.48}
8857 +\newcommand{\tpwseedsmrptsmallsfourvsharrvHsixzero}{6.3}
8858 +\newcommand{\ppwseedsmrptsmallsfourvsharrvHsixzero}{3.02e-09}
8859 +\newcommand{\dmpwseedsmrptsmallsfourvsharrvHsixzero}{7.4}
8860 +\newcommand{\tclpwseedsmrptsmallsfourvsharrvHsixzero}{6.3}
8861 +\newcommand{\tdailypwseedsmrptsmallsfourvsharrvHsixzero}{7.1}
8862 +\newcommand{\pclpwseedsmrptsmallsfourvsharrvHsixzero}{3.36e-10}
8863 +\newcommand{\lopwseedsmrptsmallsfourvsharrvHsixzero}{+0.32}
8864 +\newcommand{\hipwseedsmrptsmallsfourvsharrvHsixzero}{+0.62}
8865 +\newcommand{\pwseedsmrptsmallsfivevsharrvHfive}{-1.86}
8866 +\newcommand{\tpwseedsmrptsmallsfivevsharrvHfive}{-49.6}
8867 +\newcommand{\ppwseedsmrptsmallsfivevsharrvHfive}{0}
8868 +\newcommand{\dmpwseedsmrptsmallsfivevsharrvHfive}{-57.4}
8869 +\newcommand{\tclpwseedsmrptsmallsfivevsharrvHfive}{-49.6}
8870 +\newcommand{\tdailypwseedsmrptsmallsfivevsharrvHfive}{-46.7}
8871 +\newcommand{\pclpwseedsmrptsmallsfivevsharrvHfive}{0}
8872 +\newcommand{\lopwseedsmrptsmallsfivevsharrvHfive}{-1.93}
8873 +\newcommand{\hipwseedsmrptsmallsfivevsharrvHfive}{-1.78}
8874 +\newcommand{\pwseedsmrptsmallsfivevsharrvHonefive}{+0.24}
8875 +\newcommand{\tpwseedsmrptsmallsfivevsharrvHonefive}{6.0}
8876 +\newcommand{\ppwseedsmrptsmallsfivevsharrvHonefive}{2.03e-08}
8877 +\newcommand{\dmpwseedsmrptsmallsfivevsharrvHonefive}{8.0}
8878 +\newcommand{\tclpwseedsmrptsmallsfivevsharrvHonefive}{6.0}
8879 +\newcommand{\tdailypwseedsmrptsmallsfivevsharrvHonefive}{6.1}
8880 +\newcommand{\pclpwseedsmrptsmallsfivevsharrvHonefive}{2.54e-09}
8881 +\newcommand{\lopwseedsmrptsmallsfivevsharrvHonefive}{+0.16}
8882 +\newcommand{\hipwseedsmrptsmallsfivevsharrvHonefive}{+0.32}
8883 +\newcommand{\pwseedsmrptsmallsfivevsharrvHthreezero}{+0.43}
8884 +\newcommand{\tpwseedsmrptsmallsfivevsharrvHthreezero}{6.6}
8885 +\newcommand{\ppwseedsmrptsmallsfivevsharrvHthreezero}{3.74e-10}
8886 +\newcommand{\dmpwseedsmrptsmallsfivevsharrvHthreezero}{8.9}
8887 +\newcommand{\tclpwseedsmrptsmallsfivevsharrvHthreezero}{6.6}
8888 +\newcommand{\tdailypwseedsmrptsmallsfivevsharrvHthreezero}{7.3}
8889 +\newcommand{\pclpwseedsmrptsmallsfivevsharrvHthreezero}{2.98e-11}
8890 +\newcommand{\lopwseedsmrptsmallsfivevsharrvHthreezero}{+0.29}
8891 +\newcommand{\hipwseedsmrptsmallsfivevsharrvHthreezero}{+0.55}
8892 +\newcommand{\pwseedsmrptsmallsfivevsharrvHsixzero}{+0.61}
8893 +\newcommand{\tpwseedsmrptsmallsfivevsharrvHsixzero}{6.6}
8894 +\newcommand{\ppwseedsmrptsmallsfivevsharrvHsixzero}{6.11e-10}
8895 +\newcommand{\dmpwseedsmrptsmallsfivevsharrvHsixzero}{7.8}
8896 +\newcommand{\tclpwseedsmrptsmallsfivevsharrvHsixzero}{6.6}
8897 +\newcommand{\tdailypwseedsmrptsmallsfivevsharrvHsixzero}{7.2}
8898 +\newcommand{\pclpwseedsmrptsmallsfivevsharrvHsixzero}{5.55e-11}
8899 +\newcommand{\lopwseedsmrptsmallsfivevsharrvHsixzero}{+0.42}
8900 +\newcommand{\hipwseedsmrptsmallsfivevsharrvHsixzero}{+0.78}
8901 +\newcommand{\pwseedsmrptsmallonemonlystwovsharrvHfive}{-1.81}
8902 +\newcommand{\tpwseedsmrptsmallonemonlystwovsharrvHfive}{-49.7}
8903 +\newcommand{\ppwseedsmrptsmallonemonlystwovsharrvHfive}{0}
8904 +\newcommand{\dmpwseedsmrptsmallonemonlystwovsharrvHfive}{-56.9}
8905 +\newcommand{\tclpwseedsmrptsmallonemonlystwovsharrvHfive}{-49.7}
8906 +\newcommand{\tdailypwseedsmrptsmallonemonlystwovsharrvHfive}{-44.9}
8907 +\newcommand{\pclpwseedsmrptsmallonemonlystwovsharrvHfive}{0}
8908 +\newcommand{\lopwseedsmrptsmallonemonlystwovsharrvHfive}{-1.88}
8909 +\newcommand{\hipwseedsmrptsmallonemonlystwovsharrvHfive}{-1.73}
8910 +\newcommand{\pwseedsmrptsmallonemonlystwovsharrvHonefive}{+0.30}
8911 +\newcommand{\tpwseedsmrptsmallonemonlystwovsharrvHonefive}{7.6}
8912 +\newcommand{\ppwseedsmrptsmallonemonlystwovsharrvHonefive}{3.88e-13}
8913 +\newcommand{\dmpwseedsmrptsmallonemonlystwovsharrvHonefive}{10.2}
8914 +\newcommand{\tclpwseedsmrptsmallonemonlystwovsharrvHonefive}{7.6}
8915 +\newcommand{\tdailypwseedsmrptsmallonemonlystwovsharrvHonefive}{7.8}
8916 +\newcommand{\pclpwseedsmrptsmallonemonlystwovsharrvHonefive}{2.15e-14}
8917 +\newcommand{\lopwseedsmrptsmallonemonlystwovsharrvHonefive}{+0.22}
8918 +\newcommand{\hipwseedsmrptsmallonemonlystwovsharrvHonefive}{+0.38}
8919 +\newcommand{\pwseedsmrptsmallonemonlystwovsharrvHthreezero}{+0.53}
8920 +\newcommand{\tpwseedsmrptsmallonemonlystwovsharrvHthreezero}{8.8}
8921 +\newcommand{\ppwseedsmrptsmallonemonlystwovsharrvHthreezero}{0}
8922 +\newcommand{\dmpwseedsmrptsmallonemonlystwovsharrvHthreezero}{11.4}
8923 +\newcommand{\tclpwseedsmrptsmallonemonlystwovsharrvHthreezero}{8.8}
8924 +\newcommand{\tdailypwseedsmrptsmallonemonlystwovsharrvHthreezero}{9.3}
8925 +\newcommand{\pclpwseedsmrptsmallonemonlystwovsharrvHthreezero}{0}
8926 +\newcommand{\lopwseedsmrptsmallonemonlystwovsharrvHthreezero}{+0.40}
8927 +\newcommand{\hipwseedsmrptsmallonemonlystwovsharrvHthreezero}{+0.64}
8928 +\newcommand{\pwseedsmrptsmallonemonlystwovsharrvHsixzero}{+0.79}
8929 +\newcommand{\tpwseedsmrptsmallonemonlystwovsharrvHsixzero}{9.9}
8930 +\newcommand{\ppwseedsmrptsmallonemonlystwovsharrvHsixzero}{0}
8931 +\newcommand{\dmpwseedsmrptsmallonemonlystwovsharrvHsixzero}{11.1}
8932 +\newcommand{\tclpwseedsmrptsmallonemonlystwovsharrvHsixzero}{9.9}
8933 +\newcommand{\tdailypwseedsmrptsmallonemonlystwovsharrvHsixzero}{10.5}
8934 +\newcommand{\pclpwseedsmrptsmallonemonlystwovsharrvHsixzero}{0}
8935 +\newcommand{\lopwseedsmrptsmallonemonlystwovsharrvHsixzero}{+0.63}
8936 +\newcommand{\hipwseedsmrptsmallonemonlystwovsharrvHsixzero}{+0.94}
8937 +\newcommand{\pwseedsmrptsmallonemonlysthreevsharrvHfive}{-1.73}
8938 +\newcommand{\tpwseedsmrptsmallonemonlysthreevsharrvHfive}{-53.3}
8939 +\newcommand{\ppwseedsmrptsmallonemonlysthreevsharrvHfive}{0}
8940 +\newcommand{\dmpwseedsmrptsmallonemonlysthreevsharrvHfive}{-60.3}
8941 +\newcommand{\tclpwseedsmrptsmallonemonlysthreevsharrvHfive}{-53.3}
8942 +\newcommand{\tdailypwseedsmrptsmallonemonlysthreevsharrvHfive}{-49.1}
8943 +\newcommand{\pclpwseedsmrptsmallonemonlysthreevsharrvHfive}{0}
8944 +\newcommand{\lopwseedsmrptsmallonemonlysthreevsharrvHfive}{-1.79}
8945 +\newcommand{\hipwseedsmrptsmallonemonlysthreevsharrvHfive}{-1.67}
8946 +\newcommand{\pwseedsmrptsmallonemonlysthreevsharrvHonefive}{+0.43}
8947 +\newcommand{\tpwseedsmrptsmallonemonlysthreevsharrvHonefive}{10.2}
8948 +\newcommand{\ppwseedsmrptsmallonemonlysthreevsharrvHonefive}{0}
8949 +\newcommand{\dmpwseedsmrptsmallonemonlysthreevsharrvHonefive}{14.3}
8950 +\newcommand{\tclpwseedsmrptsmallonemonlysthreevsharrvHonefive}{10.2}
8951 +\newcommand{\tdailypwseedsmrptsmallonemonlysthreevsharrvHonefive}{10.6}
8952 +\newcommand{\pclpwseedsmrptsmallonemonlysthreevsharrvHonefive}{0}
8953 +\newcommand{\lopwseedsmrptsmallonemonlysthreevsharrvHonefive}{+0.34}
8954 +\newcommand{\hipwseedsmrptsmallonemonlysthreevsharrvHonefive}{+0.51}
8955 +\newcommand{\pwseedsmrptsmallonemonlysthreevsharrvHthreezero}{+0.67}
8956 +\newcommand{\tpwseedsmrptsmallonemonlysthreevsharrvHthreezero}{10.3}
8957 +\newcommand{\ppwseedsmrptsmallonemonlysthreevsharrvHthreezero}{0}
8958 +\newcommand{\dmpwseedsmrptsmallonemonlysthreevsharrvHthreezero}{14.1}
8959 +\newcommand{\tclpwseedsmrptsmallonemonlysthreevsharrvHthreezero}{10.3}
8960 +\newcommand{\tdailypwseedsmrptsmallonemonlysthreevsharrvHthreezero}{11.5}
8961 +\newcommand{\pclpwseedsmrptsmallonemonlysthreevsharrvHthreezero}{0}
8962 +\newcommand{\lopwseedsmrptsmallonemonlysthreevsharrvHthreezero}{+0.53}
8963 +\newcommand{\hipwseedsmrptsmallonemonlysthreevsharrvHthreezero}{+0.79}
8964 +\newcommand{\pwseedsmrptsmallonemonlysthreevsharrvHsixzero}{+0.91}
8965 +\newcommand{\tpwseedsmrptsmallonemonlysthreevsharrvHsixzero}{11.0}
8966 +\newcommand{\ppwseedsmrptsmallonemonlysthreevsharrvHsixzero}{0}
8967 +\newcommand{\dmpwseedsmrptsmallonemonlysthreevsharrvHsixzero}{13.0}
8968 +\newcommand{\tclpwseedsmrptsmallonemonlysthreevsharrvHsixzero}{11.0}
8969 +\newcommand{\tdailypwseedsmrptsmallonemonlysthreevsharrvHsixzero}{12.5}
8970 +\newcommand{\pclpwseedsmrptsmallonemonlysthreevsharrvHsixzero}{0}
8971 +\newcommand{\lopwseedsmrptsmallonemonlysthreevsharrvHsixzero}{+0.74}
8972 +\newcommand{\hipwseedsmrptsmallonemonlysthreevsharrvHsixzero}{+1.06}
8973 +\newcommand{\pwseedsmrptsmallonemonlysfourvsharrvHfive}{-1.86}
8974 +\newcommand{\tpwseedsmrptsmallonemonlysfourvsharrvHfive}{-51.0}
8975 +\newcommand{\ppwseedsmrptsmallonemonlysfourvsharrvHfive}{0}
8976 +\newcommand{\dmpwseedsmrptsmallonemonlysfourvsharrvHfive}{-58.6}
8977 +\newcommand{\tclpwseedsmrptsmallonemonlysfourvsharrvHfive}{-51.0}
8978 +\newcommand{\tdailypwseedsmrptsmallonemonlysfourvsharrvHfive}{-46.4}
8979 +\newcommand{\pclpwseedsmrptsmallonemonlysfourvsharrvHfive}{0}
8980 +\newcommand{\lopwseedsmrptsmallonemonlysfourvsharrvHfive}{-1.93}
8981 +\newcommand{\hipwseedsmrptsmallonemonlysfourvsharrvHfive}{-1.79}
8982 +\newcommand{\pwseedsmrptsmallonemonlysfourvsharrvHonefive}{+0.24}
8983 +\newcommand{\tpwseedsmrptsmallonemonlysfourvsharrvHonefive}{6.8}
8984 +\newcommand{\ppwseedsmrptsmallonemonlysfourvsharrvHonefive}{1.44e-10}
8985 +\newcommand{\dmpwseedsmrptsmallonemonlysfourvsharrvHonefive}{8.9}
8986 +\newcommand{\tclpwseedsmrptsmallonemonlysfourvsharrvHonefive}{6.8}
8987 +\newcommand{\tdailypwseedsmrptsmallonemonlysfourvsharrvHonefive}{7.1}
8988 +\newcommand{\pclpwseedsmrptsmallonemonlysfourvsharrvHonefive}{1.03e-11}
8989 +\newcommand{\lopwseedsmrptsmallonemonlysfourvsharrvHonefive}{+0.17}
8990 +\newcommand{\hipwseedsmrptsmallonemonlysfourvsharrvHonefive}{+0.31}
8991 +\newcommand{\pwseedsmrptsmallonemonlysfourvsharrvHthreezero}{+0.44}
8992 +\newcommand{\tpwseedsmrptsmallonemonlysfourvsharrvHthreezero}{7.5}
8993 +\newcommand{\ppwseedsmrptsmallonemonlysfourvsharrvHthreezero}{1.1e-12}
8994 +\newcommand{\dmpwseedsmrptsmallonemonlysfourvsharrvHthreezero}{10.1}
8995 +\newcommand{\tclpwseedsmrptsmallonemonlysfourvsharrvHthreezero}{7.5}
8996 +\newcommand{\tdailypwseedsmrptsmallonemonlysfourvsharrvHthreezero}{8.4}
8997 +\newcommand{\pclpwseedsmrptsmallonemonlysfourvsharrvHthreezero}{6.48e-14}
8998 +\newcommand{\lopwseedsmrptsmallonemonlysfourvsharrvHthreezero}{+0.31}
8999 +\newcommand{\hipwseedsmrptsmallonemonlysfourvsharrvHthreezero}{+0.54}
9000 +\newcommand{\pwseedsmrptsmallonemonlysfourvsharrvHsixzero}{+0.65}
9001 +\newcommand{\tpwseedsmrptsmallonemonlysfourvsharrvHsixzero}{8.7}
9002 +\newcommand{\ppwseedsmrptsmallonemonlysfourvsharrvHsixzero}{0}
9003 +\newcommand{\dmpwseedsmrptsmallonemonlysfourvsharrvHsixzero}{10.1}
9004 +\newcommand{\tclpwseedsmrptsmallonemonlysfourvsharrvHsixzero}{8.7}
9005 +\newcommand{\tdailypwseedsmrptsmallonemonlysfourvsharrvHsixzero}{9.6}
9006 +\newcommand{\pclpwseedsmrptsmallonemonlysfourvsharrvHsixzero}{0}
9007 +\newcommand{\lopwseedsmrptsmallonemonlysfourvsharrvHsixzero}{+0.49}
9008 +\newcommand{\hipwseedsmrptsmallonemonlysfourvsharrvHsixzero}{+0.79}
9009 +\newcommand{\pwseedsmrptsmallonemonlysfivevsharrvHfive}{-1.78}
9010 +\newcommand{\tpwseedsmrptsmallonemonlysfivevsharrvHfive}{-51.8}
9011 +\newcommand{\ppwseedsmrptsmallonemonlysfivevsharrvHfive}{0}
9012 +\newcommand{\dmpwseedsmrptsmallonemonlysfivevsharrvHfive}{-58.8}
9013 +\newcommand{\tclpwseedsmrptsmallonemonlysfivevsharrvHfive}{-51.8}
9014 +\newcommand{\tdailypwseedsmrptsmallonemonlysfivevsharrvHfive}{-47.2}
9015 +\newcommand{\pclpwseedsmrptsmallonemonlysfivevsharrvHfive}{0}
9016 +\newcommand{\lopwseedsmrptsmallonemonlysfivevsharrvHfive}{-1.84}
9017 +\newcommand{\hipwseedsmrptsmallonemonlysfivevsharrvHfive}{-1.71}
9018 +\newcommand{\pwseedsmrptsmallonemonlysfivevsharrvHonefive}{+0.33}
9019 +\newcommand{\tpwseedsmrptsmallonemonlysfivevsharrvHonefive}{8.0}
9020 +\newcommand{\ppwseedsmrptsmallonemonlysfivevsharrvHonefive}{3.11e-14}
9021 +\newcommand{\dmpwseedsmrptsmallonemonlysfivevsharrvHonefive}{10.8}
9022 +\newcommand{\tclpwseedsmrptsmallonemonlysfivevsharrvHonefive}{8.0}
9023 +\newcommand{\tdailypwseedsmrptsmallonemonlysfivevsharrvHonefive}{8.5}
9024 +\newcommand{\pclpwseedsmrptsmallonemonlysfivevsharrvHonefive}{1.55e-15}
9025 +\newcommand{\lopwseedsmrptsmallonemonlysfivevsharrvHonefive}{+0.24}
9026 +\newcommand{\hipwseedsmrptsmallonemonlysfivevsharrvHonefive}{+0.40}
9027 +\newcommand{\pwseedsmrptsmallonemonlysfivevsharrvHthreezero}{+0.53}
9028 +\newcommand{\tpwseedsmrptsmallonemonlysfivevsharrvHthreezero}{8.3}
9029 +\newcommand{\ppwseedsmrptsmallonemonlysfivevsharrvHthreezero}{4.66e-15}
9030 +\newcommand{\dmpwseedsmrptsmallonemonlysfivevsharrvHthreezero}{11.2}
9031 +\newcommand{\tclpwseedsmrptsmallonemonlysfivevsharrvHthreezero}{8.3}
9032 +\newcommand{\tdailypwseedsmrptsmallonemonlysfivevsharrvHthreezero}{9.3}
9033 +\newcommand{\pclpwseedsmrptsmallonemonlysfivevsharrvHthreezero}{2.22e-16}
9034 +\newcommand{\lopwseedsmrptsmallonemonlysfivevsharrvHthreezero}{+0.39}
9035 +\newcommand{\hipwseedsmrptsmallonemonlysfivevsharrvHthreezero}{+0.65}
9036 +\newcommand{\pwseedsmrptsmallonemonlysfivevsharrvHsixzero}{+0.75}
9037 +\newcommand{\tpwseedsmrptsmallonemonlysfivevsharrvHsixzero}{9.1}
9038 +\newcommand{\ppwseedsmrptsmallonemonlysfivevsharrvHsixzero}{0}
9039 +\newcommand{\dmpwseedsmrptsmallonemonlysfivevsharrvHsixzero}{10.6}
9040 +\newcommand{\tclpwseedsmrptsmallonemonlysfivevsharrvHsixzero}{9.1}
9041 +\newcommand{\tdailypwseedsmrptsmallonemonlysfivevsharrvHsixzero}{10.4}
9042 +\newcommand{\pclpwseedsmrptsmallonemonlysfivevsharrvHsixzero}{0}
9043 +\newcommand{\lopwseedsmrptsmallonemonlysfivevsharrvHsixzero}{+0.57}
9044 +\newcommand{\hipwseedsmrptsmallonemonlysfivevsharrvHsixzero}{+0.90}
9045 +\newcommand{\pwseedsmrptsmallstwovsmrptsmallonemonlystwoHfive}{-0.06}
9046 +\newcommand{\tpwseedsmrptsmallstwovsmrptsmallonemonlystwoHfive}{-7.9}
9047 +\newcommand{\ppwseedsmrptsmallstwovsmrptsmallonemonlystwoHfive}{3.8e-14}
9048 +\newcommand{\dmpwseedsmrptsmallstwovsmrptsmallonemonlystwoHfive}{-9.8}
9049 +\newcommand{\tclpwseedsmrptsmallstwovsmrptsmallonemonlystwoHfive}{-7.9}
9050 +\newcommand{\tdailypwseedsmrptsmallstwovsmrptsmallonemonlystwoHfive}{-7.7}
9051 +\newcommand{\pclpwseedsmrptsmallstwovsmrptsmallonemonlystwoHfive}{2e-15}
9052 +\newcommand{\lopwseedsmrptsmallstwovsmrptsmallonemonlystwoHfive}{-0.08}
9053 +\newcommand{\hipwseedsmrptsmallstwovsmrptsmallonemonlystwoHfive}{-0.05}
9054 +\newcommand{\pwseedsmrptsmallstwovsmrptsmallonemonlystwoHonefive}{-0.09}
9055 +\newcommand{\tpwseedsmrptsmallstwovsmrptsmallonemonlystwoHonefive}{-9.2}
9056 +\newcommand{\ppwseedsmrptsmallstwovsmrptsmallonemonlystwoHonefive}{0}
9057 +\newcommand{\dmpwseedsmrptsmallstwovsmrptsmallonemonlystwoHonefive}{-12.4}
9058 +\newcommand{\tclpwseedsmrptsmallstwovsmrptsmallonemonlystwoHonefive}{-9.2}
9059 +\newcommand{\tdailypwseedsmrptsmallstwovsmrptsmallonemonlystwoHonefive}{-8.8}
9060 +\newcommand{\pclpwseedsmrptsmallstwovsmrptsmallonemonlystwoHonefive}{0}
9061 +\newcommand{\lopwseedsmrptsmallstwovsmrptsmallonemonlystwoHonefive}{-0.11}
9062 +\newcommand{\hipwseedsmrptsmallstwovsmrptsmallonemonlystwoHonefive}{-0.07}
9063 +\newcommand{\pwseedsmrptsmallstwovsmrptsmallonemonlystwoHthreezero}{-0.14}
9064 +\newcommand{\tpwseedsmrptsmallstwovsmrptsmallonemonlystwoHthreezero}{-10.5}
9065 +\newcommand{\ppwseedsmrptsmallstwovsmrptsmallonemonlystwoHthreezero}{0}
9066 +\newcommand{\dmpwseedsmrptsmallstwovsmrptsmallonemonlystwoHthreezero}{-13.8}
9067 +\newcommand{\tclpwseedsmrptsmallstwovsmrptsmallonemonlystwoHthreezero}{-10.5}
9068 +\newcommand{\tdailypwseedsmrptsmallstwovsmrptsmallonemonlystwoHthreezero}{-10.6}
9069 +\newcommand{\pclpwseedsmrptsmallstwovsmrptsmallonemonlystwoHthreezero}{0}
9070 +\newcommand{\lopwseedsmrptsmallstwovsmrptsmallonemonlystwoHthreezero}{-0.16}
9071 +\newcommand{\hipwseedsmrptsmallstwovsmrptsmallonemonlystwoHthreezero}{-0.11}
9072 +\newcommand{\pwseedsmrptsmallstwovsmrptsmallonemonlystwoHsixzero}{-0.23}
9073 +\newcommand{\tpwseedsmrptsmallstwovsmrptsmallonemonlystwoHsixzero}{-10.7}
9074 +\newcommand{\ppwseedsmrptsmallstwovsmrptsmallonemonlystwoHsixzero}{0}
9075 +\newcommand{\dmpwseedsmrptsmallstwovsmrptsmallonemonlystwoHsixzero}{-12.8}
9076 +\newcommand{\tclpwseedsmrptsmallstwovsmrptsmallonemonlystwoHsixzero}{-10.7}
9077 +\newcommand{\tdailypwseedsmrptsmallstwovsmrptsmallonemonlystwoHsixzero}{-11.2}
9078 +\newcommand{\pclpwseedsmrptsmallstwovsmrptsmallonemonlystwoHsixzero}{0}
9079 +\newcommand{\lopwseedsmrptsmallstwovsmrptsmallonemonlystwoHsixzero}{-0.27}
9080 +\newcommand{\hipwseedsmrptsmallstwovsmrptsmallonemonlystwoHsixzero}{-0.18}
9081 +\newcommand{\pwseedsmrptsmallsthreevsmrptsmallonemonlysthreeHfive}{-0.15}
9082 +\newcommand{\tpwseedsmrptsmallsthreevsmrptsmallonemonlysthreeHfive}{-15.7}
9083 +\newcommand{\ppwseedsmrptsmallsthreevsmrptsmallonemonlysthreeHfive}{0}
9084 +\newcommand{\dmpwseedsmrptsmallsthreevsmrptsmallonemonlysthreeHfive}{-19.3}
9085 +\newcommand{\tclpwseedsmrptsmallsthreevsmrptsmallonemonlysthreeHfive}{-15.7}
9086 +\newcommand{\tdailypwseedsmrptsmallsthreevsmrptsmallonemonlysthreeHfive}{-13.9}
9087 +\newcommand{\pclpwseedsmrptsmallsthreevsmrptsmallonemonlysthreeHfive}{0}
9088 +\newcommand{\lopwseedsmrptsmallsthreevsmrptsmallonemonlysthreeHfive}{-0.16}
9089 +\newcommand{\hipwseedsmrptsmallsthreevsmrptsmallonemonlysthreeHfive}{-0.13}
9090 +\newcommand{\pwseedsmrptsmallsthreevsmrptsmallonemonlysthreeHonefive}{-0.26}
9091 +\newcommand{\tpwseedsmrptsmallsthreevsmrptsmallonemonlysthreeHonefive}{-20.6}
9092 +\newcommand{\ppwseedsmrptsmallsthreevsmrptsmallonemonlysthreeHonefive}{0}
9093 +\newcommand{\dmpwseedsmrptsmallsthreevsmrptsmallonemonlysthreeHonefive}{-28.0}
9094 +\newcommand{\tclpwseedsmrptsmallsthreevsmrptsmallonemonlysthreeHonefive}{-20.6}
9095 +\newcommand{\tdailypwseedsmrptsmallsthreevsmrptsmallonemonlysthreeHonefive}{-23.6}
9096 +\newcommand{\pclpwseedsmrptsmallsthreevsmrptsmallonemonlysthreeHonefive}{0}
9097 +\newcommand{\lopwseedsmrptsmallsthreevsmrptsmallonemonlysthreeHonefive}{-0.28}
9098 +\newcommand{\hipwseedsmrptsmallsthreevsmrptsmallonemonlysthreeHonefive}{-0.23}
9099 +\newcommand{\pwseedsmrptsmallsthreevsmrptsmallonemonlysthreeHthreezero}{-0.34}
9100 +\newcommand{\tpwseedsmrptsmallsthreevsmrptsmallonemonlysthreeHthreezero}{-19.9}
9101 +\newcommand{\ppwseedsmrptsmallsthreevsmrptsmallonemonlysthreeHthreezero}{0}
9102 +\newcommand{\dmpwseedsmrptsmallsthreevsmrptsmallonemonlysthreeHthreezero}{-25.7}
9103 +\newcommand{\tclpwseedsmrptsmallsthreevsmrptsmallonemonlysthreeHthreezero}{-19.9}
9104 +\newcommand{\tdailypwseedsmrptsmallsthreevsmrptsmallonemonlysthreeHthreezero}{-22.4}
9105 +\newcommand{\pclpwseedsmrptsmallsthreevsmrptsmallonemonlysthreeHthreezero}{0}
9106 +\newcommand{\lopwseedsmrptsmallsthreevsmrptsmallonemonlysthreeHthreezero}{-0.37}
9107 +\newcommand{\hipwseedsmrptsmallsthreevsmrptsmallonemonlysthreeHthreezero}{-0.30}
9108 +\newcommand{\pwseedsmrptsmallsthreevsmrptsmallonemonlysthreeHsixzero}{-0.41}
9109 +\newcommand{\tpwseedsmrptsmallsthreevsmrptsmallonemonlysthreeHsixzero}{-17.0}
9110 +\newcommand{\ppwseedsmrptsmallsthreevsmrptsmallonemonlysthreeHsixzero}{0}
9111 +\newcommand{\dmpwseedsmrptsmallsthreevsmrptsmallonemonlysthreeHsixzero}{-21.5}
9112 +\newcommand{\tclpwseedsmrptsmallsthreevsmrptsmallonemonlysthreeHsixzero}{-17.0}
9113 +\newcommand{\tdailypwseedsmrptsmallsthreevsmrptsmallonemonlysthreeHsixzero}{-22.0}
9114 +\newcommand{\pclpwseedsmrptsmallsthreevsmrptsmallonemonlysthreeHsixzero}{0}
9115 +\newcommand{\lopwseedsmrptsmallsthreevsmrptsmallonemonlysthreeHsixzero}{-0.46}
9116 +\newcommand{\hipwseedsmrptsmallsthreevsmrptsmallonemonlysthreeHsixzero}{-0.37}
9117 +\newcommand{\pwseedsmrptsmallsfourvsmrptsmallonemonlysfourHfive}{-0.07}
9118 +\newcommand{\tpwseedsmrptsmallsfourvsmrptsmallonemonlysfourHfive}{-10.1}
9119 +\newcommand{\ppwseedsmrptsmallsfourvsmrptsmallonemonlysfourHfive}{0}
9120 +\newcommand{\dmpwseedsmrptsmallsfourvsmrptsmallonemonlysfourHfive}{-11.5}
9121 +\newcommand{\tclpwseedsmrptsmallsfourvsmrptsmallonemonlysfourHfive}{-10.1}
9122 +\newcommand{\tdailypwseedsmrptsmallsfourvsmrptsmallonemonlysfourHfive}{-10.5}
9123 +\newcommand{\pclpwseedsmrptsmallsfourvsmrptsmallonemonlysfourHfive}{0}
9124 +\newcommand{\lopwseedsmrptsmallsfourvsmrptsmallonemonlysfourHfive}{-0.08}
9125 +\newcommand{\hipwseedsmrptsmallsfourvsmrptsmallonemonlysfourHfive}{-0.06}
9126 +\newcommand{\pwseedsmrptsmallsfourvsmrptsmallonemonlysfourHonefive}{-0.11}
9127 +\newcommand{\tpwseedsmrptsmallsfourvsmrptsmallonemonlysfourHonefive}{-12.0}
9128 +\newcommand{\ppwseedsmrptsmallsfourvsmrptsmallonemonlysfourHonefive}{0}
9129 +\newcommand{\dmpwseedsmrptsmallsfourvsmrptsmallonemonlysfourHonefive}{-14.8}
9130 +\newcommand{\tclpwseedsmrptsmallsfourvsmrptsmallonemonlysfourHonefive}{-12.0}
9131 +\newcommand{\tdailypwseedsmrptsmallsfourvsmrptsmallonemonlysfourHonefive}{-12.4}
9132 +\newcommand{\pclpwseedsmrptsmallsfourvsmrptsmallonemonlysfourHonefive}{0}
9133 +\newcommand{\lopwseedsmrptsmallsfourvsmrptsmallonemonlysfourHonefive}{-0.12}
9134 +\newcommand{\hipwseedsmrptsmallsfourvsmrptsmallonemonlysfourHonefive}{-0.09}
9135 +\newcommand{\pwseedsmrptsmallsfourvsmrptsmallonemonlysfourHthreezero}{-0.12}
9136 +\newcommand{\tpwseedsmrptsmallsfourvsmrptsmallonemonlysfourHthreezero}{-11.0}
9137 +\newcommand{\ppwseedsmrptsmallsfourvsmrptsmallonemonlysfourHthreezero}{0}
9138 +\newcommand{\dmpwseedsmrptsmallsfourvsmrptsmallonemonlysfourHthreezero}{-12.6}
9139 +\newcommand{\tclpwseedsmrptsmallsfourvsmrptsmallonemonlysfourHthreezero}{-11.0}
9140 +\newcommand{\tdailypwseedsmrptsmallsfourvsmrptsmallonemonlysfourHthreezero}{-11.8}
9141 +\newcommand{\pclpwseedsmrptsmallsfourvsmrptsmallonemonlysfourHthreezero}{0}
9142 +\newcommand{\lopwseedsmrptsmallsfourvsmrptsmallonemonlysfourHthreezero}{-0.14}
9143 +\newcommand{\hipwseedsmrptsmallsfourvsmrptsmallonemonlysfourHthreezero}{-0.10}
9144 +\newcommand{\pwseedsmrptsmallsfourvsmrptsmallonemonlysfourHsixzero}{-0.17}
9145 +\newcommand{\tpwseedsmrptsmallsfourvsmrptsmallonemonlysfourHsixzero}{-9.5}
9146 +\newcommand{\ppwseedsmrptsmallsfourvsmrptsmallonemonlysfourHsixzero}{0}
9147 +\newcommand{\dmpwseedsmrptsmallsfourvsmrptsmallonemonlysfourHsixzero}{-11.1}
9148 +\newcommand{\tclpwseedsmrptsmallsfourvsmrptsmallonemonlysfourHsixzero}{-9.5}
9149 +\newcommand{\tdailypwseedsmrptsmallsfourvsmrptsmallonemonlysfourHsixzero}{-9.6}
9150 +\newcommand{\pclpwseedsmrptsmallsfourvsmrptsmallonemonlysfourHsixzero}{0}
9151 +\newcommand{\lopwseedsmrptsmallsfourvsmrptsmallonemonlysfourHsixzero}{-0.20}
9152 +\newcommand{\hipwseedsmrptsmallsfourvsmrptsmallonemonlysfourHsixzero}{-0.13}
9153 +\newcommand{\pwseedsmrptsmallsfivevsmrptsmallonemonlysfiveHfive}{-0.09}
9154 +\newcommand{\tpwseedsmrptsmallsfivevsmrptsmallonemonlysfiveHfive}{-9.4}
9155 +\newcommand{\ppwseedsmrptsmallsfivevsmrptsmallonemonlysfiveHfive}{0}
9156 +\newcommand{\dmpwseedsmrptsmallsfivevsmrptsmallonemonlysfiveHfive}{-12.0}
9157 +\newcommand{\tclpwseedsmrptsmallsfivevsmrptsmallonemonlysfiveHfive}{-9.4}
9158 +\newcommand{\tdailypwseedsmrptsmallsfivevsmrptsmallonemonlysfiveHfive}{-9.8}
9159 +\newcommand{\pclpwseedsmrptsmallsfivevsmrptsmallonemonlysfiveHfive}{0}
9160 +\newcommand{\lopwseedsmrptsmallsfivevsmrptsmallonemonlysfiveHfive}{-0.10}
9161 +\newcommand{\hipwseedsmrptsmallsfivevsmrptsmallonemonlysfiveHfive}{-0.07}
9162 +\newcommand{\pwseedsmrptsmallsfivevsmrptsmallonemonlysfiveHonefive}{-0.08}
9163 +\newcommand{\tpwseedsmrptsmallsfivevsmrptsmallonemonlysfiveHonefive}{-6.7}
9164 +\newcommand{\ppwseedsmrptsmallsfivevsmrptsmallonemonlysfiveHonefive}{3.74e-10}
9165 +\newcommand{\dmpwseedsmrptsmallsfivevsmrptsmallonemonlysfiveHonefive}{-9.7}
9166 +\newcommand{\tclpwseedsmrptsmallsfivevsmrptsmallonemonlysfiveHonefive}{-6.7}
9167 +\newcommand{\tdailypwseedsmrptsmallsfivevsmrptsmallonemonlysfiveHonefive}{-7.3}
9168 +\newcommand{\pclpwseedsmrptsmallsfivevsmrptsmallonemonlysfiveHonefive}{2.88e-11}
9169 +\newcommand{\lopwseedsmrptsmallsfivevsmrptsmallonemonlysfiveHonefive}{-0.11}
9170 +\newcommand{\hipwseedsmrptsmallsfivevsmrptsmallonemonlysfiveHonefive}{-0.06}
9171 +\newcommand{\pwseedsmrptsmallsfivevsmrptsmallonemonlysfiveHthreezero}{-0.10}
9172 +\newcommand{\tpwseedsmrptsmallsfivevsmrptsmallonemonlysfiveHthreezero}{-5.6}
9173 +\newcommand{\ppwseedsmrptsmallsfivevsmrptsmallonemonlysfiveHthreezero}{1.3e-07}
9174 +\newcommand{\dmpwseedsmrptsmallsfivevsmrptsmallonemonlysfiveHthreezero}{-7.6}
9175 +\newcommand{\tclpwseedsmrptsmallsfivevsmrptsmallonemonlysfiveHthreezero}{-5.6}
9176 +\newcommand{\tdailypwseedsmrptsmallsfivevsmrptsmallonemonlysfiveHthreezero}{-6.0}
9177 +\newcommand{\pclpwseedsmrptsmallsfivevsmrptsmallonemonlysfiveHthreezero}{2.16e-08}
9178 +\newcommand{\lopwseedsmrptsmallsfivevsmrptsmallonemonlysfiveHthreezero}{-0.13}
9179 +\newcommand{\hipwseedsmrptsmallsfivevsmrptsmallonemonlysfiveHthreezero}{-0.06}
9180 +\newcommand{\pwseedsmrptsmallsfivevsmrptsmallonemonlysfiveHsixzero}{-0.14}
9181 +\newcommand{\tpwseedsmrptsmallsfivevsmrptsmallonemonlysfiveHsixzero}{-4.6}
9182 +\newcommand{\ppwseedsmrptsmallsfivevsmrptsmallonemonlysfiveHsixzero}{7.96e-06}
9183 +\newcommand{\dmpwseedsmrptsmallsfivevsmrptsmallonemonlysfiveHsixzero}{-5.9}
9184 +\newcommand{\tclpwseedsmrptsmallsfivevsmrptsmallonemonlysfiveHsixzero}{-4.6}
9185 +\newcommand{\tdailypwseedsmrptsmallsfivevsmrptsmallonemonlysfiveHsixzero}{-4.7}
9186 +\newcommand{\pclpwseedsmrptsmallsfivevsmrptsmallonemonlysfiveHsixzero}{3.98e-06}
9187 +\newcommand{\lopwseedsmrptsmallsfivevsmrptsmallonemonlysfiveHsixzero}{-0.19}
9188 +\newcommand{\hipwseedsmrptsmallsfivevsmrptsmallonemonlysfiveHsixzero}{-0.08}
9189 +\newcommand{\pwunseedsmrptsmallstwovsharrvHfive}{-1.94}
9190 +\newcommand{\tpwunseedsmrptsmallstwovsharrvHfive}{-52.0}
9191 +\newcommand{\ppwunseedsmrptsmallstwovsharrvHfive}{0}
9192 +\newcommand{\pwunseedsmrptsmallstwovsharrvHonefive}{+0.35}
9193 +\newcommand{\tpwunseedsmrptsmallstwovsharrvHonefive}{8.7}
9194 +\newcommand{\ppwunseedsmrptsmallstwovsharrvHonefive}{0}
9195 +\newcommand{\pwunseedsmrptsmallstwovsharrvHthreezero}{+0.59}
9196 +\newcommand{\tpwunseedsmrptsmallstwovsharrvHthreezero}{9.9}
9197 +\newcommand{\ppwunseedsmrptsmallstwovsharrvHthreezero}{0}
9198 +\newcommand{\pwunseedsmrptsmallstwovsharrvHsixzero}{+0.78}
9199 +\newcommand{\tpwunseedsmrptsmallstwovsharrvHsixzero}{10.2}
9200 +\newcommand{\ppwunseedsmrptsmallstwovsharrvHsixzero}{0}
9201 +\newcommand{\pwunseedsmrptsmallsthreevsharrvHfive}{-1.98}
9202 +\newcommand{\tpwunseedsmrptsmallsthreevsharrvHfive}{-52.3}
9203 +\newcommand{\ppwunseedsmrptsmallsthreevsharrvHfive}{0}
9204 +\newcommand{\pwunseedsmrptsmallsthreevsharrvHonefive}{+0.25}
9205 +\newcommand{\tpwunseedsmrptsmallsthreevsharrvHonefive}{6.9}
9206 +\newcommand{\ppwunseedsmrptsmallsthreevsharrvHonefive}{3.31e-11}
9207 +\newcommand{\pwunseedsmrptsmallsthreevsharrvHthreezero}{+0.45}
9208 +\newcommand{\tpwunseedsmrptsmallsthreevsharrvHthreezero}{8.4}
9209 +\newcommand{\ppwunseedsmrptsmallsthreevsharrvHthreezero}{0}
9210 +\newcommand{\pwunseedsmrptsmallsthreevsharrvHsixzero}{+0.60}
9211 +\newcommand{\tpwunseedsmrptsmallsthreevsharrvHsixzero}{9.2}
9212 +\newcommand{\ppwunseedsmrptsmallsthreevsharrvHsixzero}{0}
9213 +\newcommand{\pwunseedsmrptsmallsfourvsharrvHfive}{-2.01}
9214 +\newcommand{\tpwunseedsmrptsmallsfourvsharrvHfive}{-51.9}
9215 +\newcommand{\ppwunseedsmrptsmallsfourvsharrvHfive}{0}
9216 +\newcommand{\pwunseedsmrptsmallsfourvsharrvHonefive}{+0.27}
9217 +\newcommand{\tpwunseedsmrptsmallsfourvsharrvHonefive}{7.4}
9218 +\newcommand{\ppwunseedsmrptsmallsfourvsharrvHonefive}{5.84e-13}
9219 +\newcommand{\pwunseedsmrptsmallsfourvsharrvHthreezero}{+0.51}
9220 +\newcommand{\tpwunseedsmrptsmallsfourvsharrvHthreezero}{9.0}
9221 +\newcommand{\ppwunseedsmrptsmallsfourvsharrvHthreezero}{0}
9222 +\newcommand{\pwunseedsmrptsmallsfourvsharrvHsixzero}{+0.68}
9223 +\newcommand{\tpwunseedsmrptsmallsfourvsharrvHsixzero}{9.4}
9224 +\newcommand{\ppwunseedsmrptsmallsfourvsharrvHsixzero}{0}
9225 +\newcommand{\pwunseedsmrptsmallsfivevsharrvHfive}{-1.95}
9226 +\newcommand{\tpwunseedsmrptsmallsfivevsharrvHfive}{-50.6}
9227 +\newcommand{\ppwunseedsmrptsmallsfivevsharrvHfive}{0}
9228 +\newcommand{\pwunseedsmrptsmallsfivevsharrvHonefive}{+0.36}
9229 +\newcommand{\tpwunseedsmrptsmallsfivevsharrvHonefive}{8.5}
9230 +\newcommand{\ppwunseedsmrptsmallsfivevsharrvHonefive}{0}
9231 +\newcommand{\pwunseedsmrptsmallsfivevsharrvHthreezero}{+0.60}
9232 +\newcommand{\tpwunseedsmrptsmallsfivevsharrvHthreezero}{9.5}
9233 +\newcommand{\ppwunseedsmrptsmallsfivevsharrvHthreezero}{0}
9234 +\newcommand{\pwunseedsmrptsmallsfivevsharrvHsixzero}{+0.78}
9235 +\newcommand{\tpwunseedsmrptsmallsfivevsharrvHsixzero}{9.1}
9236 +\newcommand{\ppwunseedsmrptsmallsfivevsharrvHsixzero}{0}
9237 +\newcommand{\pwunseedsmrptsmallonemonlystwovsharrvHfive}{-1.88}
9238 +\newcommand{\tpwunseedsmrptsmallonemonlystwovsharrvHfive}{-51.9}
9239 +\newcommand{\ppwunseedsmrptsmallonemonlystwovsharrvHfive}{0}
9240 +\newcommand{\pwunseedsmrptsmallonemonlystwovsharrvHonefive}{+0.44}
9241 +\newcommand{\tpwunseedsmrptsmallonemonlystwovsharrvHonefive}{10.7}
9242 +\newcommand{\ppwunseedsmrptsmallonemonlystwovsharrvHonefive}{0}
9243 +\newcommand{\pwunseedsmrptsmallonemonlystwovsharrvHthreezero}{+0.73}
9244 +\newcommand{\tpwunseedsmrptsmallonemonlystwovsharrvHthreezero}{12.2}
9245 +\newcommand{\ppwunseedsmrptsmallonemonlystwovsharrvHthreezero}{0}
9246 +\newcommand{\pwunseedsmrptsmallonemonlystwovsharrvHsixzero}{+1.01}
9247 +\newcommand{\tpwunseedsmrptsmallonemonlystwovsharrvHsixzero}{13.5}
9248 +\newcommand{\ppwunseedsmrptsmallonemonlystwovsharrvHsixzero}{0}
9249 +\newcommand{\pwunseedsmrptsmallonemonlysthreevsharrvHfive}{-1.80}
9250 +\newcommand{\tpwunseedsmrptsmallonemonlysthreevsharrvHfive}{-54.0}
9251 +\newcommand{\ppwunseedsmrptsmallonemonlysthreevsharrvHfive}{0}
9252 +\newcommand{\pwunseedsmrptsmallonemonlysthreevsharrvHonefive}{+0.59}
9253 +\newcommand{\tpwunseedsmrptsmallonemonlysthreevsharrvHonefive}{13.5}
9254 +\newcommand{\ppwunseedsmrptsmallonemonlysthreevsharrvHonefive}{0}
9255 +\newcommand{\pwunseedsmrptsmallonemonlysthreevsharrvHthreezero}{+0.90}
9256 +\newcommand{\tpwunseedsmrptsmallonemonlysthreevsharrvHthreezero}{14.2}
9257 +\newcommand{\ppwunseedsmrptsmallonemonlysthreevsharrvHthreezero}{0}
9258 +\newcommand{\pwunseedsmrptsmallonemonlysthreevsharrvHsixzero}{+1.16}
9259 +\newcommand{\tpwunseedsmrptsmallonemonlysthreevsharrvHsixzero}{14.4}
9260 +\newcommand{\ppwunseedsmrptsmallonemonlysthreevsharrvHsixzero}{0}
9261 +\newcommand{\pwunseedsmrptsmallonemonlysfourvsharrvHfive}{-1.94}
9262 +\newcommand{\tpwunseedsmrptsmallonemonlysfourvsharrvHfive}{-53.1}
9263 +\newcommand{\ppwunseedsmrptsmallonemonlysfourvsharrvHfive}{0}
9264 +\newcommand{\pwunseedsmrptsmallonemonlysfourvsharrvHonefive}{+0.37}
9265 +\newcommand{\tpwunseedsmrptsmallonemonlysfourvsharrvHonefive}{9.8}
9266 +\newcommand{\ppwunseedsmrptsmallonemonlysfourvsharrvHonefive}{0}
9267 +\newcommand{\pwunseedsmrptsmallonemonlysfourvsharrvHthreezero}{+0.61}
9268 +\newcommand{\tpwunseedsmrptsmallonemonlysfourvsharrvHthreezero}{10.7}
9269 +\newcommand{\ppwunseedsmrptsmallonemonlysfourvsharrvHthreezero}{0}
9270 +\newcommand{\pwunseedsmrptsmallonemonlysfourvsharrvHsixzero}{+0.83}
9271 +\newcommand{\tpwunseedsmrptsmallonemonlysfourvsharrvHsixzero}{11.7}
9272 +\newcommand{\ppwunseedsmrptsmallonemonlysfourvsharrvHsixzero}{0}
9273 +\newcommand{\pwunseedsmrptsmallonemonlysfivevsharrvHfive}{-1.86}
9274 +\newcommand{\tpwunseedsmrptsmallonemonlysfivevsharrvHfive}{-52.8}
9275 +\newcommand{\ppwunseedsmrptsmallonemonlysfivevsharrvHfive}{0}
9276 +\newcommand{\pwunseedsmrptsmallonemonlysfivevsharrvHonefive}{+0.45}
9277 +\newcommand{\tpwunseedsmrptsmallonemonlysfivevsharrvHonefive}{10.8}
9278 +\newcommand{\ppwunseedsmrptsmallonemonlysfivevsharrvHonefive}{0}
9279 +\newcommand{\pwunseedsmrptsmallonemonlysfivevsharrvHthreezero}{+0.70}
9280 +\newcommand{\tpwunseedsmrptsmallonemonlysfivevsharrvHthreezero}{11.4}
9281 +\newcommand{\ppwunseedsmrptsmallonemonlysfivevsharrvHthreezero}{0}
9282 +\newcommand{\pwunseedsmrptsmallonemonlysfivevsharrvHsixzero}{+0.92}
9283 +\newcommand{\tpwunseedsmrptsmallonemonlysfivevsharrvHsixzero}{12.0}
9284 +\newcommand{\ppwunseedsmrptsmallonemonlysfivevsharrvHsixzero}{0}
9285 +\newcommand{\pwunseedsmrptsmallstwovsmrptsmallonemonlystwoHfive}{-0.06}
9286 +\newcommand{\tpwunseedsmrptsmallstwovsmrptsmallonemonlystwoHfive}{-6.7}
9287 +\newcommand{\ppwunseedsmrptsmallstwovsmrptsmallonemonlystwoHfive}{6.05e-11}
9288 +\newcommand{\pwunseedsmrptsmallstwovsmrptsmallonemonlystwoHonefive}{-0.09}
9289 +\newcommand{\tpwunseedsmrptsmallstwovsmrptsmallonemonlystwoHonefive}{-8.2}
9290 +\newcommand{\ppwunseedsmrptsmallstwovsmrptsmallonemonlystwoHonefive}{2e-15}
9291 +\newcommand{\pwunseedsmrptsmallstwovsmrptsmallonemonlystwoHthreezero}{-0.14}
9292 +\newcommand{\tpwunseedsmrptsmallstwovsmrptsmallonemonlystwoHthreezero}{-9.4}
9293 +\newcommand{\ppwunseedsmrptsmallstwovsmrptsmallonemonlystwoHthreezero}{0}
9294 +\newcommand{\pwunseedsmrptsmallstwovsmrptsmallonemonlystwoHsixzero}{-0.22}
9295 +\newcommand{\tpwunseedsmrptsmallstwovsmrptsmallonemonlystwoHsixzero}{-9.4}
9296 +\newcommand{\ppwunseedsmrptsmallstwovsmrptsmallonemonlystwoHsixzero}{0}
9297 +\newcommand{\pwunseedsmrptsmallsthreevsmrptsmallonemonlysthreeHfive}{-0.18}
9298 +\newcommand{\tpwunseedsmrptsmallsthreevsmrptsmallonemonlysthreeHfive}{-17.0}
9299 +\newcommand{\ppwunseedsmrptsmallsthreevsmrptsmallonemonlysthreeHfive}{0}
9300 +\newcommand{\pwunseedsmrptsmallsthreevsmrptsmallonemonlysthreeHonefive}{-0.34}
9301 +\newcommand{\tpwunseedsmrptsmallsthreevsmrptsmallonemonlysthreeHonefive}{-23.2}
9302 +\newcommand{\ppwunseedsmrptsmallsthreevsmrptsmallonemonlysthreeHonefive}{0}
9303 +\newcommand{\pwunseedsmrptsmallsthreevsmrptsmallonemonlysthreeHthreezero}{-0.45}
9304 +\newcommand{\tpwunseedsmrptsmallsthreevsmrptsmallonemonlysthreeHthreezero}{-23.8}
9305 +\newcommand{\ppwunseedsmrptsmallsthreevsmrptsmallonemonlysthreeHthreezero}{0}
9306 +\newcommand{\pwunseedsmrptsmallsthreevsmrptsmallonemonlysthreeHsixzero}{-0.55}
9307 +\newcommand{\tpwunseedsmrptsmallsthreevsmrptsmallonemonlysthreeHsixzero}{-19.8}
9308 +\newcommand{\ppwunseedsmrptsmallsthreevsmrptsmallonemonlysthreeHsixzero}{0}
9309 +\newcommand{\pwunseedsmrptsmallsfourvsmrptsmallonemonlysfourHfive}{-0.07}
9310 +\newcommand{\tpwunseedsmrptsmallsfourvsmrptsmallonemonlysfourHfive}{-8.3}
9311 +\newcommand{\ppwunseedsmrptsmallsfourvsmrptsmallonemonlysfourHfive}{0}
9312 +\newcommand{\pwunseedsmrptsmallsfourvsmrptsmallonemonlysfourHonefive}{-0.10}
9313 +\newcommand{\tpwunseedsmrptsmallsfourvsmrptsmallonemonlysfourHonefive}{-9.4}
9314 +\newcommand{\ppwunseedsmrptsmallsfourvsmrptsmallonemonlysfourHonefive}{0}
9315 +\newcommand{\pwunseedsmrptsmallsfourvsmrptsmallonemonlysfourHthreezero}{-0.10}
9316 +\newcommand{\tpwunseedsmrptsmallsfourvsmrptsmallonemonlysfourHthreezero}{-7.5}
9317 +\newcommand{\ppwunseedsmrptsmallsfourvsmrptsmallonemonlysfourHthreezero}{5.84e-13}
9318 +\newcommand{\pwunseedsmrptsmallsfourvsmrptsmallonemonlysfourHsixzero}{-0.15}
9319 +\newcommand{\tpwunseedsmrptsmallsfourvsmrptsmallonemonlysfourHsixzero}{-7.8}
9320 +\newcommand{\ppwunseedsmrptsmallsfourvsmrptsmallonemonlysfourHsixzero}{4.97e-14}
9321 +\newcommand{\pwunseedsmrptsmallsfivevsmrptsmallonemonlysfiveHfive}{-0.09}
9322 +\newcommand{\tpwunseedsmrptsmallsfivevsmrptsmallonemonlysfiveHfive}{-8.9}
9323 +\newcommand{\ppwunseedsmrptsmallsfivevsmrptsmallonemonlysfiveHfive}{0}
9324 +\newcommand{\pwunseedsmrptsmallsfivevsmrptsmallonemonlysfiveHonefive}{-0.09}
9325 +\newcommand{\tpwunseedsmrptsmallsfivevsmrptsmallonemonlysfiveHonefive}{-6.8}
9326 +\newcommand{\ppwunseedsmrptsmallsfivevsmrptsmallonemonlysfiveHonefive}{3.54e-11}
9327 +\newcommand{\pwunseedsmrptsmallsfivevsmrptsmallonemonlysfiveHthreezero}{-0.09}
9328 +\newcommand{\tpwunseedsmrptsmallsfivevsmrptsmallonemonlysfiveHthreezero}{-5.1}
9329 +\newcommand{\ppwunseedsmrptsmallsfivevsmrptsmallonemonlysfiveHthreezero}{5.55e-07}
9330 +\newcommand{\pwunseedsmrptsmallsfivevsmrptsmallonemonlysfiveHsixzero}{-0.14}
9331 +\newcommand{\tpwunseedsmrptsmallsfivevsmrptsmallonemonlysfiveHsixzero}{-4.8}
9332 +\newcommand{\ppwunseedsmrptsmallsfivevsmrptsmallonemonlysfiveHsixzero}{1.58e-06}
8597 9333 \newcommand{\pairwiseConvention}{scaled CRPS}
modified paper/tables/compute.tex +15 −3
@@ -4,7 +4,7 @@
4 4 \begin{adjustbox}{max width=\textwidth}
5 5 \begin{tabular}{llllrrrr}
6 6 \toprule
7 −Experiment & Model & Node & Chip & Steps & Parameters & Wall-clock (s) & Examples/s \\
7 +Experiment & Model & Node (hostname) & Chip & Steps & Parameters & Wall-clock (s) & Examples/s \\
8 8 \midrule
9 9 main & MLP (1m) & m3u96b & Apple M3 Ultra & 12{,}000 & 301{,}827 & 839 & 916 \\
10 10 main & MRPT-B (1m+5m+30m) & m3u96b & Apple M3 Ultra & 12{,}000 & 20{,}718{,}339 & 4{,}580 & 168 \\
@@ -26,10 +26,22 @@ ablations & MRPT-S reference, seed 3 & m3u96b & Apple M3 Ultra & 4{,}000 & 3{,}4
26 26 ablations & MRPT-S shuffled minutes & m3u96b & Apple M3 Ultra & 4{,}000 & 3{,}455{,}619 & 853 & 300 \\
27 27 ablations & MRPT-S + ticker id & m3u96b & Apple M3 Ultra & 4{,}000 & 3{,}501{,}699 & 854 & 300 \\
28 28 ablations & MRPT-S time only & m3u96b & Apple M3 Ultra & 4{,}000 & 3{,}455{,}619 & 853 & 300 \\
29 +seeds & MRPT-S 1m only, seed 2 & M4M64c & Apple M4 Max & 12{,}000 & 3{,}200{,}259 & 932 & 824 \\
30 +seeds & MRPT-S 1m only, seed 3 & M4M64c & Apple M4 Max & 12{,}000 & 3{,}200{,}259 & 931 & 825 \\
31 +seeds & MRPT-S 1m only, seed 4 & M4M64c & Apple M4 Max & 12{,}000 & 3{,}200{,}259 & 938 & 819 \\
32 +seeds & MRPT-S 1m only, seed 5 & M4M64c & Apple M4 Max & 12{,}000 & 3{,}200{,}259 & 932 & 824 \\
33 +seeds & MRPT-S seed 2 & MacStudnpierre6 & Apple M4 Max & 12{,}000 & 3{,}455{,}619 & 2{,}062 & 372 \\
34 +seeds & MRPT-S seed 3 & MacStudnpierre6 & Apple M4 Max & 12{,}000 & 3{,}455{,}619 & 2{,}023 & 380 \\
35 +seeds & MRPT-S seed 4 & MacStudnpierre4 & Apple M4 Max & 12{,}000 & 3{,}455{,}619 & 2{,}034 & 378 \\
36 +seeds & MRPT-S seed 5 & MacStudnpierre4 & Apple M4 Max & 12{,}000 & 3{,}455{,}619 & 2{,}024 & 379 \\
37 +budget & MRPT-S 1m only, 24k steps & M5M36 & Apple M5 Max & 20{,}000 & 3{,}200{,}259 & 743 & 689 \\
38 +budget & MRPT-S 1m only, 36k steps & M5M36 & Apple M5 Max & 30{,}000 & 3{,}200{,}259 & 912 & 702 \\
39 +ablations\_h3 & MRPT-S shuffled price/volume columns & M5M36 & Apple M5 Max & 4{,}000 & 3{,}455{,}619 & 933 & 274 \\
40 +ablations\_h3 & MRPT-S time only, reduced global token & M5M36 & Apple M5 Max & 4{,}000 & 3{,}455{,}619 & 936 & 273 \\
29 41 \midrule
30 −Total & 20 runs & & & & & 21{,}565 (6.0 GPU-h) & \\
42 +Total & 32 runs & & & & & 36{,}966 (10.3 GPU-h; baseline study 6.0 GPU-h) & \\
31 43 \bottomrule
32 44 \end{tabular}
33 45 \end{adjustbox}
34 −\begin{minipage}{0.95\textwidth}\scriptsize \emph{Notes.} Wall-clock of the training loop from \texttt{train\_summary.json} of every run (including the periodic validation passes; the prediction passes over the evaluation origins are not included). The node and chip of the review runs come from \texttt{results/metrics/review\_runs.jsonl}; the baseline study ran on M3U96b (Apple M3 Ultra). Throughput is not comparable across chips; comparisons between models are at matched optimiser steps, never at matched wall-clock.\end{minipage}
46 +\begin{minipage}{0.95\textwidth}\scriptsize \emph{Notes.} Wall-clock of the training loop from \texttt{train\_summary.json} of every run (including the periodic validation passes; the prediction passes over the evaluation origins are not included). Node = hostname recorded by the run; the chip comes from \texttt{results/metrics/review\_runs*.jsonl} (ledger of the review runs) and from \texttt{benchmark\_M3U96b.json} for the baseline study. Continued runs (24k, 36k) report the steps of the continuation segment. Throughput is not comparable across chips; comparisons between models are at matched optimiser steps, never at matched wall-clock.\end{minipage}
35 47 \end{table}
\ No newline at end of file
added paper/tables/seeds_calibration.tex +22 −0
@@ -0,0 +1,22 @@
1 +\begin{table}[htbp]\centering\small
2 +\caption{Seed study (12,000 steps): empirical 50/80/95\% coverage and PIT KS statistic}
3 +\label{tab:seeds_calib}
4 +\begin{adjustbox}{max width=\textwidth}
5 +\begin{tabular}{lcccccccccccccccc}
6 +\toprule
7 +Model & \multicolumn{4}{c}{$H=5$} & \multicolumn{4}{c}{$H=15$} & \multicolumn{4}{c}{$H=30$} & \multicolumn{4}{c}{$H=60$} \\
8 + & 50 & 80 & 95 & KS & 50 & 80 & 95 & KS & 50 & 80 & 95 & KS & 50 & 80 & 95 & KS \\
9 +\midrule
10 +MRPT-S seed 2 & 0.54 & 0.83 & 0.95 & 0.027 & 0.56 & 0.84 & 0.96 & 0.033 & 0.57 & 0.84 & 0.96 & 0.039 & 0.58 & 0.85 & 0.96 & 0.045 \\
11 +MRPT-S seed 3 & 0.54 & 0.82 & 0.95 & 0.025 & 0.56 & 0.84 & 0.96 & 0.030 & 0.56 & 0.84 & 0.96 & 0.033 & 0.57 & 0.85 & 0.96 & 0.036 \\
12 +MRPT-S seed 4 & 0.54 & 0.82 & 0.95 & 0.022 & 0.55 & 0.83 & 0.96 & 0.027 & 0.56 & 0.84 & 0.96 & 0.032 & 0.57 & 0.85 & 0.96 & 0.036 \\
13 +MRPT-S seed 5 & 0.54 & 0.83 & 0.96 & 0.026 & 0.56 & 0.84 & 0.96 & 0.032 & 0.57 & 0.85 & 0.96 & 0.038 & 0.58 & 0.85 & 0.96 & 0.042 \\
14 +MRPT-S 1m only, seed 2 & 0.54 & 0.83 & 0.96 & 0.028 & 0.56 & 0.84 & 0.96 & 0.035 & 0.57 & 0.85 & 0.96 & 0.042 & 0.58 & 0.86 & 0.96 & 0.049 \\
15 +MRPT-S 1m only, seed 3 & 0.55 & 0.83 & 0.96 & 0.030 & 0.57 & 0.85 & 0.96 & 0.036 & 0.58 & 0.85 & 0.96 & 0.040 & 0.59 & 0.86 & 0.96 & 0.044 \\
16 +MRPT-S 1m only, seed 4 & 0.54 & 0.82 & 0.95 & 0.025 & 0.56 & 0.84 & 0.96 & 0.031 & 0.57 & 0.85 & 0.96 & 0.035 & 0.58 & 0.85 & 0.96 & 0.040 \\
17 +MRPT-S 1m only, seed 5 & 0.55 & 0.83 & 0.96 & 0.029 & 0.57 & 0.84 & 0.96 & 0.034 & 0.58 & 0.85 & 0.96 & 0.039 & 0.58 & 0.86 & 0.96 & 0.044 \\
18 +\bottomrule
19 +\end{tabular}
20 +\end{adjustbox}
21 +\begin{minipage}{0.95\textwidth}\scriptsize \emph{Notes.} development test 2024, \num{986468} evaluation origins over 251 sessions. Empirical coverage of the central 50/80/95\,\% prediction intervals of the cumulative return (nominal 0.50/0.80/0.95) and the Kolmogorov--Smirnov distance of the PIT values from uniformity; no scaling is involved.\end{minipage}
22 +\end{table}
\ No newline at end of file
added paper/tables/seeds_crps_scaled.tex +21 −0
@@ -0,0 +1,21 @@
1 +\begin{table}[htbp]\centering\small
2 +\caption{Seed study (12,000 steps): mean scaled CRPS of the cumulative-return forecast by horizon (minutes)}
3 +\label{tab:seeds_crps_scaled}
4 +\begin{adjustbox}{max width=\textwidth}
5 +\begin{tabular}{lrcccc}
6 +\toprule
7 +Model & Parameters & $H=5$ & $H=15$ & $H=30$ & $H=60$ \\
8 +\midrule
9 +MRPT-S seed 2 & 3{,}455{,}619 & 0.4529 {\scriptsize[0.4474, 0.4588]} & 0.4413 {\scriptsize[0.4349, 0.4478]} & 0.4312 {\scriptsize[0.4249, 0.4381]} & 0.4189 {\scriptsize[0.4108, 0.4286]} \\
10 +MRPT-S seed 3 & 3{,}455{,}619 & 0.4528 {\scriptsize[0.4473, 0.4588]} & 0.4411 {\scriptsize[0.4347, 0.4476]} & 0.4309 {\scriptsize[0.4246, 0.4378]} & 0.4187 {\scriptsize[0.4105, 0.4284]} \\
11 +MRPT-S seed 4 & 3{,}455{,}619 & 0.4526 {\scriptsize[0.4471, 0.4585]} & 0.4409 {\scriptsize[0.4346, 0.4475]} & 0.4309 {\scriptsize[0.4245, 0.4378]} & 0.4186 {\scriptsize[0.4105, 0.4283]} \\
12 +MRPT-S seed 5 & 3{,}455{,}619 & 0.4529 {\scriptsize[0.4474, 0.4588]} & 0.4414 {\scriptsize[0.4351, 0.4478]} & 0.4314 {\scriptsize[0.4251, 0.4383]} & 0.4191 {\scriptsize[0.4111, 0.4286]} \\
13 +MRPT-S 1m only, seed 2 & 3{,}200{,}259 & 0.4532 {\scriptsize[0.4477, 0.4590]} & 0.4416 {\scriptsize[0.4353, 0.4482]} & 0.4318 {\scriptsize[0.4255, 0.4387]} & 0.4199 {\scriptsize[0.4117, 0.4296]} \\
14 +MRPT-S 1m only, seed 3 & 3{,}200{,}259 & 0.4535 {\scriptsize[0.4481, 0.4594]} & 0.4422 {\scriptsize[0.4359, 0.4487]} & 0.4324 {\scriptsize[0.4261, 0.4392]} & 0.4204 {\scriptsize[0.4123, 0.4300]} \\
15 +MRPT-S 1m only, seed 4 & 3{,}200{,}259 & 0.4529 {\scriptsize[0.4474, 0.4588]} & 0.4414 {\scriptsize[0.4351, 0.4479]} & 0.4314 {\scriptsize[0.4251, 0.4382]} & 0.4193 {\scriptsize[0.4112, 0.4290]} \\
16 +MRPT-S 1m only, seed 5 & 3{,}200{,}259 & 0.4533 {\scriptsize[0.4479, 0.4592]} & 0.4418 {\scriptsize[0.4355, 0.4482]} & 0.4318 {\scriptsize[0.4255, 0.4386]} & 0.4197 {\scriptsize[0.4116, 0.4293]} \\
17 +\bottomrule
18 +\end{tabular}
19 +\end{adjustbox}
20 +\begin{minipage}{0.95\textwidth}\scriptsize \emph{Notes.} development test 2024, \num{986468} evaluation origins over 251 sessions. Brackets: 95\,\% trading-day cluster-bootstrap intervals (all instruments and origins of one session form one cluster). Convention: scaled CRPS, i.e.\ CRPS divided by $\sigma_t\sqrt{H}$. Parameters: trainable parameters of the trained models (\texttt{train\_summary.json}); baselines have none in this sense.\end{minipage}
21 +\end{table}
\ No newline at end of file
added paper/tables/seeds_qlike.tex +21 −0
@@ -0,0 +1,21 @@
1 +\begin{table}[htbp]\centering\small
2 +\caption{Seed study (12,000 steps): mean QLIKE of the realised-variance forecast by horizon (minutes)}
3 +\label{tab:seeds_qlike}
4 +\begin{adjustbox}{max width=\textwidth}
5 +\begin{tabular}{lcccc}
6 +\toprule
7 +Model & $H=5$ & $H=15$ & $H=30$ & $H=60$ \\
8 +\midrule
9 +MRPT-S seed 2 & -12.476 {\scriptsize[-12.507, -12.439]} & -11.407 {\scriptsize[-11.443, -11.365]} & -10.735 {\scriptsize[-10.773, -10.692]} & -10.077 {\scriptsize[-10.116, -10.032]} \\
10 +MRPT-S seed 3 & -12.474 {\scriptsize[-12.506, -12.437]} & -11.405 {\scriptsize[-11.442, -11.362]} & -10.733 {\scriptsize[-10.772, -10.689]} & -10.076 {\scriptsize[-10.116, -10.028]} \\
11 +MRPT-S seed 4 & -12.472 {\scriptsize[-12.504, -12.435]} & -11.404 {\scriptsize[-11.441, -11.360]} & -10.732 {\scriptsize[-10.771, -10.688]} & -10.075 {\scriptsize[-10.114, -10.028]} \\
12 +MRPT-S seed 5 & -12.474 {\scriptsize[-12.505, -12.437]} & -11.406 {\scriptsize[-11.441, -11.365]} & -10.734 {\scriptsize[-10.771, -10.693]} & -10.077 {\scriptsize[-10.114, -10.034]} \\
13 +MRPT-S 1m only, seed 2 & -12.470 {\scriptsize[-12.502, -12.433]} & -11.401 {\scriptsize[-11.438, -11.358]} & -10.728 {\scriptsize[-10.767, -10.684]} & -10.069 {\scriptsize[-10.108, -10.021]} \\
14 +MRPT-S 1m only, seed 3 & -12.470 {\scriptsize[-12.502, -12.433]} & -11.398 {\scriptsize[-11.435, -11.357]} & -10.725 {\scriptsize[-10.763, -10.681]} & -10.065 {\scriptsize[-10.104, -10.017]} \\
15 +MRPT-S 1m only, seed 4 & -12.471 {\scriptsize[-12.502, -12.434]} & -11.401 {\scriptsize[-11.439, -11.358]} & -10.728 {\scriptsize[-10.768, -10.683]} & -10.070 {\scriptsize[-10.109, -10.020]} \\
16 +MRPT-S 1m only, seed 5 & -12.471 {\scriptsize[-12.503, -12.435]} & -11.402 {\scriptsize[-11.438, -11.359]} & -10.729 {\scriptsize[-10.768, -10.685]} & -10.071 {\scriptsize[-10.109, -10.023]} \\
17 +\bottomrule
18 +\end{tabular}
19 +\end{adjustbox}
20 +\begin{minipage}{0.95\textwidth}\scriptsize \emph{Notes.} development test 2024, \num{986468} evaluation origins over 251 sessions. Brackets: 95\,\% trading-day cluster-bootstrap intervals (all instruments and origins of one session form one cluster). Convention: QLIKE of the realised variance, $\log v + \mathrm{RV}/v$ without the data-only constant (levels can be negative). The LightGBM $H=5$ QLIKE is dominated by a few near-zero variance forecasts (floored at $10^{-14}$ in \texttt{eval/scores.py}); the floor share is tabulated once \texttt{recal/lightgbm\_floor.csv} is in.\end{minipage}
21 +\end{table}
\ No newline at end of file
added paper/tables/seeds_wis.tex +21 −0
@@ -0,0 +1,21 @@
1 +\begin{table}[htbp]\centering\small
2 +\caption{Seed study (12,000 steps): mean WIS ($\times 10^{4}$) of the cumulative-return forecast by horizon (minutes)}
3 +\label{tab:seeds_wis}
4 +\begin{adjustbox}{max width=\textwidth}
5 +\begin{tabular}{lcccc}
6 +\toprule
7 +Model & $H=5$ & $H=15$ & $H=30$ & $H=60$ \\
8 +\midrule
9 +MRPT-S seed 2 & 7.138 {\scriptsize[7.004, 7.280]} & 12.024 {\scriptsize[11.782, 12.283]} & 16.594 {\scriptsize[16.225, 16.974]} & 22.749 {\scriptsize[22.182, 23.373]} \\
10 +MRPT-S seed 3 & 7.136 {\scriptsize[7.001, 7.277]} & 12.012 {\scriptsize[11.770, 12.272]} & 16.571 {\scriptsize[16.201, 16.953]} & 22.708 {\scriptsize[22.137, 23.326]} \\
11 +MRPT-S seed 4 & 7.134 {\scriptsize[6.999, 7.276]} & 12.016 {\scriptsize[11.773, 12.276]} & 16.582 {\scriptsize[16.209, 16.963]} & 22.728 {\scriptsize[22.158, 23.344]} \\
12 +MRPT-S seed 5 & 7.138 {\scriptsize[7.004, 7.279]} & 12.025 {\scriptsize[11.784, 12.283]} & 16.597 {\scriptsize[16.229, 16.976]} & 22.748 {\scriptsize[22.185, 23.362]} \\
13 +MRPT-S 1m only, seed 2 & 7.144 {\scriptsize[7.009, 7.286]} & 12.037 {\scriptsize[11.795, 12.297]} & 16.620 {\scriptsize[16.250, 17.001]} & 22.804 {\scriptsize[22.237, 23.421]} \\
14 +MRPT-S 1m only, seed 3 & 7.150 {\scriptsize[7.016, 7.292]} & 12.056 {\scriptsize[11.816, 12.314]} & 16.651 {\scriptsize[16.285, 17.029]} & 22.841 {\scriptsize[22.276, 23.451]} \\
15 +MRPT-S 1m only, seed 4 & 7.139 {\scriptsize[7.005, 7.281]} & 12.028 {\scriptsize[11.786, 12.287]} & 16.600 {\scriptsize[16.231, 16.981]} & 22.764 {\scriptsize[22.194, 23.383]} \\
16 +MRPT-S 1m only, seed 5 & 7.145 {\scriptsize[7.010, 7.287]} & 12.037 {\scriptsize[11.796, 12.296]} & 16.613 {\scriptsize[16.245, 16.992]} & 22.782 {\scriptsize[22.213, 23.397]} \\
17 +\bottomrule
18 +\end{tabular}
19 +\end{adjustbox}
20 +\begin{minipage}{0.95\textwidth}\scriptsize \emph{Notes.} development test 2024, \num{986468} evaluation origins over 251 sessions. Brackets: 95\,\% trading-day cluster-bootstrap intervals (all instruments and origins of one session form one cluster). Convention: weighted interval score of the cumulative return (unscaled). Values are multiplied by $10^{4}$ (raw WIS of order $10^{-3}$).\end{minipage}
21 +\end{table}
\ No newline at end of file
modified results/inline_numbers.json +1444 −0
@@ -5007,5 +5007,1449 @@
5007 5007 "max": 2.4291650213479232,
5008 5008 "n": 44
5009 5009 }
5010 + },
5011 + "seeds": {
5012 + "source": "seeds/leaderboard_test.csv + seeds/pairwise_test.csv (+ main for seed 1); the official seed-aware contrast is seeds/seed_contrast.csv (P3, scripts/seed_contrast.py) when present",
5013 + "bands": {
5014 + "mrpt_small": {
5015 + "crps_scaled": {
5016 + "H5": {
5017 + "n_seeds": 5,
5018 + "seeds": [
5019 + 1,
5020 + 2,
5021 + 3,
5022 + 4,
5023 + 5
5024 + ],
5025 + "mean": 0.4528644065860442,
5026 + "min": 0.4525906855208318,
5027 + "max": 0.4530927717510459,
5028 + "sd": 0.00018030556584870908,
5029 + "half_band_pct": 0.0554,
5030 + "per_seed": {
5031 + "1": 0.453093,
5032 + "2": 0.452878,
5033 + "3": 0.452847,
5034 + "4": 0.452591,
5035 + "5": 0.452914
5036 + }
5037 + },
5038 + "H15": {
5039 + "n_seeds": 5,
5040 + "seeds": [
5041 + 1,
5042 + 2,
5043 + 3,
5044 + 4,
5045 + 5
5046 + ],
5047 + "mean": 0.4411968674676883,
5048 + "min": 0.4409256083869134,
5049 + "max": 0.4413848444583868,
5050 + "sd": 0.00019683175063063527,
5051 + "half_band_pct": 0.052,
5052 + "per_seed": {
5053 + "1": 0.441355,
5054 + "2": 0.441254,
5055 + "3": 0.441064,
5056 + "4": 0.440926,
5057 + "5": 0.441385
5058 + }
5059 + },
5060 + "H30": {
5061 + "n_seeds": 5,
5062 + "seeds": [
5063 + 1,
5064 + 2,
5065 + 3,
5066 + 4,
5067 + 5
5068 + ],
5069 + "mean": 0.43109245857907935,
5070 + "min": 0.4308529213326499,
5071 + "max": 0.4313586073821507,
5072 + "sd": 0.00020562370642904522,
5073 + "half_band_pct": 0.0587,
5074 + "per_seed": {
5075 + "1": 0.43113,
5076 + "2": 0.431197,
5077 + "3": 0.430924,
5078 + "4": 0.430853,
5079 + "5": 0.431359
5080 + }
5081 + },
5082 + "H60": {
5083 + "n_seeds": 5,
5084 + "seeds": [
5085 + 1,
5086 + 2,
5087 + 3,
5088 + 4,
5089 + 5
5090 + ],
5091 + "mean": 0.41880969079755237,
5092 + "min": 0.4186140611836507,
5093 + "max": 0.419136401387894,
5094 + "sd": 0.00022370977482268005,
5095 + "half_band_pct": 0.0624,
5096 + "per_seed": {
5097 + "1": 0.418702,
5098 + "2": 0.418945,
5099 + "3": 0.418651,
5100 + "4": 0.418614,
5101 + "5": 0.419136
5102 + }
5103 + }
5104 + },
5105 + "crps": {
5106 + "H5": {
5107 + "n_seeds": 5,
5108 + "seeds": [
5109 + 1,
5110 + 2,
5111 + 3,
5112 + 4,
5113 + 5
5114 + ],
5115 + "mean": 0.0007928722421588999,
5116 + "min": 0.0007924569044415,
5117 + "max": 0.0007932827856504,
5118 + "sd": 3.1839466625418063e-07,
5119 + "half_band_pct": 0.0521,
5120 + "per_seed": {
5121 + "1": 0.000793283,
5122 + "2": 0.000793014,
5123 + "3": 0.000792672,
5124 + "4": 0.000792457,
5125 + "5": 0.000792936
5126 + }
5127 + },
5128 + "H15": {
5129 + "n_seeds": 5,
5130 + "seeds": [
5131 + 1,
5132 + 2,
5133 + 3,
5134 + 4,
5135 + 5
5136 + ],
5137 + "mean": 0.00133544601055832,
5138 + "min": 0.0013346003427833,
5139 + "max": 0.0013360015052376,
5140 + "sd": 6.549985457174202e-07,
5141 + "half_band_pct": 0.0525,
5142 + "per_seed": {
5143 + "1": 0.001335804,
5144 + "2": 0.001335942,
5145 + "3": 0.0013346,
5146 + "4": 0.001334882,
5147 + "5": 0.001336002
5148 + }
5149 + },
5150 + "H30": {
5151 + "n_seeds": 5,
5152 + "seeds": [
5153 + 1,
5154 + 2,
5155 + 3,
5156 + 4,
5157 + 5
5158 + ],
5159 + "mean": 0.0018424816919472003,
5160 + "min": 0.0018409302088207,
5161 + "max": 0.0018436906382275,
5162 + "sd": 1.1202954575279269e-06,
5163 + "half_band_pct": 0.0749,
5164 + "per_seed": {
5165 + "1": 0.001842371,
5166 + "2": 0.001843428,
5167 + "3": 0.00184093,
5168 + "4": 0.001841989,
5169 + "5": 0.001843691
5170 + }
5171 + },
5172 + "H60": {
5173 + "n_seeds": 5,
5174 + "seeds": [
5175 + 1,
5176 + 2,
5177 + 3,
5178 + 4,
5179 + 5
5180 + ],
5181 + "mean": 0.0025247705133933603,
5182 + "min": 0.0025222933585249,
5183 + "max": 0.0025268840236714,
5184 + "sd": 2.006148932745872e-06,
5185 + "half_band_pct": 0.0909,
5186 + "per_seed": {
5187 + "1": 0.002523578,
5188 + "2": 0.002526884,
5189 + "3": 0.002522293,
5190 + "4": 0.002524352,
5191 + "5": 0.002526745
5192 + }
5193 + }
5194 + }
5195 + },
5196 + "mrpt_small_1m_only": {
5197 + "crps_scaled": {
5198 + "H5": {
5199 + "n_seeds": 5,
5200 + "seeds": [
5201 + 1,
5202 + 2,
5203 + 3,
5204 + 4,
5205 + 5
5206 + ],
5207 + "mean": 0.4532328683252903,
5208 + "min": 0.4529135455999097,
5209 + "max": 0.4535089673923718,
5210 + "sd": 0.0002183624553798893,
5211 + "half_band_pct": 0.0657,
5212 + "per_seed": {
5213 + "1": 0.453271,
5214 + "2": 0.453161,
5215 + "3": 0.453509,
5216 + "4": 0.452914,
5217 + "5": 0.453309
5218 + }
5219 + },
5220 + "H15": {
5221 + "n_seeds": 5,
5222 + "seeds": [
5223 + 1,
5224 + 2,
5225 + 3,
5226 + 4,
5227 + 5
5228 + ],
5229 + "mean": 0.44171549157229545,
5230 + "min": 0.4413954619038545,
5231 + "max": 0.4422136108105083,
5232 + "sd": 0.00030798755630764255,
5233 + "half_band_pct": 0.0926,
5234 + "per_seed": {
5235 + "1": 0.441564,
5236 + "2": 0.44165,
5237 + "3": 0.442214,
5238 + "4": 0.441395,
5239 + "5": 0.441755
5240 + }
5241 + },
5242 + "H30": {
5243 + "n_seeds": 5,
5244 + "seeds": [
5245 + 1,
5246 + 2,
5247 + 3,
5248 + 4,
5249 + 5
5250 + ],
5251 + "mean": 0.43174969771644306,
5252 + "min": 0.4313836106983059,
5253 + "max": 0.4323763802278078,
5254 + "sd": 0.0004011123302340566,
5255 + "half_band_pct": 0.115,
5256 + "per_seed": {
5257 + "1": 0.431412,
5258 + "2": 0.431791,
5259 + "3": 0.432376,
5260 + "4": 0.431384,
5261 + "5": 0.431785
5262 + }
5263 + },
5264 + "H60": {
5265 + "n_seeds": 5,
5266 + "seeds": [
5267 + 1,
5268 + 2,
5269 + 3,
5270 + 4,
5271 + 5
5272 + ],
5273 + "mean": 0.419706532129917,
5274 + "min": 0.4192359583603176,
5275 + "max": 0.4203856012141207,
5276 + "sd": 0.0004674081043564891,
5277 + "half_band_pct": 0.137,
5278 + "per_seed": {
5279 + "1": 0.419236,
5280 + "2": 0.419894,
5281 + "3": 0.420386,
5282 + "4": 0.419311,
5283 + "5": 0.419706
5284 + }
5285 + }
5286 + },
5287 + "crps": {
5288 + "H5": {
5289 + "n_seeds": 5,
5290 + "seeds": [
5291 + 1,
5292 + 2,
5293 + 3,
5294 + 4,
5295 + 5
5296 + ],
5297 + "mean": 0.0007935735646851201,
5298 + "min": 0.0007930158796125,
5299 + "max": 0.0007941202725412,
5300 + "sd": 3.949801698705461e-07,
5301 + "half_band_pct": 0.0696,
5302 + "per_seed": {
5303 + "1": 0.000793592,
5304 + "2": 0.000793487,
5305 + "3": 0.00079412,
5306 + "4": 0.000793016,
5307 + "5": 0.000793653
5308 + }
5309 + },
5310 + "H15": {
5311 + "n_seeds": 5,
5312 + "seeds": [
5313 + 1,
5314 + 2,
5315 + 3,
5316 + 4,
5317 + 5
5318 + ],
5319 + "mean": 0.00133721261034096,
5320 + "min": 0.0013361959272533,
5321 + "max": 0.0013391706399136,
5322 + "sd": 1.1938596733570463e-06,
5323 + "half_band_pct": 0.1112,
5324 + "per_seed": {
5325 + "1": 0.001336302,
5326 + "2": 0.001337157,
5327 + "3": 0.001339171,
5328 + "4": 0.001336196,
5329 + "5": 0.001337238
5330 + }
5331 + },
5332 + "H30": {
5333 + "n_seeds": 5,
5334 + "seeds": [
5335 + 1,
5336 + 2,
5337 + 3,
5338 + 4,
5339 + 5
5340 + ],
5341 + "mean": 0.0018455833217680198,
5342 + "min": 0.0018432955350954,
5343 + "max": 0.0018492385947557,
5344 + "sd": 2.324006383203628e-06,
5345 + "half_band_pct": 0.161,
5346 + "per_seed": {
5347 + "1": 0.001843296,
5348 + "2": 0.001846027,
5349 + "3": 0.001849239,
5350 + "4": 0.001843912,
5351 + "5": 0.001845443
5352 + }
5353 + },
5354 + "H60": {
5355 + "n_seeds": 5,
5356 + "seeds": [
5357 + 1,
5358 + 2,
5359 + 3,
5360 + 4,
5361 + 5
5362 + ],
5363 + "mean": 0.00253062402804298,
5364 + "min": 0.0025261483103202,
5365 + "max": 0.002536183235187,
5366 + "sd": 3.889679349503912e-06,
5367 + "half_band_pct": 0.1983,
5368 + "per_seed": {
5369 + "1": 0.002526148,
5370 + "2": 0.002532415,
5371 + "3": 0.002536183,
5372 + "4": 0.002528128,
5373 + "5": 0.002530245
5374 + }
5375 + }
5376 + }
5377 + }
5378 + },
5379 + "H1_per_seed": {
5380 + "crps": {
5381 + "H5": {
5382 + "per_seed": {
5383 + "1": {
5384 + "rel_pct": -0.0389,
5385 + "t_cl": -4.4
5386 + },
5387 + "2": {
5388 + "rel_pct": -0.0596,
5389 + "t_cl": -6.7
5390 + },
5391 + "3": {
5392 + "rel_pct": -0.1824,
5393 + "t_cl": -16.98
5394 + },
5395 + "4": {
5396 + "rel_pct": -0.0705,
5397 + "t_cl": -8.3
5398 + },
5399 + "5": {
5400 + "rel_pct": -0.0903,
5401 + "t_cl": -8.91
5402 + }
5403 + },
5404 + "n_seeds": 5,
5405 + "mean_pct": -0.08834,
5406 + "sd_pct": 0.05576668360230865,
5407 + "min_pct": -0.1824,
5408 + "max_pct": -0.0389,
5409 + "t_seed": -3.5421551430423204,
5410 + "n_negative": 5
5411 + },
5412 + "H15": {
5413 + "per_seed": {
5414 + "1": {
5415 + "rel_pct": -0.0373,
5416 + "t_cl": -3.67
5417 + },
5418 + "2": {
5419 + "rel_pct": -0.0908,
5420 + "t_cl": -8.17
5421 + },
5422 + "3": {
5423 + "rel_pct": -0.3413,
5424 + "t_cl": -23.2
5425 + },
5426 + "4": {
5427 + "rel_pct": -0.0983,
5428 + "t_cl": -9.36
5429 + },
5430 + "5": {
5431 + "rel_pct": -0.0925,
5432 + "t_cl": -6.82
5433 + }
5434 + },
5435 + "n_seeds": 5,
5436 + "mean_pct": -0.13204,
5437 + "sd_pct": 0.1195491028824558,
5438 + "min_pct": -0.3413,
5439 + "max_pct": -0.0373,
5440 + "t_seed": -2.469699969554528,
5441 + "n_negative": 5
5442 + },
5443 + "H30": {
5444 + "per_seed": {
5445 + "1": {
5446 + "rel_pct": -0.0502,
5447 + "t_cl": -3.39
5448 + },
5449 + "2": {
5450 + "rel_pct": -0.1408,
5451 + "t_cl": -9.41
5452 + },
5453 + "3": {
5454 + "rel_pct": -0.4493,
5455 + "t_cl": -23.8
5456 + },
5457 + "4": {
5458 + "rel_pct": -0.1043,
5459 + "t_cl": -7.46
5460 + },
5461 + "5": {
5462 + "rel_pct": -0.095,
5463 + "t_cl": -5.14
5464 + }
5465 + },
5466 + "n_seeds": 5,
5467 + "mean_pct": -0.16791999999999999,
5468 + "sd_pct": 0.16057165690121028,
5469 + "min_pct": -0.4493,
5470 + "max_pct": -0.0502,
5471 + "t_seed": -2.3383985818417155,
5472 + "n_negative": 5
5473 + },
5474 + "H60": {
5475 + "per_seed": {
5476 + "1": {
5477 + "rel_pct": -0.1017,
5478 + "t_cl": -4.12
5479 + },
5480 + "2": {
5481 + "rel_pct": -0.2184,
5482 + "t_cl": -9.4
5483 + },
5484 + "3": {
5485 + "rel_pct": -0.5477,
5486 + "t_cl": -19.77
5487 + },
5488 + "4": {
5489 + "rel_pct": -0.1493,
5490 + "t_cl": -7.8
5491 + },
5492 + "5": {
5493 + "rel_pct": -0.1383,
5494 + "t_cl": -4.8
5495 + }
5496 + },
5497 + "n_seeds": 5,
5498 + "mean_pct": -0.23108,
5499 + "sd_pct": 0.18196448005036586,
5500 + "min_pct": -0.5477,
5501 + "max_pct": -0.1017,
5502 + "t_seed": -2.839623359996585,
5503 + "n_negative": 5
5504 + }
5505 + },
5506 + "crps_scaled": {
5507 + "H5": {
5508 + "per_seed": {
5509 + "1": {
5510 + "rel_pct": -0.0394,
5511 + "t_cl": -5.06
5512 + },
5513 + "2": {
5514 + "rel_pct": -0.0625,
5515 + "t_cl": -7.95
5516 + },
5517 + "3": {
5518 + "rel_pct": -0.1461,
5519 + "t_cl": -15.69
5520 + },
5521 + "4": {
5522 + "rel_pct": -0.0713,
5523 + "t_cl": -10.11
5524 + },
5525 + "5": {
5526 + "rel_pct": -0.0872,
5527 + "t_cl": -9.38
5528 + }
5529 + },
5530 + "n_seeds": 5,
5531 + "mean_pct": -0.08130000000000001,
5532 + "sd_pct": 0.04013383859039651,
5533 + "min_pct": -0.1461,
5534 + "max_pct": -0.0394,
5535 + "t_seed": -4.52965210794049,
5536 + "n_negative": 5
5537 + },
5538 + "H15": {
5539 + "per_seed": {
5540 + "1": {
5541 + "rel_pct": -0.0472,
5542 + "t_cl": -5.1
5543 + },
5544 + "2": {
5545 + "rel_pct": -0.0895,
5546 + "t_cl": -9.18
5547 + },
5548 + "3": {
5549 + "rel_pct": -0.2599,
5550 + "t_cl": -20.62
5551 + },
5552 + "4": {
5553 + "rel_pct": -0.1064,
5554 + "t_cl": -11.96
5555 + },
5556 + "5": {
5557 + "rel_pct": -0.0838,
5558 + "t_cl": -6.65
5559 + }
5560 + },
5561 + "n_seeds": 5,
5562 + "mean_pct": -0.11735999999999999,
5563 + "sd_pct": 0.08255702877405412,
5564 + "min_pct": -0.2599,
5565 + "max_pct": -0.0472,
5566 + "t_seed": -3.178711028440619,
5567 + "n_negative": 5
5568 + },
5569 + "H30": {
5570 + "per_seed": {
5571 + "1": {
5572 + "rel_pct": -0.0654,
5573 + "t_cl": -4.78
5574 + },
5575 + "2": {
5576 + "rel_pct": -0.1375,
5577 + "t_cl": -10.49
5578 + },
5579 + "3": {
5580 + "rel_pct": -0.336,
5581 + "t_cl": -19.92
5582 + },
5583 + "4": {
5584 + "rel_pct": -0.123,
5585 + "t_cl": -10.99
5586 + },
5587 + "5": {
5588 + "rel_pct": -0.0988,
5589 + "t_cl": -5.6
5590 + }
5591 + },
5592 + "n_seeds": 5,
5593 + "mean_pct": -0.15214,
5594 + "sd_pct": 0.10634490114716362,
5595 + "min_pct": -0.336,
5596 + "max_pct": -0.0654,
5597 + "t_seed": -3.1989816006885397,
5598 + "n_negative": 5
5599 + },
5600 + "H60": {
5601 + "per_seed": {
5602 + "1": {
5603 + "rel_pct": -0.1274,
5604 + "t_cl": -5.09
5605 + },
5606 + "2": {
5607 + "rel_pct": -0.226,
5608 + "t_cl": -10.75
5609 + },
5610 + "3": {
5611 + "rel_pct": -0.4126,
5612 + "t_cl": -17.04
5613 + },
5614 + "4": {
5615 + "rel_pct": -0.1663,
5616 + "t_cl": -9.48
5617 + },
5618 + "5": {
5619 + "rel_pct": -0.1356,
5620 + "t_cl": -4.61
5621 + }
5622 + },
5623 + "n_seeds": 5,
5624 + "mean_pct": -0.21358000000000002,
5625 + "sd_pct": 0.1177990746992522,
5626 + "min_pct": -0.4126,
5627 + "max_pct": -0.1274,
5628 + "t_seed": -4.054186332564095,
5629 + "n_negative": 5
5630 + }
5631 + }
5632 + },
5633 + "detectability_rule": "|t_seed| > 2.78 (t, 4 df) and |t_cl| > 1.96 on the seed-averaged differential (plan section 3)",
5634 + "seed_contrast": [
5635 + {
5636 + "tag": "test",
5637 + "metric": "crps",
5638 + "H": 5,
5639 + "n_seeds": 5,
5640 + "seeds": "1;2;3;4;5",
5641 + "d_mean": -7.013225262368692e-07,
5642 + "d_sd": 4.430976156607665e-07,
5643 + "d_se": 1.9815927785710985e-07,
5644 + "t_seed": -3.539185920644019,
5645 + "p_seed": 0.0240310090547109,
5646 + "df": 4,
5647 + "d_min": -1.4487549389440805e-06,
5648 + "d_max": -3.088222688064721e-07,
5649 + "rel_mean_pct": -0.0883752379673948,
5650 + "rel_min_pct": -0.1825608870324217,
5651 + "rel_max_pct": -0.0389153926679732,
5652 + "t_cl_seedavg": -13.453565494423088,
5653 + "p_cl_seedavg": 0.0,
5654 + "se_cl_seedavg": 5.212911971384752e-08,
5655 + "lo_cl": -7.955577384490978e-07,
5656 + "hi_cl": -5.987141381096425e-07,
5657 + "detectable": true,
5658 + "rule": "|t_seed| > 2.78 (t, 4 df) and |t_cl| > 1.96",
5659 + "per_seed": "1:-3.08822e-07;2:-4.73023e-07;3:-1.44875e-06;4:-5.58975e-07;5:-7.17037e-07"
5660 + },
5661 + {
5662 + "tag": "test",
5663 + "metric": "crps",
5664 + "H": 15,
5665 + "n_seeds": 5,
5666 + "seeds": "1;2;3;4;5",
5667 + "d_mean": -1.766599782659686e-06,
5668 + "d_sd": 1.6016543154795162e-06,
5669 + "d_se": 7.162815851736183e-07,
5670 + "t_seed": -2.466348178183979,
5671 + "p_seed": 0.0692176439179691,
5672 + "df": 4,
5673 + "d_min": -4.570297130361281e-06,
5674 + "d_max": -4.978861146850422e-07,
5675 + "rel_mean_pct": -0.1321106134505532,
5676 + "rel_min_pct": -0.34177789642559,
5677 + "rel_max_pct": -0.0372331303814183,
5678 + "t_cl_seedavg": -14.352270470740848,
5679 + "p_cl_seedavg": 0.0,
5680 + "se_cl_seedavg": 1.230885236075471e-07,
5681 + "lo_cl": -1.992515916911006e-06,
5682 + "hi_cl": -1.508894321555138e-06,
5683 + "detectable": false,
5684 + "rule": "|t_seed| > 2.78 (t, 4 df) and |t_cl| > 1.96",
5685 + "per_seed": "1:-4.97886e-07;2:-1.21459e-06;3:-4.5703e-06;4:-1.31384e-06;5:-1.23639e-06"
5686 + },
5687 + {
5688 + "tag": "test",
5689 + "metric": "crps",
5690 + "H": 30,
5691 + "n_seeds": 5,
5692 + "seeds": "1;2;3;4;5",
5693 + "d_mean": -3.101629820794977e-06,
5694 + "d_sd": 2.9710708006218443e-06,
5695 + "d_se": 1.3287032552310337e-06,
5696 + "t_seed": -2.3343284579036188,
5697 + "p_seed": 0.0798725740983773,
5698 + "df": 4,
5699 + "d_min": -8.308385934951591e-06,
5700 + "d_max": -9.249746004447273e-07,
5701 + "rel_mean_pct": -0.1680568839245698,
5702 + "rel_min_pct": -0.4501766913992362,
5703 + "rel_max_pct": -0.0501182791118096,
5704 + "t_cl_seedavg": -13.211231622110189,
5705 + "p_cl_seedavg": 0.0,
5706 + "se_cl_seedavg": 2.3477219304853606e-07,
5707 + "lo_cl": -3.5264989387293883e-06,
5708 + "hi_cl": -2.610060813518323e-06,
5709 + "detectable": false,
5710 + "rule": "|t_seed| > 2.78 (t, 4 df) and |t_cl| > 1.96",
5711 + "per_seed": "1:-9.24975e-07;2:-2.59873e-06;3:-8.30839e-06;4:-1.92357e-06;5:-1.75249e-06"
5712 + },
5713 + {
5714 + "tag": "test",
5715 + "metric": "crps",
5716 + "H": 60,
5717 + "n_seeds": 5,
5718 + "seeds": "1;2;3;4;5",
5719 + "d_mean": -5.853514649624166e-06,
5720 + "d_sd": 4.618445443931396e-06,
5721 + "d_se": 2.065431592600959e-06,
5722 + "t_seed": -2.83403946690529,
5723 + "p_seed": 0.0471515224820166,
5724 + "df": 4,
5725 + "d_min": -1.388987666205214e-05,
5726 + "d_max": -2.5703304371146946e-06,
5727 + "rel_mean_pct": -0.2313071631644464,
5728 + "rel_min_pct": -0.5488716027403494,
5729 + "rel_max_pct": -0.1015690362784698,
5730 + "t_cl_seedavg": -11.7811720470273,
5731 + "p_cl_seedavg": 0.0,
5732 + "se_cl_seedavg": 4.968533373639308e-07,
5733 + "lo_cl": -6.742997937598271e-06,
5734 + "hi_cl": -4.8654948420124835e-06,
5735 + "detectable": true,
5736 + "rule": "|t_seed| > 2.78 (t, 4 df) and |t_cl| > 1.96",
5737 + "per_seed": "1:-2.57033e-06;2:-5.53113e-06;3:-1.38899e-05;4:-3.77571e-06;5:-3.50053e-06"
5738 + },
5739 + {
5740 + "tag": "test",
5741 + "metric": "crps_scaled",
5742 + "H": 5,
5743 + "n_seeds": 5,
5744 + "seeds": "1;2;3;4;5",
5745 + "d_mean": -0.000368461739246,
5746 + "d_sd": 0.0001819866086255,
5747 + "d_se": 8.138688557628998e-05,
5748 + "t_seed": -4.527286388181222,
5749 + "p_seed": 0.0105992449980823,
5750 + "df": 4,
5751 + "d_min": -0.0006623557585303,
5752 + "d_max": -0.0001787154855185,
5753 + "rel_mean_pct": -0.0812963412400954,
5754 + "rel_min_pct": -0.1461402746402357,
5755 + "rel_max_pct": -0.0394312720917446,
5756 + "t_cl_seedavg": -13.602900218343114,
5757 + "p_cl_seedavg": 0.0,
5758 + "se_cl_seedavg": 2.708699860557239e-05,
5759 + "lo_cl": -0.0004206029265275,
5760 + "hi_cl": -0.0003117411930341,
5761 + "detectable": true,
5762 + "rule": "|t_seed| > 2.78 (t, 4 df) and |t_cl| > 1.96",
5763 + "per_seed": "1:-0.000178715;2:-0.000283038;3:-0.000662356;4:-0.00032286;5:-0.00039534"
5764 + },
5765 + {
5766 + "tag": "test",
5767 + "metric": "crps_scaled",
5768 + "H": 15,
5769 + "n_seeds": 5,
5770 + "seeds": "1;2;3;4;5",
5771 + "d_mean": -0.0005186241046071,
5772 + "d_sd": 0.0003653129616178,
5773 + "d_se": 0.0001633729230478,
5774 + "t_seed": -3.174480170470545,
5775 + "p_seed": 0.0337128230493727,
5776 + "df": 4,
5777 + "d_min": -0.0011494632940769,
5778 + "d_max": -0.0002084785545519,
5779 + "rel_mean_pct": -0.1174113461045082,
5780 + "rel_min_pct": -0.2602270728575521,
5781 + "rel_max_pct": -0.0471974740595634,
5782 + "t_cl_seedavg": -13.995378959069406,
5783 + "p_cl_seedavg": 0.0,
5784 + "se_cl_seedavg": 3.705681040320059e-05,
5785 + "lo_cl": -0.0005861150935657,
5786 + "hi_cl": -0.0004385408939588,
5787 + "detectable": true,
5788 + "rule": "|t_seed| > 2.78 (t, 4 df) and |t_cl| > 1.96",
5789 + "per_seed": "1:-0.000208479;2:-0.000395237;3:-0.00114946;4:-0.000469854;5:-0.000370088"
5790 + },
5791 + {
5792 + "tag": "test",
5793 + "metric": "crps_scaled",
5794 + "H": 30,
5795 + "n_seeds": 5,
5796 + "seeds": "1;2;3;4;5",
5797 + "d_mean": -0.0006572391373636,
5798 + "d_sd": 0.0004601404650366,
5799 + "d_se": 0.000205781071804,
5800 + "t_seed": -3.1938755668911365,
5801 + "p_seed": 0.0330935620773272,
5802 + "df": 4,
5803 + "d_min": -0.001452873261839,
5804 + "d_max": -0.0002820922609419,
5805 + "rel_mean_pct": -0.1522268899873724,
5806 + "rel_min_pct": -0.3365082290788982,
5807 + "rel_max_pct": -0.0653369909542345,
5808 + "t_cl_seedavg": -13.024716302765995,
5809 + "p_cl_seedavg": 0.0,
5810 + "se_cl_seedavg": 5.046091769569277e-05,
5811 + "lo_cl": -0.0007485392520964,
5812 + "hi_cl": -0.0005539894405001,
5813 + "detectable": true,
5814 + "rule": "|t_seed| > 2.78 (t, 4 df) and |t_cl| > 1.96",
5815 + "per_seed": "1:-0.000282092;2:-0.000593738;3:-0.00145287;4:-0.000530689;5:-0.000426803"
5816 + },
5817 + {
5818 + "tag": "test",
5819 + "metric": "crps_scaled",
5820 + "H": 60,
5821 + "n_seeds": 5,
5822 + "seeds": "1;2;3;4;5",
5823 + "d_mean": -0.0008968413323646,
5824 + "d_sd": 0.0004957534442085,
5825 + "d_se": 0.000221707680266,
5826 + "t_seed": -4.045152298236201,
5827 + "p_seed": 0.0155377511280813,
5828 + "df": 4,
5829 + "d_min": -0.0017345274584973,
5830 + "d_max": -0.0005342267132761,
5831 + "rel_mean_pct": -0.2136829579023628,
5832 + "rel_min_pct": -0.4132714946548412,
5833 + "rel_max_pct": -0.1272857752689846,
5834 + "t_cl_seedavg": -11.226346701606046,
5835 + "p_cl_seedavg": 0.0,
5836 + "se_cl_seedavg": 7.988719359935098e-05,
5837 + "lo_cl": -0.0010502639125438,
5838 + "hi_cl": -0.0007365630641428,
5839 + "detectable": true,
5840 + "rule": "|t_seed| > 2.78 (t, 4 df) and |t_cl| > 1.96",
5841 + "per_seed": "1:-0.000534227;2:-0.000948931;3:-0.00173453;4:-0.000697353;5:-0.000569168"
5842 + },
5843 + {
5844 + "tag": "test",
5845 + "metric": "wis",
5846 + "H": 5,
5847 + "n_seeds": 5,
5848 + "seeds": "1;2;3;4;5",
5849 + "d_mean": -6.897164360289419e-07,
5850 + "d_sd": 4.197671351533154e-07,
5851 + "d_se": 1.8772556978463097e-07,
5852 + "t_seed": -3.6740676127403544,
5853 + "p_seed": 0.0213147699041792,
5854 + "df": 4,
5855 + "d_min": -1.4102883099869045e-06,
5856 + "d_max": -3.315561870277995e-07,
5857 + "rel_mean_pct": -0.0965413336734378,
5858 + "rel_min_pct": -0.1974015801248518,
5859 + "rel_max_pct": -0.0464087483076891,
5860 + "t_cl_seedavg": -13.161714983398268,
5861 + "p_cl_seedavg": 0.0,
5862 + "se_cl_seedavg": 5.240323444922842e-08,
5863 + "lo_cl": -7.838149113150101e-07,
5864 + "hi_cl": -5.86542800209814e-07,
5865 + "detectable": true,
5866 + "rule": "|t_seed| > 2.78 (t, 4 df) and |t_cl| > 1.96",
5867 + "per_seed": "1:-3.31556e-07;2:-5.15375e-07;3:-1.41029e-06;4:-5.27729e-07;5:-6.63634e-07"
5868 + },
5869 + {
5870 + "tag": "test",
5871 + "metric": "wis",
5872 + "H": 15,
5873 + "n_seeds": 5,
5874 + "seeds": "1;2;3;4;5",
5875 + "d_mean": -1.739011704585736e-06,
5876 + "d_sd": 1.5260205831393387e-06,
5877 + "d_se": 6.824571517926862e-07,
5878 + "t_seed": -2.548162474402503,
5879 + "p_seed": 0.063428926377344,
5880 + "df": 4,
5881 + "d_min": -4.4213327993862695e-06,
5882 + "d_max": -5.810103444128879e-07,
5883 + "rel_mean_pct": -0.1444677741635962,
5884 + "rel_min_pct": -0.3673006378735075,
5885 + "rel_max_pct": -0.0482672261503551,
5886 + "t_cl_seedavg": -14.390906913039055,
5887 + "p_cl_seedavg": 0.0,
5888 + "se_cl_seedavg": 1.2084100849892117e-07,
5889 + "lo_cl": -1.96393131485038e-06,
5890 + "hi_cl": -1.48908673577041e-06,
5891 + "detectable": false,
5892 + "rule": "|t_seed| > 2.78 (t, 4 df) and |t_cl| > 1.96",
5893 + "per_seed": "1:-5.8101e-07;2:-1.28004e-06;3:-4.42133e-06;4:-1.22873e-06;5:-1.18394e-06"
5894 + },
5895 + {
5896 + "tag": "test",
5897 + "metric": "wis",
5898 + "H": 30,
5899 + "n_seeds": 5,
5900 + "seeds": "1;2;3;4;5",
5901 + "d_mean": -3.012216064582412e-06,
5902 + "d_sd": 2.8018458445480056e-06,
5903 + "d_se": 1.2530235541769295e-06,
5904 + "t_seed": -2.403958053734304,
5905 + "p_seed": 0.074037898361062,
5906 + "df": 4,
5907 + "d_min": -7.923545052665859e-06,
5908 + "d_max": -1.04208873746376e-06,
5909 + "rel_mean_pct": -0.1812898339781619,
5910 + "rel_min_pct": -0.4768775334565577,
5911 + "rel_max_pct": -0.0627179757875395,
5912 + "t_cl_seedavg": -13.16371070930604,
5913 + "p_cl_seedavg": 0.0,
5914 + "se_cl_seedavg": 2.2882727606988025e-07,
5915 + "lo_cl": -3.4373234657932404e-06,
5916 + "hi_cl": -2.5468528852229223e-06,
5917 + "detectable": false,
5918 + "rule": "|t_seed| > 2.78 (t, 4 df) and |t_cl| > 1.96",
5919 + "per_seed": "1:-1.04209e-06;2:-2.60938e-06;3:-7.92355e-06;4:-1.82928e-06;5:-1.65678e-06"
5920 + },
5921 + {
5922 + "tag": "test",
5923 + "metric": "wis",
5924 + "H": 60,
5925 + "n_seeds": 5,
5926 + "seeds": "1;2;3;4;5",
5927 + "d_mean": -5.676637007075559e-06,
5928 + "d_sd": 4.338575816753542e-06,
5929 + "d_se": 1.940270090359518e-06,
5930 + "t_seed": -2.925694229520241,
5931 + "p_seed": 0.0429981987193455,
5932 + "df": 4,
5933 + "d_min": -1.3230586679914512e-05,
5934 + "d_max": -2.699478557508874e-06,
5935 + "rel_mean_pct": -0.2491169567417712,
5936 + "rel_min_pct": -0.5806190329767984,
5937 + "rel_max_pct": -0.1184655425735461,
5938 + "t_cl_seedavg": -11.427830682010187,
5939 + "p_cl_seedavg": 0.0,
5940 + "se_cl_seedavg": 4.967379343493234e-07,
5941 + "lo_cl": -6.571003602203331e-06,
5942 + "hi_cl": -4.696686679269732e-06,
5943 + "detectable": true,
5944 + "rule": "|t_seed| > 2.78 (t, 4 df) and |t_cl| > 1.96",
5945 + "per_seed": "1:-2.69948e-06;2:-5.40675e-06;3:-1.32306e-05;4:-3.62264e-06;5:-3.42373e-06"
5946 + }
5947 + ],
5948 + "seed_bands": [
5949 + {
5950 + "tag": "test",
5951 + "model": "mrpt_small",
5952 + "metric": "crps",
5953 + "H": 5,
5954 + "n_seeds": 5,
5955 + "seeds": "1;2;3;4;5",
5956 + "mean": 0.0007928722421589,
5957 + "sd": 3.1839466626096505e-07,
5958 + "min": 0.0007924569044415,
5959 + "max": 0.0007932827856504,
5960 + "seed1": 0.0007932827856504,
5961 + "half_band_pct": 0.0520816069103111,
5962 + "rel_rw_mean_pct": 4.103373553309053,
5963 + "rel_rw_min_pct": 4.053718976250787,
5964 + "rel_rw_max_pct": 4.15360798430322,
5965 + "rel_har_mean_pct": 1.9564006675866152,
5966 + "rel_har_min_pct": 1.905634403553047,
5967 + "rel_har_max_pct": 2.0077597675631,
5968 + "per_seed": "1:0.000793283;2:0.000793014;3:0.000792672;4:0.000792457;5:0.000792936"
5969 + },
5970 + {
5971 + "tag": "test",
5972 + "model": "mrpt_small_1m_only",
5973 + "metric": "crps",
5974 + "H": 5,
5975 + "n_seeds": 5,
5976 + "seeds": "1;2;3;4;5",
5977 + "mean": 0.0007935735646851,
5978 + "sd": 3.949801698497661e-07,
5979 + "min": 0.0007930158796125,
5980 + "max": 0.0007941202725412,
5981 + "seed1": 0.0007935916079192,
5982 + "half_band_pct": 0.0695835255726251,
5983 + "rel_rw_mean_pct": 4.0185497182179715,
5984 + "rel_rw_min_pct": 3.952426279590393,
5985 + "rel_rw_max_pct": 4.086000833593994,
5986 + "rel_har_mean_pct": 1.8696777617904248,
5987 + "rel_har_min_pct": 1.802073924580494,
5988 + "rel_har_max_pct": 1.9386390003187424,
5989 + "per_seed": "1:0.000793592;2:0.000793487;3:0.00079412;4:0.000793016;5:0.000793653"
5990 + },
5991 + {
5992 + "tag": "test",
5993 + "model": "mrpt_small",
5994 + "metric": "crps",
5995 + "H": 15,
5996 + "n_seeds": 5,
5997 + "seeds": "1;2;3;4;5",
5998 + "mean": 0.0013354460105583,
5999 + "sd": 6.549985457197716e-07,
6000 + "min": 0.0013346003427833,
6001 + "max": 0.0013360015052376,
6002 + "seed1": 0.0013358037100368,
6003 + "half_band_pct": 0.0524604680096099,
6004 + "rel_rw_mean_pct": 4.057363197449115,
6005 + "rel_rw_min_pct": 4.017454714561575,
6006 + "rel_rw_max_pct": 4.118118627136324,
6007 + "rel_har_mean_pct": -0.3150599121696684,
6008 + "rel_har_min_pct": -0.3567871565449465,
6009 + "rel_har_max_pct": -0.2515356567168503,
6010 + "per_seed": "1:0.0013358;2:0.00133594;3:0.0013346;4:0.00133488;5:0.001336"
6011 + },
6012 + {
6013 + "tag": "test",
6014 + "model": "mrpt_small_1m_only",
6015 + "metric": "crps",
6016 + "H": 15,
6017 + "n_seeds": 5,
6018 + "seeds": "1;2;3;4;5",
6019 + "mean": 0.001337212610341,
6020 + "sd": 1.1938596733740087e-06,
6021 + "min": 0.0013361959272533,
6022 + "max": 0.0013391706399136,
6023 + "seed1": 0.0013363015961515,
6024 + "half_band_pct": 0.1112281112725136,
6025 + "rel_rw_mean_pct": 3.9304451191568224,
6026 + "rel_rw_min_pct": 3.7897741233591575,
6027 + "rel_rw_max_pct": 4.003486826162906,
6028 + "rel_har_mean_pct": -0.4477620668335102,
6029 + "rel_har_min_pct": -0.594843904915443,
6030 + "rel_har_max_pct": -0.371391607790561,
6031 + "per_seed": "1:0.0013363;2:0.00133716;3:0.00133917;4:0.0013362;5:0.00133724"
6032 + },
6033 + {
6034 + "tag": "test",
6035 + "model": "mrpt_small",
6036 + "metric": "crps",
6037 + "H": 30,
6038 + "n_seeds": 5,
6039 + "seeds": "1;2;3;4;5",
6040 + "mean": 0.0018424816919472,
6041 + "sd": 1.12029545752144e-06,
6042 + "min": 0.0018409302088207,
6043 + "max": 0.0018436906382275,
6044 + "seed1": 0.001842370560495,
6045 + "half_band_pct": 0.0749106332737223,
6046 + "rel_rw_mean_pct": 4.0469783504471435,
6047 + "rel_rw_min_pct": 3.984018675398826,
6048 + "rel_rw_max_pct": 4.1277767077247285,
6049 + "rel_har_mean_pct": -0.5353009058450819,
6050 + "rel_har_min_pct": -0.6012672481978454,
6051 + "rel_har_max_pct": -0.450643987053434,
6052 + "per_seed": "1:0.00184237;2:0.00184343;3:0.00184093;4:0.00184199;5:0.00184369"
6053 + },
6054 + {
6055 + "tag": "test",
6056 + "model": "mrpt_small_1m_only",
6057 + "metric": "crps",
6058 + "H": 30,
6059 + "n_seeds": 5,
6060 + "seeds": "1;2;3;4;5",
6061 + "mean": 0.001845583321768,
6062 + "sd": 2.3240063831999236e-06,
6063 + "min": 0.0018432955350954,
6064 + "max": 0.0018492385947557,
6065 + "seed1": 0.0018432955350954,
6066 + "half_band_pct": 0.161007622635167,
6067 + "rel_rw_mean_pct": 3.885451234794175,
6068 + "rel_rw_min_pct": 3.695091412140228,
6069 + "rel_rw_max_pct": 4.004594912086978,
6070 + "rel_har_mean_pct": -0.704541820799629,
6071 + "rel_har_min_pct": -0.9039923615110412,
6072 + "rel_har_max_pct": -0.5797083841684314,
6073 + "per_seed": "1:0.0018433;2:0.00184603;3:0.00184924;4:0.00184391;5:0.00184544"
6074 + },
6075 + {
6076 + "tag": "test",
6077 + "model": "mrpt_small",
6078 + "metric": "crps",
6079 + "H": 60,
6080 + "n_seeds": 5,
6081 + "seeds": "1;2;3;4;5",
6082 + "mean": 0.0025247705133934,
6083 + "sd": 2.0061489327537308e-06,
6084 + "min": 0.0025222933585249,
6085 + "max": 0.0025268840236714,
6086 + "seed1": 0.0025235779798831,
6087 + "half_band_pct": 0.0909125229831866,
6088 + "rel_rw_mean_pct": 4.22462607057545,
6089 + "rel_rw_min_pct": 4.144451561204221,
6090 + "rel_rw_max_pct": 4.318595178875862,
6091 + "rel_har_mean_pct": -0.7001290825403528,
6092 + "rel_har_min_pct": -0.7844261529831309,
6093 + "rel_har_max_pct": -0.6013280969906054,
6094 + "per_seed": "1:0.00252358;2:0.00252688;3:0.00252229;4:0.00252435;5:0.00252674"
6095 + },
6096 + {
6097 + "tag": "test",
6098 + "model": "mrpt_small_1m_only",
6099 + "metric": "crps",
6100 + "H": 60,
6101 + "n_seeds": 5,
6102 + "seeds": "1;2;3;4;5",
6103 + "mean": 0.002530624028043,
6104 + "sd": 3.88967934947763e-06,
6105 + "min": 0.0025261483103202,
6106 + "max": 0.002536183235187,
6107 + "seed1": 0.0025261483103202,
6108 + "half_band_pct": 0.1982697697397946,
6109 + "rel_rw_mean_pct": 4.002577155081887,
6110 + "rel_rw_min_pct": 3.791692585517537,
6111 + "rel_rw_max_pct": 4.172360323979052,
6112 + "rel_har_mean_pct": -0.9335957194789568,
6113 + "rel_har_min_pct": -1.1553239415195593,
6114 + "rel_har_max_pct": -0.7550823258733574,
6115 + "per_seed": "1:0.00252615;2:0.00253242;3:0.00253618;4:0.00252813;5:0.00253025"
6116 + },
6117 + {
6118 + "tag": "test",
6119 + "model": "mrpt_small",
6120 + "metric": "crps_scaled",
6121 + "H": 5,
6122 + "n_seeds": 5,
6123 + "seeds": "1;2;3;4;5",
6124 + "mean": 0.4528644065860442,
6125 + "sd": 0.0001803055658487,
6126 + "min": 0.4525906855208318,
6127 + "max": 0.4530927717510459,
6128 + "seed1": 0.4530927717510459,
6129 + "half_band_pct": 0.0554344990368261,
6130 + "rel_rw_mean_pct": 3.6284251572894743,
6131 + "rel_rw_min_pct": 3.5798280269556004,
6132 + "rel_rw_max_pct": 3.6866742264115127,
6133 + "rel_har_mean_pct": 1.87183604072594,
6134 + "rel_har_min_pct": 1.822353118182274,
6135 + "rel_har_max_pct": 1.9311468303919943,
6136 + "per_seed": "1:0.453093;2:0.452878;3:0.452847;4:0.452591;5:0.452914"
6137 + },
6138 + {
6139 + "tag": "test",
6140 + "model": "mrpt_small_1m_only",
6141 + "metric": "crps_scaled",
6142 + "H": 5,
6143 + "n_seeds": 5,
6144 + "seeds": "1;2;3;4;5",
6145 + "mean": 0.4532328683252903,
6146 + "sd": 0.0002183624553798,
6147 + "min": 0.4529135455999097,
6148 + "max": 0.4535089673923718,
6149 + "seed1": 0.4532714872365646,
6150 + "half_band_pct": 0.0656860781811988,
6151 + "rel_rw_mean_pct": 3.550014848234462,
6152 + "rel_rw_min_pct": 3.4912597296597014,
6153 + "rel_rw_max_pct": 3.61796815496479,
6154 + "rel_har_mean_pct": 1.791996527097515,
6155 + "rel_har_min_pct": 1.7321704640871238,
6156 + "rel_har_max_pct": 1.8611884359699291,
6157 + "per_seed": "1:0.453271;2:0.453161;3:0.453509;4:0.452914;5:0.453309"
6158 + },
6159 + {
6160 + "tag": "test",
6161 + "model": "mrpt_small",
6162 + "metric": "crps_scaled",
6163 + "H": 15,
6164 + "n_seeds": 5,
6165 + "seeds": "1;2;3;4;5",
6166 + "mean": 0.4411968674676884,
6167 + "sd": 0.0001968317506306,
6168 + "min": 0.4409256083869134,
6169 + "max": 0.4413848444583868,
6170 + "seed1": 0.4413554208765214,
6171 + "half_band_pct": 0.0520443486044231,
6172 + "rel_rw_mean_pct": 3.562655418764475,
6173 + "rel_rw_min_pct": 3.521567180923213,
6174 + "rel_rw_max_pct": 3.6219475565206327,
6175 + "rel_har_mean_pct": -0.199115232248257,
6176 + "rel_har_min_pct": -0.2418062156636979,
6177 + "rel_har_max_pct": -0.1375102620036594,
6178 + "per_seed": "1:0.441355;2:0.441254;3:0.441064;4:0.440926;5:0.441385"
6179 + },
6180 + {
6181 + "tag": "test",
6182 + "model": "mrpt_small_1m_only",
6183 + "metric": "crps_scaled",
6184 + "H": 15,
6185 + "n_seeds": 5,
6186 + "seeds": "1;2;3;4;5",
6187 + "mean": 0.4417154915722955,
6188 + "sd": 0.0003079875563076,
6189 + "min": 0.4413954619038545,
6190 + "max": 0.4422136108105083,
6191 + "seed1": 0.4415638994310734,
6192 + "half_band_pct": 0.0926103931448734,
6193 + "rel_rw_mean_pct": 3.449293935100275,
6194 + "rel_rw_min_pct": 3.340414429917493,
6195 + "rel_rw_max_pct": 3.5192464068592,
6196 + "rel_har_mean_pct": -0.3168986533274154,
6197 + "rel_har_min_pct": -0.4300252655709657,
6198 + "rel_har_max_pct": -0.2442175171037952,
6199 + "per_seed": "1:0.441564;2:0.44165;3:0.442214;4:0.441395;5:0.441755"
6200 + },
6201 + {
6202 + "tag": "test",
6203 + "model": "mrpt_small",
6204 + "metric": "crps_scaled",
6205 + "H": 30,
6206 + "n_seeds": 5,
6207 + "seeds": "1;2;3;4;5",
6208 + "mean": 0.4310924585790794,
6209 + "sd": 0.000205623706429,
6210 + "min": 0.4308529213326499,
6211 + "max": 0.4313586073821507,
6212 + "seed1": 0.4311301908788577,
6213 + "half_band_pct": 0.0586516928604644,
6214 + "rel_rw_mean_pct": 3.546785455592807,
6215 + "rel_rw_min_pct": 3.487236959458151,
6216 + "rel_rw_max_pct": 3.600379845755408,
6217 + "rel_har_mean_pct": -0.3672292901980656,
6218 + "rel_har_min_pct": -0.4291942293000339,
6219 + "rel_har_max_pct": -0.3114600711883408,
6220 + "per_seed": "1:0.43113;2:0.431197;3:0.430924;4:0.430853;5:0.431359"
6221 + },
6222 + {
6223 + "tag": "test",
6224 + "model": "mrpt_small_1m_only",
6225 + "metric": "crps_scaled",
6226 + "H": 30,
6227 + "n_seeds": 5,
6228 + "seeds": "1;2;3;4;5",
6229 + "mean": 0.431749697716443,
6230 + "sd": 0.000401112330234,
6231 + "min": 0.4313836106983059,
6232 + "max": 0.4323763802278078,
6233 + "seed1": 0.4314122831397996,
6234 + "half_band_pct": 0.1149704950290259,
6235 + "rel_rw_mean_pct": 3.399733874750819,
6236 + "rel_rw_min_pct": 3.259519075078554,
6237 + "rel_rw_max_pct": 3.4816426834056613,
6238 + "rel_har_mean_pct": -0.5202481377457469,
6239 + "rel_har_min_pct": -0.6661527715628557,
6240 + "rel_har_max_pct": -0.4350155177861303,
6241 + "per_seed": "1:0.431412;2:0.431791;3:0.432376;4:0.431384;5:0.431785"
6242 + },
6243 + {
6244 + "tag": "test",
6245 + "model": "mrpt_small",
6246 + "metric": "crps_scaled",
6247 + "H": 60,
6248 + "n_seeds": 5,
6249 + "seeds": "1;2;3;4;5",
6250 + "mean": 0.4188096907975523,
6251 + "sd": 0.0002237097748226,
6252 + "min": 0.4186140611836507,
6253 + "max": 0.419136401387894,
6254 + "seed1": 0.4187017316470415,
6255 + "half_band_pct": 0.0623600904803008,
6256 + "rel_rw_mean_pct": 3.6528486059094902,
6257 + "rel_rw_min_pct": 3.5776888486227065,
6258 + "rel_rw_max_pct": 3.697853190191802,
6259 + "rel_har_mean_pct": -0.5301736814894253,
6260 + "rel_har_min_pct": -0.6085965860026299,
6261 + "rel_har_max_pct": -0.4832151714670774,
6262 + "per_seed": "1:0.418702;2:0.418945;3:0.418651;4:0.418614;5:0.419136"
6263 + },
6264 + {
6265 + "tag": "test",
6266 + "model": "mrpt_small_1m_only",
6267 + "metric": "crps_scaled",
6268 + "H": 60,
6269 + "n_seeds": 5,
6270 + "seeds": "1;2;3;4;5",
6271 + "mean": 0.419706532129917,
6272 + "sd": 0.0004674081043564,
6273 + "min": 0.4192359583603176,
6274 + "max": 0.4203856012141207,
6275 + "seed1": 0.4192359583603176,
6276 + "half_band_pct": 0.1369579415370198,
6277 + "rel_rw_mean_pct": 3.446530295888386,
6278 + "rel_rw_min_pct": 3.2903104822106566,
6279 + "rel_rw_max_pct": 3.5547857713893016,
6280 + "rel_har_mean_pct": -0.7454495380142889,
6281 + "rel_har_min_pct": -0.9084518144103492,
6282 + "rel_har_max_pct": -0.6324940266513757,
6283 + "per_seed": "1:0.419236;2:0.419894;3:0.420386;4:0.419311;5:0.419706"
6284 + },
6285 + {
6286 + "tag": "test",
6287 + "model": "mrpt_small",
6288 + "metric": "wis",
6289 + "H": 5,
6290 + "n_seeds": 5,
6291 + "seeds": "1;2;3;4;5",
6292 + "mean": 0.0007137363327855,
6293 + "sd": 2.612301495928549e-07,
6294 + "min": 0.0007134014779646,
6295 + "max": 0.0007140696574642,
6296 + "seed1": 0.0007140696574642,
6297 + "half_band_pct": 0.046808567037683,
6298 + "rel_rw_mean_pct": 4.345936941959114,
6299 + "rel_rw_min_pct": 4.301265179612601,
6300 + "rel_rw_max_pct": 4.390813772074187,
6301 + "rel_har_mean_pct": 2.3894970597252474,
6302 + "rel_har_min_pct": 2.343911613059735,
6303 + "rel_har_max_pct": 2.4352917684689723,
6304 + "per_seed": "1:0.00071407;2:0.000713843;3:0.000713556;4:0.000713401;5:0.000713812"
6305 + },
6306 + {
6307 + "tag": "test",
6308 + "model": "mrpt_small_1m_only",
6309 + "metric": "wis",
6310 + "H": 5,
6311 + "n_seeds": 5,
6312 + "seeds": "1;2;3;4;5",
6313 + "mean": 0.0007144260492215,
6314 + "sd": 3.694628034257428e-07,
6315 + "min": 0.0007139292065838,
6316 + "max": 0.0007149659009947,
6317 + "seed1": 0.0007144012136512,
6318 + "half_band_pct": 0.0725543540818051,
6319 + "rel_rw_mean_pct": 4.25350199584029,
6320 + "rel_rw_min_pct": 4.181151727009846,
6321 + "rel_rw_max_pct": 4.320088233375586,
6322 + "rel_har_mean_pct": 2.2951715152427177,
6323 + "rel_har_min_pct": 2.2213414456917935,
6324 + "rel_har_max_pct": 2.363119660119495,
6325 + "per_seed": "1:0.000714401;2:0.000714358;3:0.000714966;4:0.000713929;5:0.000714476"
6326 + },
6327 + {
6328 + "tag": "test",
6329 + "model": "mrpt_small",
6330 + "metric": "wis",
6331 + "H": 15,
6332 + "n_seeds": 5,
6333 + "seeds": "1;2;3;4;5",
6334 + "mean": 0.0012019977487278,
6335 + "sd": 5.736332587646528e-07,
6336 + "min": 0.0012012256114693,
6337 + "max": 0.0012025420722825,
6338 + "seed1": 0.0012022254595248,
6339 + "half_band_pct": 0.0547613676740746,
6340 + "rel_rw_mean_pct": 4.294530212385818,
6341 + "rel_rw_min_pct": 4.2511900800290885,
6342 + "rel_rw_max_pct": 4.356009328418287,
6343 + "rel_har_mean_pct": -0.2074775577248067,
6344 + "rel_har_min_pct": -0.2528564200837024,
6345 + "rel_har_max_pct": -0.1431064496391076,
6346 + "per_seed": "1:0.00120223;2:0.00120243;3:0.00120123;4:0.00120157;5:0.00120254"
6347 + },
6348 + {
6349 + "tag": "test",
6350 + "model": "mrpt_small_1m_only",
6351 + "metric": "wis",
6352 + "H": 15,
6353 + "n_seeds": 5,
6354 + "seeds": "1;2;3;4;5",
6355 + "mean": 0.0012037367604324,
6356 + "sd": 1.1620501009342654e-06,
6357 + "min": 0.0012027953169174,
6358 + "max": 0.0012056469442687,
6359 + "seed1": 0.0012028064698693,
6360 + "half_band_pct": 0.118448960147777,
6361 + "rel_rw_mean_pct": 4.156066615153901,
6362 + "rel_rw_min_pct": 4.003973949732719,
6363 + "rel_rw_max_pct": 4.231026234650881,
6364 + "rel_har_mean_pct": -0.3524545150812663,
6365 + "rel_har_min_pct": -0.511701655194674,
6366 + "rel_har_max_pct": -0.2739687774829136,
6367 + "per_seed": "1:0.00120281;2:0.00120371;3:0.00120565;4:0.0012028;5:0.00120373"
6368 + },
6369 + {
6370 + "tag": "test",
6371 + "model": "mrpt_small",
6372 + "metric": "wis",
6373 + "H": 30,
6374 + "n_seeds": 5,
6375 + "seeds": "1;2;3;4;5",
6376 + "mean": 0.0016585349311104,
6377 + "sd": 1.0123233545591178e-06,
6378 + "min": 0.0016571484599663,
6379 + "max": 0.001659662513808,
6380 + "seed1": 0.0016583006156569,
6381 + "half_band_pct": 0.0757914046490001,
6382 + "rel_rw_mean_pct": 4.268161122645668,
6383 + "rel_rw_min_pct": 4.203076231691416,
6384 + "rel_rw_max_pct": 4.348189242454337,
6385 + "rel_har_mean_pct": -0.4203971149179697,
6386 + "rel_har_min_pct": -0.4886696005659274,
6387 + "rel_har_max_pct": -0.3364495415109303,
6388 + "per_seed": "1:0.0016583;2:0.00165939;3:0.00165715;4:0.00165818;5:0.00165966"
6389 + },
6390 + {
6391 + "tag": "test",
6392 + "model": "mrpt_small_1m_only",
6393 + "metric": "wis",
6394 + "H": 30,
6395 + "n_seeds": 5,
6396 + "seeds": "1;2;3;4;5",
6397 + "mean": 0.0016615471471749,
6398 + "sd": 2.2309219494749293e-06,
6399 + "min": 0.0016593427043944,
6400 + "max": 0.0016650720050189,
6401 + "seed1": 0.0016593427043944,
6402 + "half_band_pct": 0.1724086082745873,
6403 + "rel_rw_mean_pct": 4.0942938271493245,
6404 + "rel_rw_min_pct": 3.890836476413162,
6405 + "rel_rw_max_pct": 4.221535862950221,
6406 + "rel_har_mean_pct": -0.6027797272629432,
6407 + "rel_har_min_pct": -0.8162015960630375,
6408 + "rel_har_max_pct": -0.4693058912363934,
6409 + "per_seed": "1:0.00165934;2:0.00166199;3:0.00166507;4:0.00166001;5:0.00166132"
6410 + },
6411 + {
6412 + "tag": "test",
6413 + "model": "mrpt_small",
6414 + "metric": "wis",
6415 + "H": 60,
6416 + "n_seeds": 5,
6417 + "seeds": "1;2;3;4;5",
6418 + "mean": 0.0022730269411519,
6419 + "sd": 1.8230525379387148e-06,
6420 + "min": 0.0022708418737577,
6421 + "max": 0.0022749486224176,
6422 + "seed1": 0.0022717728496587,
6423 + "half_band_pct": 0.0903365592719754,
6424 + "rel_rw_mean_pct": 4.443067541038999,
6425 + "rel_rw_min_pct": 4.362281007630497,
6426 + "rel_rw_max_pct": 4.534926697489039,
6427 + "rel_har_mean_pct": -0.5802703669648546,
6428 + "rel_har_min_pct": -0.6653037723195698,
6429 + "rel_har_max_pct": -0.4835822612076379,
6430 + "per_seed": "1:0.00227177;2:0.00227495;3:0.00227084;4:0.00227276;5:0.00227481"
6431 + },
6432 + {
6433 + "tag": "test",
6434 + "model": "mrpt_small_1m_only",
6435 + "metric": "wis",
6436 + "H": 60,
6437 + "n_seeds": 5,
6438 + "seeds": "1;2;3;4;5",
6439 + "mean": 0.002278703578159,
6440 + "sd": 3.710178891762849e-06,
6441 + "min": 0.0022744723282162,
6442 + "max": 0.0022840724604376,
6443 + "seed1": 0.0022744723282162,
6444 + "half_band_pct": 0.2106489916769451,
6445 + "rel_rw_mean_pct": 4.2044245187067375,
6446 + "rel_rw_min_pct": 3.978719353494986,
6447 + "rel_rw_max_pct": 4.382304181139929,
6448 + "rel_har_mean_pct": -0.8314586281376046,
6449 + "rel_har_min_pct": -1.0690289012307508,
6450 + "rel_har_max_pct": -0.6442279994440803,
6451 + "per_seed": "1:0.00227447;2:0.00228036;3:0.00228407;4:0.00227638;5:0.00227823"
6452 + }
6453 + ]
5010 6454 }
5011 6455 }
\ No newline at end of file
modified scripts/evaluate.py +23 −21
Large diff (62 lines) is not loaded by default to keep the page fast.Load diff
modified scripts/review/headline_numbers.py +70 −1
Large diff (91 lines) is not loaded by default to keep the page fast.Load diff
Menu

Theme