| system | n | chrf | edit_sim | rougeL | exact_match | number_recall | placeholders_exact |
|---|---|---|---|---|---|---|---|
| B0_identity | 15649 | 68.913 [68.348, 69.472] | 0.682 [0.677, 0.687] | 0.689 [0.683, 0.695] | 0.000 [0.000, 0.000] | 1.000 [1.000, 1.000] | 1.000 [1.000, 1.000] |
| B1_generic_paraphrase | 15649 | 66.222 [65.675, 66.763] | 0.570 [0.564, 0.575] | 0.606 [0.600, 0.612] | 0.000 [0.000, 0.000] | 1.000 [1.000, 1.000] | 1.000 [1.000, 1.000] |
| B2_t5-small | 15649 | 68.830 [68.304, 69.346] | 0.684 [0.679, 0.689] | 0.693 [0.688, 0.698] | 0.000 [0.000, 0.000] | 0.986 [0.983, 0.990] | 0.733 [0.705, 0.761] |
| htr-m1-small | 15649 | 69.019 [68.482, 69.543] | 0.679 [0.675, 0.684] | 0.688 [0.683, 0.693] | 0.000 [0.000, 0.000] | 0.990 [0.988, 0.992] | 0.991 [0.988, 0.993] |
| htr-m1-tiny-s2 | 15649 | 69.301 [68.758, 69.837] | 0.685 [0.680, 0.690] | 0.694 [0.689, 0.699] | 0.000 [0.000, 0.000] | 0.991 [0.989, 0.992] | 0.992 [0.990, 0.994] |
| htr-m1-tiny-s3 | 15649 | 69.352 [68.811, 69.880] | 0.684 [0.680, 0.689] | 0.693 [0.688, 0.698] | 0.000 [0.000, 0.000] | 0.991 [0.990, 0.993] | 0.992 [0.990, 0.994] |
| htr-m1-tiny | 15649 | 69.315 [68.772, 69.848] | 0.684 [0.679, 0.689] | 0.693 [0.687, 0.698] | 0.000 [0.000, 0.000] | 0.991 [0.989, 0.992] | 0.992 [0.990, 0.994] |
| htr-m2-tiny | 15649 | 69.172 [68.626, 69.712] | 0.683 [0.678, 0.688] | 0.692 [0.686, 0.697] | 0.000 [0.000, 0.000] | 0.989 [0.986, 0.991] | 0.993 [0.991, 0.995] |
| htr-m3light-tiny | 15649 | 69.004 [68.452, 69.547] | 0.682 [0.677, 0.687] | 0.690 [0.685, 0.696] | 0.000 [0.000, 0.000] | 0.989 [0.987, 0.990] | 0.993 [0.990, 0.995] |
| htr-m3tokenonly-tiny-s2 | 15649 | 69.234 [68.692, 69.767] | 0.684 [0.680, 0.689] | 0.693 [0.688, 0.699] | 0.000 [0.000, 0.000] | 0.991 [0.989, 0.993] | 0.993 [0.990, 0.995] |
| htr-m3tokenonly-tiny | 15649 | 69.309 [68.760, 69.851] | 0.686 [0.681, 0.690] | 0.694 [0.689, 0.700] | 0.000 [0.000, 0.000] | 0.991 [0.989, 0.992] | 0.994 [0.991, 0.996] |
Stylometric W1 (mean over features, standardised; lower = closer to originals):
- rewrite vs original: 0.154
- B0_identity vs original: 0.154 · probe P(original) mean 0.43
- B1_generic_paraphrase vs original: 0.227 · probe P(original) mean 0.47
- B2_t5-small vs original: 0.141 · probe P(original) mean 0.49
- htr-m1-small vs original: 0.093 · probe P(original) mean 0.52
- htr-m1-tiny-s2 vs original: 0.099 · probe P(original) mean 0.51
- htr-m1-tiny-s3 vs original: 0.104 · probe P(original) mean 0.51
- htr-m1-tiny vs original: 0.098 · probe P(original) mean 0.51
- htr-m2-tiny vs original: 0.099 · probe P(original) mean 0.51
- htr-m3light-tiny vs original: 0.100 · probe P(original) mean 0.51
- htr-m3tokenonly-tiny-s2 vs original: 0.106 · probe P(original) mean 0.50
- htr-m3tokenonly-tiny vs original: 0.105 · probe P(original) mean 0.50