Repository Public Research preview
1\begin{tabular}{l r c c c c c}2\toprule3System & $n$ & chrF++ & edit similarity & ROUGE-L & number recall & placeholders exact \\4\midrule5B0 identity & 502 & 71.24 [69.69, 72.65] & 0.666 [0.645, 0.686] & 0.690 [0.670, 0.708] & 1.000 [1.000, 1.000] & 1.000 [1.000, 1.000] \\6B1 paraphrase & 502 & 68.41 [66.90, 69.99] & 0.561 [0.545, 0.579] & 0.612 [0.593, 0.632] & 1.000 [1.000, 1.000] & 1.000 [1.000, 1.000] \\7B2 t5-small & 502 & 68.85 [67.66, 69.94] & 0.638 [0.621, 0.657] & 0.671 [0.654, 0.687] & 0.945 [0.919, 0.969] & 0.691 [0.585, 0.787] \\8denoise-only & 502 & 58.06 [55.21, 60.87] & 0.456 [0.421, 0.491] & 0.493 [0.459, 0.526] & 0.856 [0.806, 0.902] & 0.741 [0.649, 0.824] \\9m1-tiny-denoiseinit & 502 & 63.60 [62.20, 64.86] & 0.578 [0.558, 0.595] & 0.600 [0.579, 0.617] & 0.931 [0.912, 0.950] & 0.884 [0.830, 0.938] \\10m1-tiny & 502 & 32.86 [30.87, 34.47] & 0.287 [0.274, 0.299] & 0.241 [0.224, 0.255] & 0.571 [0.503, 0.659] & 0.633 [0.505, 0.742] \\11\bottomrule12\end{tabular}13