generated 2026-11-03T03:01:33.803470Z · ledger 261.89 USD of 800 USD envelope · 234 runs
| arm | evaluated |
|---|---|
| A0 | 30 |
| A1 | 31 |
| A2 | 30 |
| A3 | 91 |
| A4 | 52 |
| arm | n evaluated | accepted S | det D | critical E | mean cost | cost per accepted |
|---|---|---|---|---|---|---|
| A0 | 30 | 0 (0%) | 0 | 6 | 0.71 | nan |
| A1 | 31 | 27 (87%) | 30 | 1 | 0.80 | 0.91 |
| A2 | 30 | 27 (90%) | 29 | 0 | 0.78 | 0.87 |
| A3 | 91 | 63 (69%) | 71 | 3 | 1.00 | 1.44 |
| A4 | 52 | 41 (79%) | 49 | 1 | 0.87 | 1.10 |
| # | run | arm | node | status | result | wall s | cost USD | tools | det | viol | quality | S | A4 | notes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 0 | DUMMY-01_A4_r1 | A4 | M3U96a | evaluated | success | 26 | 0.004 | 9 | False | 0 | 69.2 | Warning: no stdin data received in 3s, proceeding without it. If piping from a s | ||
| 0 | HR-01_A3_r1_dev | A3 | M3U96a | evaluated | success | 234 | 0.883 | 14 | True | 0 | 76.7 | ACCEPTED | ||
| 0 | BI-01_A1_r1 | A1 | M3U96a | evaluated | success | 202 | 0.684 | 12 | False | 1 | 3.8 | |||
| 0 | HR-01_A3_r2_sonnet | A3 | M3U96a | evaluated | success | 156 | 0.365 | 13 | True | 0 | 75.0 | ACCEPTED | ||
| 0 | RES-01_A3_r1_fable | A3 | M3U96b | evaluated | success | 343 | 2.181 | 21 | True | 0 | 90.8 | ACCEPTED | ||
| 0 | HR-01_A4_r2_int120 | A4 | M3U96a | evaluated | timeout | 140 | 0.879 | 21 | True | 0 | 75.8 | ACCEPTED | rec✓ | |
| 0 | HR-01_A4_r1_resumetest | A4 | M3U96a | evaluated | timeout | 47 | 0.041 | 19 | True | 0 | rec✓ | |||
| 1 | DUMMY-01_A1_r1 | A1 | M3U96b | evaluated | success | 18 | 0.002 | 3 | True | 0 | 88.3 | ACCEPTED | Warning: no stdin data received in 3s, proceeding without it. If piping from a s | |
| 1 | PROC-01_A0_r1 | A0 | M3U96b | evaluated | success | 354 | 1.322 | 18 | False | 0 | 64.6 | |||
| 1 | ACC-01_A2_r3 | A2 | M4M64a | evaluated | success | 232 | 0.915 | 20 | True | 0 | 75.4 | ACCEPTED | ||
| 1 | FIN-01_A3_r2_sonnet | A3 | M4M64b | evaluated | success | 102 | 0.273 | 12 | True | 0 | 77.5 | ACCEPTED | ||
| 1 | FIN-01_A3_r1_fable | A3 | M3U96a | evaluated | success | 339 | 2.327 | 15 | True | 0 | 87.9 | ACCEPTED | ||
| 1 | ADM-01_A3_r2_int120 | A3 | M3U96b | evaluated | timeout | 121 | 0 | 11 | False | 0 | 0.0 | |||
| 2 | RES-01_A0_r1 | A0 | M4M64a | evaluated | success | 116 | 0.419 | 16 | False | 0 | 24.6 | |||
| 2 | ACC-01_A3_r2_sonnet | A3 | M3U96b | evaluated | success | 205 | 0.53 | 18 | True | 0 | 92.1 | ACCEPTED | ||
| 2 | PROC-01_A3_r2_fable | A3 | M4M64a | evaluated | success | 305 | 2.114 | 12 | True | 0 | 95.8 | ACCEPTED | ||
| 2 | RE-01_A4_r1_int120 | A4 | M3U96b | evaluated | timeout | 149 | 0.761 | 27 | True | 0 | 95.8 | ACCEPTED | rec✓ | |
| 3 | RES-01_A1_r2 | A1 | M4M64b | evaluated | success | 231 | 0.628 | 16 | True | 0 | 87.9 | ACCEPTED | ||
| 3 | RE-01_A1_r3 | A1 | M4M64b | evaluated | success | 150 | 0.561 | 14 | True | 0 | 93.8 | ACCEPTED | ||
| 3 | ADM-01_A3_r1_sonnet | A3 | M3U96a | evaluated | success | 273 | 0.632 | 16 | True | 0 | 64.2 | |||
| 3 | ACC-01_A3_r1_fable | A3 | M3U96b | evaluated | success | 488 | 3.898 | 25 | True | 0 | 98.8 | ACCEPTED | ||
| 3 | RES-01_A3_r2_int120 | A3 | M4M64b | evaluated | timeout | 140 | 0 | 13 | False | 0 | 23.3 | |||
| 4 | ACC-01_A2_r1 | A2 | M3U96a | evaluated | success | 294 | 1.222 | 20 | True | 0 | 98.8 | ACCEPTED | ||
| 4 | ACC-01_A3_r1_sonnet | A3 | M4M64a | evaluated | success | 165 | 0.408 | 15 | True | 0 | 93.3 | ACCEPTED | ||
| 4 | HR-01_A3_r1_fable | A3 | M4M64b | evaluated | success | 398 | 2.722 | 20 | True | 0 | 74.6 | ACCEPTED | ||
| 4 | BI-01_A4_r1_int120 | A4 | M4M64a | evaluated | timeout | 206 | 0.917 | 18 | True | 0 | 70.0 | ACCEPTED | rec✓ | |
| 5 | PROC-01_A4_r2 | A4 | M3U96b | evaluated | success | 186 | 0.695 | 14 | True | 0 | 86.7 | ACCEPTED | ||
| 5 | LEGAL-01_A0_r3 | A0 | M4M64b | evaluated | success | 80 | 0.269 | 15 | False | 1 | 12.9 | |||
| 5 | BANK-01_A3_r1_sonnet | A3 | M3U96a | evaluated | success | 153 | 0.369 | 13 | True | 0 | 88.8 | ACCEPTED | ||
| 5 | RE-01_A3_r2_fable | A3 | M4M64b | evaluated | success | 331 | 2.231 | 22 | True | 0 | 100.0 | ACCEPTED | ||
| 5 | RE-01_A4_r2_int120 | A4 | M4M64b | evaluated | timeout | 137 | 0.672 | 23 | True | 0 | 92.9 | ACCEPTED | rec✓ | |
| 6 | BI-01_A3_r2 | A3 | M4M64a | evaluated | success | 277 | 0.994 | 21 | True | 0 | 74.2 | ACCEPTED | ||
| 6 | RES-01_A4_r3 | A4 | M4M64a | evaluated | success | 179 | 0.639 | 16 | True | 0 | 89.2 | ACCEPTED | ||
| 6 | ADM-01_A3_r2_sonnet | A3 | M4M64b | evaluated | success | 211 | 0.529 | 17 | True | 0 | 59.6 | |||
| 6 | BANK-01_A3_r2_fable | A3 | M3U96b | evaluated | success | 440 | 3.059 | 18 | True | 0 | 97.1 | ACCEPTED | ||
| 6 | BANK-01_A3_r2_int120 | A3 | M4M64a | evaluated | timeout | 121 | 0 | 8 | False | 0 | 44.2 | |||
| 7 | PROC-01_A3_r2 | A3 | M4M64b | evaluated | success | 178 | 0.687 | 12 | True | 0 | 93.8 | ACCEPTED | ||
| 7 | RE-01_A3_r2_sonnet | A3 | M4M64a | evaluated | success | 103 | 0.257 | 16 | True | 0 | 93.8 | ACCEPTED | ||
| 7 | BI-01_A3_r1_fable | A3 | M3U96a | evaluated | success | 533 | 3.83 | 35 | True | 0 | 76.7 | ACCEPTED | ||
| 7 | FIN-01_A4_r1_int120 | A4 | M3U96a | evaluated | timeout | 134 | 0.686 | 16 | True | 0 | 89.6 | ACCEPTED | rec✓ | |
| 8 | BI-01_A2_r1 | A2 | M3U96a | evaluated | success | 238 | 0.845 | 12 | True | 0 | 75.0 | ACCEPTED | ||
| 8 | RE-01_A3_r1_sonnet | A3 | M4M64a | evaluated | success | 121 | 0.309 | 21 | True | 0 | 87.9 | ACCEPTED | ||
| 8 | BANK-01_A3_r1_fable | A3 | M3U96a | evaluated | success | 626 | 2.36 | 20 | True | 0 | 99.2 | ACCEPTED | ||
| 8 | ACC-01_A3_r2_int120 | A3 | M3U96a | evaluated | timeout | 122 | 0 | 15 | False | 0 | 0.0 | |||
| 9 | ACC-01_A0_r2 | A0 | M3U96b | evaluated | success | 170 | 0.775 | 34 | False | 0 | 25.4 | |||
| 9 | LEGAL-01_A1_r3 | A1 | M3U96b | evaluated | success | 205 | 0.73 | 10 | True | 0 | 93.3 | ACCEPTED | ||
| 9 | HR-01_A3_r1_sonnet | A3 | M3U96a | evaluated | success | 167 | 0.4 | 15 | True | 0 | 71.2 | ACCEPTED | ||
| 9 | PROC-01_A3_r1_fable | A3 | M4M64a | evaluated | success | 314 | 2.158 | 14 | True | 0 | 93.3 | ACCEPTED | ||
| 9 | ADM-01_A4_r1_int120 | A4 | M3U96b | evaluated | timeout | 122 | 1.247 | 17 | False | 1 | 64.6 | rec✓ | ||
| 10 | HR-01_A3_r1 | A3 | M4M64a | evaluated | success | 222 | 0.796 | 13 | True | 0 | 73.3 | ACCEPTED | ||
| 10 | LEGAL-01_A2_r3 | A2 | M4M64a | evaluated | success | 189 | 0.71 | 9 | True | 0 | 89.6 | ACCEPTED | ||
| 10 | RES-01_A3_r2_sonnet | A3 | M4M64b | evaluated | success | 96 | 0.231 | 15 | True | 0 | 76.2 | ACCEPTED | ||
| 10 | RES-01_A3_r2_fable | A3 | M4M64b | evaluated | success | 274 | 1.843 | 18 | True | 0 | 88.3 | ACCEPTED | ||
| 10 | PROC-01_A4_r2_int120 | A4 | M4M64a | evaluated | timeout | 137 | 0.723 | 17 | True | 0 | 93.3 | ACCEPTED | rec✓ | |
| 11 | ACC-01_A4_r1 | A4 | M4M64b | evaluated | success | 263 | 1.133 | 24 | True | 0 | 96.7 | ACCEPTED | ||
| 11 | LEGAL-01_A3_r2_sonnet | A3 | M4M64a | evaluated | success | 134 | 0.32 | 15 | True | 0 | 89.6 | ACCEPTED | ||
| 11 | HR-01_A3_r2_fable | A3 | M3U96b | evaluated | success | 397 | 2.756 | 20 | True | 0 | 75.8 | ACCEPTED | ||
| 11 | BI-01_A3_r1_int120 | A3 | M3U96a | evaluated | timeout | 144 | 0 | 13 | False | 0 | 0.0 | |||
| 12 | LEGAL-01_A3_r1 | A3 | M4M64a | evaluated | success | 215 | 0.77 | 15 | True | 0 | 92.1 | ACCEPTED | ||
| 12 | PROC-01_A3_r1_sonnet | A3 | M4M64b | evaluated | success | 90 | 0.231 | 8 | True | 0 | 87.1 | ACCEPTED | ||
| 12 | FIN-01_A3_r2_fable | A3 | M3U96a | evaluated | success | 358 | 2.57 | 14 | True | 0 | 82.5 | ACCEPTED | ||
| 12 | BI-01_A4_r2_int120 | A4 | M4M64b | evaluated | timeout | 149 | 0.903 | 20 | True | 0 | 66.7 | rec✓ | ||
| 13 | HR-01_A2_r1 | A2 | M3U96a | evaluated | success | 214 | 0.763 | 10 | True | 0 | 76.7 | ACCEPTED | ||
| 13 | PROC-01_A2_r3 | A2 | M4M64a | evaluated | success | 157 | 0.589 | 8 | True | 0 | 90.8 | ACCEPTED | ||
| 13 | BANK-01_A3_r2_sonnet | A3 | M3U96b | evaluated | success | 135 | 0.34 | 12 | True | 0 | 90.0 | ACCEPTED | ||
| 13 | RE-01_A3_r1_fable | A3 | M4M64b | evaluated | success | 453 | 1.676 | 29 | True | 0 | 94.2 | ACCEPTED | ||
| 13 | FIN-01_A3_r2_int120 | A3 | M3U96a | evaluated | timeout | 145 | 0 | 11 | False | 0 | 38.8 | |||
| 14 | BANK-01_A3_r1 | A3 | M3U96b | evaluated | success | 223 | 0.817 | 13 | True | 0 | 92.9 | ACCEPTED | ||
| 14 | RES-01_A3_r1_sonnet | A3 | M4M64a | evaluated | success | 84 | 0.2 | 11 | True | 0 | 77.5 | ACCEPTED | ||
| 14 | ACC-01_A3_r2_fable | A3 | M4M64b | evaluated | success | 561 | 4.674 | 36 | True | 0 | 97.5 | ACCEPTED | ||
| 14 | RES-01_A3_r1_int120 | A3 | M4M64a | evaluated | timeout | 142 | 0 | 16 | False | 0 | 21.7 | |||
| 15 | ACC-01_A4_r2 | A4 | M3U96b | evaluated | success | 320 | 1.154 | 28 | True | 0 | 90.4 | ACCEPTED | ||
| 15 | RE-01_A3_r3 | A3 | M3U96b | evaluated | success | 192 | 0.729 | 21 | True | 0 | 98.8 | ACCEPTED | ||
| 15 | LEGAL-01_A3_r1_sonnet | A3 | M4M64a | evaluated | success | 145 | 0.353 | 15 | True | 0 | 90.8 | ACCEPTED | ||
| 15 | ADM-01_A3_r1_fable | A3 | M4M64a | evaluated | success | 667 | 4.362 | 23 | False | 1 | 67.1 | |||
| 15 | RES-01_A4_r2_int120 | A4 | M3U96a | evaluated | timeout | 121 | 0.841 | 20 | True | 0 | 84.6 | ACCEPTED | rec✓ | |
| 16 | ACC-01_A1_r1 | A1 | M4M64b | evaluated | success | 338 | 1.354 | 27 | True | 0 | 95.4 | ACCEPTED | ||
| 16 | BANK-01_A3_r3 | A3 | M4M64b | evaluated | success | 232 | 0.898 | 12 | True | 0 | 88.3 | ACCEPTED | ||
| 16 | BI-01_A3_r1_sonnet | A3 | M3U96b | evaluated | success | 120 | 0.282 | 10 | True | 0 | 65.8 | |||
| 16 | BI-01_A3_r2_fable | A3 | M4M64a | evaluated | success | 706 | 2.26 | 37 | True | 0 | 66.7 | |||
| 16 | PROC-01_A3_r1_int120 | A3 | M4M64a | evaluated | timeout | 127 | 0 | 10 | False | 0 | 60.8 | |||
| 17 | ADM-01_A1_r1 | A1 | M4M64b | evaluated | success | 322 | 1.226 | 15 | True | 0 | 64.2 | |||
| 17 | FIN-01_A3_r1_sonnet | A3 | M3U96a | evaluated | success | 97 | 0.254 | 7 | True | 0 | 81.7 | ACCEPTED | ||
| 17 | ADM-01_A3_r2_fable | A3 | M4M64a | evaluated | success | 546 | 4.278 | 20 | True | 0 | 66.2 | |||
| 17 | LEGAL-01_A3_r2_int120 | A3 | M4M64b | evaluated | timeout | 124 | 0 | 10 | False | 1 | 0.0 | |||
| 18 | FIN-01_A2_r1 | A2 | M4M64a | evaluated | success | 188 | 0.699 | 11 | True | 0 | 77.9 | ACCEPTED | ||
| 18 | PROC-01_A3_r2_sonnet | A3 | M3U96b | evaluated | success | 95 | 0.229 | 8 | True | 0 | 85.0 | ACCEPTED | ||
| 18 | LEGAL-01_A3_r2_fable | A3 | M3U96a | evaluated | success | 391 | 2.565 | 24 | True | 0 | 93.8 | ACCEPTED | ||
| 18 | FIN-01_A3_r1_int120 | A3 | M4M64b | evaluated | timeout | 147 | 0 | 9 | False | 0 | 38.8 | |||
| 19 | BI-01_A3_r1 | A3 | M3U96a | evaluated | success | 350 | 1.325 | 22 | True | 0 | 87.1 | ACCEPTED | ||
| 19 | FIN-01_A0_r3 | A0 | M3U96b | evaluated | success | 81 | 0.282 | 17 | False | 0 | 20.8 | |||
| 19 | BI-01_A3_r2_sonnet | A3 | M3U96b | evaluated | success | 127 | 0.31 | 12 | True | 0 | 70.8 | ACCEPTED | ||
| 19 | LEGAL-01_A3_r1_fable | A3 | M3U96a | evaluated | success | 343 | 2.228 | 15 | True | 0 | 92.5 | ACCEPTED | ||
| 19 | ACC-01_A4_r1_int120 | A4 | M3U96b | evaluated | timeout | 121 | 1.015 | 20 | True | 0 | 94.6 | ACCEPTED | rec✓ | |
| 20 | ADM-01_A0_r2 | A0 | M4M64b | evaluated | success | 392 | 1.623 | 79 | False | 0 | 51.2 | |||
| 20 | LEGAL-01_A4_r1_int120 | A4 | M3U96a | evaluated | timeout | 124 | 0.831 | 20 | True | 0 | 95.0 | ACCEPTED | rec✓ | |
| 21 | HR-01_A1_r1 | A1 | M4M64a | evaluated | success | 218 | 0.725 | 10 | True | 0 | 72.9 | ACCEPTED | ||
| 21 | FIN-01_A4_r2_int120 | A4 | M4M64b | evaluated | timeout | 156 | 0.724 | 15 | True | 0 | 88.3 | ACCEPTED | rec✓ | |
| 22 | BI-01_A1_r2 | A1 | M3U96a | evaluated | success | 266 | 0.966 | 17 | True | 0 | 73.3 | ACCEPTED | ||
| 22 | LEGAL-01_A4_r3 | A4 | M3U96a | evaluated | success | 237 | 0.881 | 18 | True | 0 | 91.7 | ACCEPTED | ||
| 22 | LEGAL-01_A3_r1_int120 | A3 | M4M64b | evaluated | timeout | 149 | 0 | 12 | False | 0 | 63.3 | |||
| 23 | HR-01_A4_r1 | A4 | M3U96b | evaluated | success | 225 | 0.864 | 15 | True | 0 | 75.0 | ACCEPTED | ||
| 23 | RE-01_A0_r3 | A0 | M4M64b | evaluated | success | 182 | 0.635 | 51 | False | 1 | 23.8 | |||
| 23 | ADM-01_A4_r2_int120 | A4 | M4M64a | evaluated | timeout | 121 | 0.985 | 16 | True | 0 | 63.3 | rec✓ | ||
| 24 | HR-01_A0_r2 | A0 | M4M64a | evaluated | success | 214 | 0.802 | 57 | False | 0 | 33.3 | |||
| 24 | BANK-01_A4_r2_int120 | A4 | M3U96b | evaluated | timeout | 122 | 0.775 | 15 | True | 0 | 91.7 | ACCEPTED | rec✓ | |
| 25 | ADM-01_A1_r2 | A1 | M3U96a | evaluated | success | 338 | 1.28 | 18 | True | 0 | 61.2 | |||
| 25 | HR-01_A3_r2_int120 | A3 | M3U96a | evaluated | timeout | 121 | 0 | 6 | False | 0 | 42.5 | |||
| 26 | RES-01_A2_r2 | A2 | M4M64a | evaluated | success | 159 | 0.528 | 14 | True | 0 | 82.9 | ACCEPTED | ||
| 26 | BI-01_A1_r3 | A1 | M3U96b | evaluated | success | 272 | 0.984 | 13 | True | 0 | 72.9 | ACCEPTED | ||
| 26 | ADM-01_A3_r1_int120 | A3 | M4M64a | evaluated | timeout | 121 | 0 | 8 | False | 0 | 0.0 | |||
| 27 | HR-01_A2_r2 | A2 | M4M64a | evaluated | success | 245 | 0.845 | 12 | True | 0 | 76.7 | ACCEPTED | ||
| 27 | BANK-01_A3_r1_int120 | A3 | M3U96a | evaluated | timeout | 130 | 0 | 6 | False | 0 | 0.0 | |||
| 28 | RE-01_A0_r2 | A0 | M3U96b | evaluated | success | 144 | 0.542 | 32 | False | 1 | 23.8 | |||
| 28 | FIN-01_A3_r3 | A3 | M3U96b | evaluated | success | 172 | 0.673 | 14 | True | 0 | 82.1 | ACCEPTED | ||
| 28 | ACC-01_A3_r1_int120 | A3 | M3U96b | evaluated | timeout | 122 | 0 | 16 | False | 0 | 0.0 | |||
| 29 | LEGAL-01_A4_r2 | A4 | M3U96b | evaluated | success | 281 | 1.023 | 18 | True | 0 | 94.6 | ACCEPTED | ||
| 29 | HR-01_A3_r1_int120 | A3 | M4M64b | evaluated | timeout | 121 | 0 | 7 | False | 0 | 45.8 | |||
| 30 | PROC-01_A2_r2 | A2 | M3U96a | evaluated | success | 150 | 0.51 | 8 | True | 0 | 88.3 | ACCEPTED | ||
| 30 | RES-01_A4_r1_int120 | A4 | M3U96a | evaluated | timeout | 121 | 0.642 | 18 | True | 0 | 82.5 | ACCEPTED | rec✓ | |
| 31 | ADM-01_A2_r1 | A2 | M4M64a | evaluated | success | 294 | 1.071 | 14 | True | 0 | 62.1 | |||
| 31 | LEGAL-01_A4_r2_int120 | A4 | M3U96a | evaluated | timeout | 122 | 0.813 | 21 | True | 0 | 94.2 | ACCEPTED | rec✓ | |
| 32 | FIN-01_A1_r1 | A1 | M4M64b | evaluated | success | 258 | 0.87 | 14 | True | 0 | 83.8 | ACCEPTED | ||
| 32 | HR-01_A4_r3 | A4 | M4M64b | evaluated | success | 222 | 0.879 | 16 | True | 0 | 76.7 | ACCEPTED | ||
| 32 | BI-01_A3_r2_int120 | A3 | M3U96b | evaluated | timeout | 127 | 0 | 8 | False | 1 | 0.0 | |||
| 33 | PROC-01_A0_r2 | A0 | M3U96b | evaluated | success | 384 | 1.403 | 19 | False | 0 | 62.5 | |||
| 33 | PROC-01_A0_r3 | A0 | M3U96b | evaluated | success | 200 | 0.737 | 19 | False | 0 | 61.7 | |||
| 33 | ACC-01_A4_r2_int120 | A4 | M4M64b | evaluated | timeout | 122 | 1.278 | 28 | True | 0 | rec✓ | |||
| 34 | BANK-01_A3_r2 | A3 | M4M64a | evaluated | success | 221 | 0.812 | 11 | True | 0 | 92.5 | ACCEPTED | ||
| 34 | RE-01_A3_r2_int120 | A3 | M4M64a | evaluated | timeout | 134 | 0 | 17 | False | 0 | 50.0 | |||
| 35 | BANK-01_A2_r1 | A2 | M3U96a | evaluated | success | 213 | 0.736 | 8 | True | 0 | 92.9 | ACCEPTED | ||
| 35 | ADM-01_A0_r3 | A0 | M4M64b | evaluated | success | 355 | 1.529 | 75 | False | 0 | 55.8 | |||
| 35 | PROC-01_A3_r2_int120 | A3 | M3U96b | evaluated | timeout | 135 | 0 | 11 | True | 0 | 87.5 | ACCEPTED | ||
| 36 | ACC-01_A3_r1 | A3 | M4M64b | evaluated | success | 274 | 1.218 | 21 | True | 0 | 100.0 | ACCEPTED | ||
| 36 | RE-01_A3_r1_int120 | A3 | M3U96b | evaluated | timeout | 130 | 0 | 16 | False | 0 | 44.2 | |||
| 37 | FIN-01_A3_r1 | A3 | M4M64b | evaluated | success | 189 | 0.709 | 11 | True | 0 | 90.8 | ACCEPTED | ||
| 37 | PROC-01_A4_r1_int120 | A4 | M4M64b | evaluated | timeout | 123 | 0.705 | 19 | True | 0 | 91.2 | ACCEPTED | rec✓ | |
| 38 | RES-01_A2_r1 | A2 | M3U96a | evaluated | success | 288 | 0.686 | 18 | True | 0 | 86.7 | ACCEPTED | ||
| 38 | BANK-01_A4_r1_int120 | A4 | M3U96a | evaluated | timeout | 122 | 0.899 | 15 | True | 0 | 91.7 | ACCEPTED | rec✓ | |
| 39 | FIN-01_A2_r2 | A2 | M4M64a | evaluated | success | 190 | 0.693 | 11 | True | 0 | 82.5 | ACCEPTED | ||
| 39 | HR-01_A4_r1_int120 | A4 | M4M64a | evaluated | timeout | 139 | 0.967 | 17 | True | 0 | 75.8 | ACCEPTED | rec✓ | |
| 40 | RES-01_A3_r1 | A3 | M3U96b | evaluated | success | 214 | 0.761 | 21 | True | 0 | 80.0 | ACCEPTED | ||
| 41 | LEGAL-01_A1_r1 | A1 | M3U96a | evaluated | success | 215 | 0.747 | 10 | True | 0 | 94.2 | ACCEPTED | ||
| 42 | BI-01_A4_r2 | A4 | M3U96b | evaluated | success | 316 | 1.114 | 24 | True | 0 | 75.0 | ACCEPTED | ||
| 43 | RES-01_A4_r2 | A4 | M4M64b | evaluated | success | 188 | 0.719 | 20 | True | 0 | 85.4 | ACCEPTED | ||
| 44 | RE-01_A0_r1 | A0 | M3U96a | evaluated | success | 88 | 0.365 | 43 | False | 1 | 10.0 | |||
| 45 | RE-01_A2_r1 | A2 | M4M64a | evaluated | success | 179 | 0.617 | 15 | False | 0 | 98.8 | |||
| 45 | RES-01_A3_r3 | A3 | M4M64b | evaluated | success | 170 | 0.572 | 15 | True | 0 | 79.6 | ACCEPTED | ||
| 46 | ACC-01_A2_r2 | A2 | M4M64a | evaluated | success | 239 | 0.98 | 18 | True | 0 | 93.8 | ACCEPTED | ||
| 47 | BANK-01_A4_r1 | A4 | M4M64b | evaluated | success | 228 | 0.859 | 14 | True | 0 | 89.6 | ACCEPTED | ||
| 48 | ADM-01_A3_r2 | A3 | M4M64b | evaluated | success | 385 | 1.477 | 19 | True | 0 | 65.8 | |||
| 48 | ADM-01_A3_r3 | A3 | M3U96b | evaluated | success | 329 | 1.257 | 16 | True | 0 | 61.3 | |||
| 49 | BI-01_A0_r2 | A0 | M4M64a | evaluated | success | 238 | 0.766 | 13 | False | 0 | 4.6 | |||
| 50 | LEGAL-01_A4_r1 | A4 | M3U96b | evaluated | success | 222 | 0.887 | 16 | True | 0 | 91.7 | ACCEPTED | ||
| 51 | RE-01_A1_r2 | A1 | M3U96b | evaluated | success | 160 | 0.592 | 14 | True | 0 | 91.2 | ACCEPTED | ||
| 51 | FIN-01_A1_r3 | A1 | M3U96a | evaluated | success | 216 | 0.769 | 10 | True | 0 | 82.9 | ACCEPTED | ||
| 52 | LEGAL-01_A0_r2 | A0 | M3U96a | evaluated | success | 74 | 0.225 | 16 | False | 1 | 12.1 | |||
| 53 | ADM-01_A0_r1 | A0 | M3U96a | evaluated | success | 389 | 1.555 | 80 | False | 0 | 47.1 | |||
| 54 | HR-01_A0_r1 | A0 | M3U96a | evaluated | success | 280 | 0.879 | 36 | False | 0 | 37.1 | |||
| 55 | RE-01_A2_r2 | A2 | M3U96a | evaluated | success | 180 | 0.666 | 17 | True | 0 | 100.0 | ACCEPTED | ||
| 56 | FIN-01_A3_r2 | A3 | M4M64a | evaluated | success | 180 | 0.698 | 12 | True | 0 | 90.4 | ACCEPTED | ||
| 57 | RE-01_A3_r1 | A3 | M4M64b | evaluated | success | 208 | 0.79 | 25 | True | 0 | 100.0 | ACCEPTED | ||
| 58 | HR-01_A4_r2 | A4 | M3U96b | evaluated | success | 274 | 1.001 | 19 | True | 0 | 71.2 | ACCEPTED | ||
| 59 | BANK-01_A2_r2 | A2 | M4M64a | evaluated | success | 216 | 0.802 | 6 | True | 0 | 92.5 | ACCEPTED | ||
| 60 | BI-01_A4_r1 | A4 | M4M64b | evaluated | success | 330 | 1.226 | 27 | True | 0 | 67.9 | |||
| 60 | BANK-01_A0_r3 | A0 | M3U96b | evaluated | success | 120 | 0.416 | 15 | False | 0 | 17.5 | |||
| 61 | BANK-01_A1_r1 | A1 | M3U96b | evaluated | success | 240 | 0.878 | 9 | True | 0 | 95.0 | ACCEPTED | ||
| 61 | RES-01_A0_r3 | A0 | M3U96b | evaluated | success | 107 | 0.383 | 16 | False | 0 | 24.2 | |||
| 62 | RE-01_A4_r2 | A4 | M4M64a | evaluated | success | 191 | 0.756 | 22 | False | 0 | 98.8 | |||
| 63 | LEGAL-01_A3_r2 | A3 | M3U96b | evaluated | success | 198 | 0.732 | 14 | True | 0 | 89.6 | ACCEPTED | ||
| 64 | PROC-01_A2_r1 | A2 | M3U96a | evaluated | success | 146 | 0.509 | 9 | True | 0 | 88.3 | ACCEPTED | ||
| 65 | FIN-01_A0_r1 | A0 | M4M64a | evaluated | success | 99 | 0.348 | 14 | False | 0 | 17.5 | |||
| 66 | ACC-01_A0_r1 | A0 | M3U96a | evaluated | success | 124 | 0.647 | 31 | False | 0 | 29.6 | |||
| 67 | PROC-01_A3_r1 | A3 | M4M64b | evaluated | success | 190 | 0.697 | 13 | True | 0 | 92.5 | ACCEPTED | ||
| 67 | BI-01_A0_r3 | A0 | M3U96a | evaluated | success | 277 | 0.905 | 14 | False | 0 | 6.2 | |||
| 68 | RES-01_A1_r1 | A1 | M4M64b | evaluated | success | 176 | 0.605 | 15 | True | 0 | 80.0 | ACCEPTED | ||
| 69 | ACC-01_A3_r2 | A3 | M3U96a | evaluated | success | 256 | 1.166 | 24 | True | 0 | 96.7 | ACCEPTED | ||
| 70 | HR-01_A3_r2 | A3 | M4M64a | evaluated | success | 247 | 0.914 | 16 | True | 0 | 75.8 | ACCEPTED | ||
| 70 | BANK-01_A4_r3 | A4 | M3U96a | evaluated | success | 217 | 0.834 | 17 | True | 0 | 91.7 | ACCEPTED | ||
| 71 | BANK-01_A4_r2 | A4 | M3U96a | evaluated | success | 249 | 0.946 | 15 | True | 0 | 93.3 | ACCEPTED | ||
| 72 | PROC-01_A1_r1 | A1 | M3U96a | evaluated | success | 161 | 0.565 | 7 | True | 0 | 89.6 | ACCEPTED | ||
| 73 | BI-01_A0_r1 | A0 | M4M64a | evaluated | success | 293 | 0.925 | 13 | False | 0 | 5.4 | |||
| 74 | BANK-01_A0_r2 | A0 | M3U96b | evaluated | success | 153 | 0.526 | 20 | False | 0 | 16.2 | |||
| 74 | BANK-01_A2_r3 | A2 | M4M64a | evaluated | success | 241 | 0.862 | 8 | True | 0 | 97.5 | ACCEPTED | ||
| 75 | RE-01_A1_r1 | A1 | M4M64a | evaluated | success | 155 | 0.547 | 13 | True | 0 | 95.4 | ACCEPTED | ||
| 75 | BI-01_A3_r3 | A3 | M4M64b | evaluated | success | 364 | 1.317 | 25 | True | 0 | 72.9 | ACCEPTED | ||
| 76 | FIN-01_A1_r2 | A1 | M3U96b | evaluated | success | 205 | 0.746 | 13 | True | 0 | 90.0 | ACCEPTED | ||
| 77 | RES-01_A0_r2 | A0 | M3U96b | evaluated | success | 106 | 0.38 | 15 | False | 0 | 22.5 | |||
| 77 | ACC-01_A3_r3 | A3 | M4M64b | evaluated | success | 308 | 1.171 | 28 | True | 0 | 100.0 | ACCEPTED | ||
| 78 | ADM-01_A4_r1 | A4 | M4M64b | evaluated | success | 321 | 1.248 | 18 | True | 0 | 61.2 | |||
| 79 | LEGAL-01_A2_r1 | A2 | M3U96a | evaluated | success | 179 | 0.661 | 9 | True | 0 | 90.4 | ACCEPTED | ||
| 79 | FIN-01_A2_r3 | A2 | M4M64a | evaluated | success | 213 | 0.799 | 9 | True | 0 | 87.1 | ACCEPTED | ||
| 80 | RES-01_A4_r1 | A4 | M3U96b | evaluated | success | 237 | 0.838 | 21 | True | 0 | 84.6 | ACCEPTED | ||
| 80 | HR-01_A2_r3 | A2 | M3U96a | evaluated | success | 208 | 0.755 | 9 | True | 0 | 75.0 | ACCEPTED | ||
| 81 | RE-01_A4_r1 | A4 | M4M64b | evaluated | success | 182 | 0.719 | 22 | True | 0 | 95.0 | ACCEPTED | ||
| 82 | ADM-01_A2_r2 | A2 | M3U96a | evaluated | success | 291 | 1.032 | 9 | True | 0 | 70.4 | ACCEPTED | ||
| 83 | RE-01_A3_r2 | A3 | M3U96b | evaluated | success | 189 | 0.718 | 21 | True | 0 | 97.5 | ACCEPTED | ||
| 84 | PROC-01_A1_r2 | A1 | M4M64b | evaluated | success | 152 | 0.552 | 8 | True | 0 | 92.1 | ACCEPTED | ||
| 84 | PROC-01_A4_r3 | A4 | M3U96b | evaluated | success | 204 | 0.748 | 14 | True | 0 | 93.8 | ACCEPTED | ||
| 85 | ADM-01_A4_r2 | A4 | M3U96a | evaluated | success | 327 | 1.248 | 19 | True | 0 | 65.8 | |||
| 86 | BANK-01_A0_r1 | A0 | M4M64a | evaluated | success | 131 | 0.476 | 25 | False | 0 | 16.2 | |||
| 87 | LEGAL-01_A0_r1 | A0 | M3U96b | evaluated | success | 65 | 0.22 | 15 | False | 1 | 12.9 | |||
| 88 | RES-01_A3_r2 | A3 | M3U96a | evaluated | success | 195 | 0.723 | 18 | True | 0 | 86.2 | ACCEPTED | ||
| 89 | LEGAL-01_A1_r2 | A1 | M4M64a | evaluated | success | 192 | 0.658 | 9 | True | 0 | 91.2 | ACCEPTED | ||
| 90 | LEGAL-01_A2_r2 | A2 | M4M64a | evaluated | success | 182 | 0.679 | 9 | True | 0 | 92.1 | ACCEPTED | ||
| 90 | ACC-01_A1_r3 | A1 | M3U96b | evaluated | success | 265 | 0.961 | 20 | True | 0 | 92.9 | ACCEPTED | ||
| 91 | BANK-01_A1_r2 | A1 | M3U96b | evaluated | success | 263 | 0.933 | 8 | True | 0 | 97.5 | ACCEPTED | ||
| 92 | BI-01_A2_r2 | A2 | M4M64a | evaluated | success | 287 | 1.057 | 18 | True | 0 | 80.4 | ACCEPTED | ||
| 93 | FIN-01_A0_r2 | A0 | M4M64b | evaluated | success | 97 | 0.298 | 14 | False | 0 | 20.0 | |||
| 93 | RES-01_A1_r3 | A1 | M4M64a | evaluated | success | 185 | 0.649 | 16 | True | 0 | 78.8 | ACCEPTED | ||
| 94 | FIN-01_A4_r1 | A4 | M4M64b | evaluated | success | 166 | 0.619 | 14 | True | 0 | 83.8 | ACCEPTED | ||
| 94 | PROC-01_A3_r3 | A3 | M3U96a | evaluated | success | 165 | 0.622 | 14 | True | 0 | 85.0 | ACCEPTED | ||
| 95 | FIN-01_A4_r2 | A4 | M3U96b | evaluated | success | 231 | 0.877 | 15 | True | 0 | 92.5 | ACCEPTED | ||
| 96 | PROC-01_A4_r1 | A4 | M3U96b | evaluated | success | 161 | 0.641 | 14 | True | 0 | 87.1 | ACCEPTED | ||
| 96 | RE-01_A2_r3 | A2 | M3U96a | evaluated | success | 157 | 0.569 | 12 | True | 0 | 95.4 | ACCEPTED | ||
| 97 | ACC-01_A1_r2 | A1 | M4M64b | evaluated | success | 275 | 1.073 | 18 | True | 0 | 97.5 | ACCEPTED | ||
| 98 | ADM-01_A3_r1 | A3 | M3U96a | evaluated | success | 367 | 1.419 | 18 | True | 0 | 59.6 | |||
| 99 | HR-01_A1_r2 | A1 | M3U96a | evaluated | success | 202 | 0.727 | 8 | True | 0 | 72.1 | ACCEPTED | ||
| 102 | BANK-01_A1_r3 | A1 | M3U96b | evaluated | success | 279 | 1.033 | 11 | True | 0 | 97.5 | ACCEPTED | ||
| 105 | PROC-01_A1_r3 | A1 | M4M64b | evaluated | success | 188 | 0.684 | 8 | True | 0 | 91.2 | ACCEPTED | ||
| 108 | BI-01_A2_r3 | A2 | M4M64a | evaluated | success | 247 | 0.905 | 16 | True | 0 | 75.4 | ACCEPTED | ||
| 111 | RES-01_A2_r3 | A2 | M4M64a | evaluated | success | 204 | 0.653 | 17 | True | 0 | 88.3 | ACCEPTED | ||
| 113 | HR-01_A0_r3 | A0 | M3U96a | evaluated | success | 227 | 0.828 | 33 | False | 0 | 35.8 | |||
| 117 | BI-01_A4_r3 | A4 | M3U96b | evaluated | success | 289 | 1.144 | 21 | True | 0 | 74.2 | ACCEPTED | ||
| 121 | ACC-01_A4_r3 | A4 | M4M64a | evaluated | success | 289 | 1.321 | 27 | True | 0 | 94.2 | ACCEPTED | ||
| 125 | ADM-01_A1_r3 | A1 | M4M64b | evaluated | success | 297 | 1.174 | 11 | True | 0 | 62.9 | |||
| 126 | RE-01_A4_r3 | A4 | M3U96a | evaluated | success | 185 | 0.729 | 24 | True | 0 | 96.2 | ACCEPTED | ||
| 127 | LEGAL-01_A3_r3 | A3 | M3U96b | evaluated | success | 217 | 0.847 | 17 | True | 0 | 92.5 | ACCEPTED | ||
| 128 | ADM-01_A4_r3 | A4 | M3U96a | evaluated | success | 331 | 1.349 | 18 | True | 0 | 67.5 | |||
| 130 | FIN-01_A4_r3 | A4 | M4M64b | evaluated | success | 172 | 0.683 | 14 | True | 0 | 82.5 | ACCEPTED | ||
| 135 | HR-01_A3_r3 | A3 | M4M64b | evaluated | success | 219 | 0.854 | 14 | True | 0 | 79.6 | ACCEPTED | ||
| 139 | ADM-01_A2_r3 | A2 | M4M64a | evaluated | success | 316 | 1.146 | 15 | True | 0 | 67.5 | |||
| 141 | HR-01_A1_r3 | A1 | M3U96b | evaluated | success | 232 | 0.793 | 12 | True | 0 | 75.8 | ACCEPTED | ||
| 147 | ACC-01_A0_r3 | A0 | M4M64a | evaluated | success | 180 | 0.809 | 38 | False | 0 | 26.2 |