Offline Leaderboard

Models CHALLENGEACCENT IWSLT25INSTRUCT TVSERIES BUSINESSNEWS
characTER bleurt comet bleu chrf ter characTER bleurt comet bleu chrf ter characTER bleurt comet bleu chrf ter characTER bleurt comet bleu chrf ter
NAIST_IWSLT25_Offline_en-zh_constrained_primary N/A N/A N/A N/A N/A N/A 0.362 0.243 0.355 15.480 13.280 49.920 N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A
Bigwatermelon_IWSLT25_Offline_en-zh_unconstrained_CONTRASTIVE N/A N/A N/A N/A N/A N/A 0.219 0.352 0.422 28.050 24.620 49.375 N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A
NYA_IWSLT25_Offline_en-ar_unconstrained_contrastive2 N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A 0.221 0.332 0.421 10.925 27.535 32.525
NeMo_IWSLT25_Offline_en-de-zh-ar_unconstrained_primary 0.549 0.579 0.712 18.390 51.020 92.510 0.418 0.708 0.836 42.355 53.470 73.995 0.571 0.546 0.695 19.780 42.210 75.790 0.423 0.676 0.823 28.895 58.680 58.650
NYA_IWSLT25_Offline_en-ar_unconstrained_contrastive3 N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A 0.220 0.332 0.419 11.070 27.695 32.175
CUNI-NL_IWSLT25_Offline_en-de_constrained_contrastive 0.705 0.419 0.582 12.160 37.240 87.560 0.252 0.293 0.365 12.355 27.500 31.330 0.795 0.297 0.527 8.980 27.870 86.010 0.326 0.191 0.266 9.070 22.080 39.295
AIB_IWSLT25_Offline_en-ar_unconstrained_primary N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A 0.248 0.313 0.406 8.615 25.125 33.505
NYA_IWSLT25_Offline_en-ar_unconstrained_contrastive1 N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A 0.222 0.323 0.411 11.025 27.525 31.790
KIT_IWSLT25_Offline_en-de_unconstrained_contrastive2 0.548 0.593 0.725 18.620 50.880 85.250 0.174 0.366 0.419 19.145 33.420 24.610 0.560 0.565 0.713 18.280 42.330 79.150 0.197 0.355 0.415 18.625 32.105 26.705
CUNI-NL_IWSLT25_Offline_en-de_constrained_contrastive 0.686 0.479 0.624 14.360 38.880 83.830 0.248 0.308 0.377 13.405 28.125 30.285 0.780 0.317 0.546 10.750 29.720 83.340 0.336 0.203 0.281 9.165 21.820 37.510
NYA_IWSLT25_Offline_en-de_unconstrained_primary 0.543 0.595 0.742 20.710 52.040 78.260 0.174 0.365 0.420 19.210 33.185 24.465 0.564 0.551 0.704 19.050 42.890 78.440 0.198 0.354 0.416 18.765 32.340 26.400
AIB_IWSLT25_Offline_en-zh_unconstrained_contrastive2 N/A N/A N/A N/A N/A N/A 0.310 0.307 0.396 15.485 14.580 49.890 N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A
Bigwatermelon_IWSLT25_Offline_en-zh_unconstrained_PRIMARY N/A N/A N/A N/A N/A N/A 0.218 0.352 0.422 28.085 24.730 49.565 N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A
Test-Organizers N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A 0.461 0.065 0.181 0.110 8.430 49.320
KIT_IWSLT25_Offline_en-de_unconstrained_contrastive1 0.548 0.596 0.725 18.590 50.930 84.990 0.173 0.363 0.417 19.415 33.540 24.375 0.565 0.551 0.706 17.780 42.100 79.250 0.194 0.354 0.413 18.075 32.400 27.190
KIT_IWSLT25_Offline_en-de_unconstrained_primary 0.540 0.603 0.733 21.820 52.280 76.160 0.168 0.368 0.421 20.445 33.995 23.520 0.546 0.579 0.722 21.810 44.330 74.740 0.191 0.361 0.416 18.085 32.490 27.255
NYA_IWSLT25_Offline_en-zh_unconstrained_primary N/A N/A N/A N/A N/A N/A 0.209 0.357 0.430 28.360 24.530 49.400 N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A
NYA_IWSLT25_Offline_en-zh_unconstrained_contrastive3 N/A N/A N/A N/A N/A N/A 0.209 0.357 0.430 28.360 24.530 49.400 N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A
AIB_IWSLT25_Offline_en-zh_unconstrained_contrastive1 N/A N/A N/A N/A N/A N/A 0.248 0.328 0.407 25.520 22.410 49.590 N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A
NYA_IWSLT25_Offline_en-ar_unconstrained_primary N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A 0.220 0.332 0.419 11.070 27.695 32.175
NAIST_IWSLT25_Offline_en-zh_unconstrained_primary N/A N/A N/A N/A N/A N/A 0.300 0.295 0.386 20.075 16.690 49.835 N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A
CUNI-NL_IWSLT25_Offline_en-de_constrained_primary 0.676 0.473 0.628 15.290 40.590 80.520 0.226 0.319 0.386 14.950 29.695 28.550 0.778 0.318 0.544 10.620 29.730 83.330 0.314 0.216 0.292 10.895 23.760 35.880
NAIST_IWSLT25_Offline_en-de_unconstrained_primary 0.598 0.551 0.695 16.670 46.840 81.190 0.224 0.315 0.383 14.300 29.245 29.490 0.787 0.287 0.513 8.180 25.660 93.820 0.339 0.204 0.300 9.165 20.430 37.290
NYA_IWSLT25_Offline_en-de_unconstrained_contrastive3 0.545 0.594 0.741 20.750 52.030 78.200 0.174 0.365 0.420 19.210 33.185 24.465 0.564 0.550 0.703 19.060 42.870 78.800 0.197 0.355 0.416 18.830 32.360 26.255
NYA_IWSLT25_Offline_en-zh_unconstrained_contrastive2 N/A N/A N/A N/A N/A N/A 0.220 0.351 0.426 27.375 23.745 49.485 N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A
NYA_IWSLT25_Offline_en-de_unconstrained_contrastive2 0.551 0.593 0.735 20.110 51.570 80.180 0.178 0.362 0.417 18.605 32.895 24.890 0.563 0.552 0.703 18.700 42.630 78.870 0.202 0.353 0.415 18.410 32.015 26.665
NYA_IWSLT25_Offline_en-ar_unconstrained_contrastive4 N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A 0.222 0.325 0.413 11.010 27.535 31.865
NYA_IWSLT25_Offline_en-zh_unconstrained_contrastive1 N/A N/A N/A N/A N/A N/A 0.218 0.351 0.425 27.530 23.510 49.210 N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A
AIB_IWSLT25_Offline_en-zh_unconstrained_primary N/A N/A N/A N/A N/A N/A 0.214 0.360 0.428 27.840 24.530 49.345 N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A
AIB_IWSLT25_Offline_en-de_unconstrained_primary 0.569 0.533 0.688 19.440 50.190 79.680 0.209 0.344 0.402 15.010 30.480 28.025 0.788 0.172 0.401 2.570 17.940 120.650 0.208 0.343 0.406 17.890 31.060 26.645
AIB_IWSLT25_Offline_en-ar_unconstrained_contrastive2 N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A 0.253 0.303 0.398 8.180 24.570 34.425
NYA_IWSLT25_Offline_en-de_unconstrained_contrastive1 0.546 0.590 0.735 20.770 51.600 76.470 0.176 0.362 0.417 19.310 33.275 24.400 0.560 0.551 0.701 19.930 42.870 76.750 0.188 0.349 0.413 20.395 33.205 24.780
NYA_IWSLT25_Offline_en-de_unconstrained_contrastive4 0.544 0.569 0.705 21.110 51.620 76.590 0.179 0.356 0.410 18.885 32.950 24.705 0.566 0.542 0.689 19.480 42.160 77.960 0.500 0.018 0.132 0.000 0.150 50.015
AIB_IWSLT25_Offline_en-ar_unconstrained_contrastive1 N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A 0.240 0.314 0.405 9.030 25.520 33.810
NYA_IWSLT25_Offline_en-zh_unconstrained_contrastive4 N/A N/A N/A N/A N/A N/A 0.214 0.349 0.419 27.835 23.680 49.185 N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A
AIB_IWSLT25_Offline_en-de_unconstrained_contrastive1 0.563 0.527 0.680 20.050 51.040 79.550 0.185 0.351 0.409 17.910 32.450 26.085 0.544 0.550 0.704 20.630 44.710 76.020 0.203 0.344 0.406 18.010 31.290 26.815
NAIST_IWSLT25_Offline_en-de_constrained_primary 0.628 0.518 0.672 13.720 43.780 86.750 0.277 0.275 0.355 11.415 26.085 33.565 0.786 0.249 0.491 6.880 25.390 97.460 0.402 0.141 0.252 5.125 15.170 40.915
AIB_IWSLT25_Offline_en-de_unconstrained_contrastive2 0.599 0.516 0.671 14.870 46.710 85.890 0.186 0.354 0.411 17.330 32.300 25.695 0.603 0.487 0.662 16.530 40.170 79.510 0.205 0.342 0.404 17.735 31.225 26.995