Offline: IWSLT25INSTRUCT Leaderboard

Models characTER bleurt comet bleu chrf ter en → de en → zh
characTER bleurt comet bleu chrf ter characTER bleurt comet bleu chrf ter
NeMo_IWSLT25_Offline_en-de-zh-ar_unconstrained_primary 0.418 0.708 0.836 42.355 53.470 73.995 0.355 0.718 0.828 38.380 66.320 48.970 0.481 0.699 0.844 46.330 40.620 99.020
KIT_IWSLT25_Offline_en-de_unconstrained_primary 0.168 0.368 0.421 20.445 33.995 23.520 0.337 0.735 0.842 40.890 67.990 47.040 N/A N/A N/A N/A N/A N/A
KIT_IWSLT25_Offline_en-de_unconstrained_contrastive2 0.174 0.366 0.419 19.145 33.420 24.610 0.347 0.733 0.838 38.290 66.840 49.220 N/A N/A N/A N/A N/A N/A
NYA_IWSLT25_Offline_en-de_unconstrained_primary 0.174 0.365 0.420 19.210 33.185 24.465 0.348 0.730 0.840 38.420 66.370 48.930 N/A N/A N/A N/A N/A N/A
NYA_IWSLT25_Offline_en-de_unconstrained_contrastive3 0.174 0.365 0.420 19.210 33.185 24.465 0.348 0.730 0.840 38.420 66.370 48.930 N/A N/A N/A N/A N/A N/A
KIT_IWSLT25_Offline_en-de_unconstrained_contrastive1 0.173 0.363 0.417 19.415 33.540 24.375 0.347 0.725 0.835 38.830 67.080 48.750 N/A N/A N/A N/A N/A N/A
NYA_IWSLT25_Offline_en-de_unconstrained_contrastive2 0.178 0.362 0.417 18.605 32.895 24.890 0.356 0.725 0.834 37.210 65.790 49.780 N/A N/A N/A N/A N/A N/A
NYA_IWSLT25_Offline_en-de_unconstrained_contrastive1 0.176 0.362 0.417 19.310 33.275 24.400 0.353 0.723 0.835 38.620 66.550 48.800 N/A N/A N/A N/A N/A N/A
AIB_IWSLT25_Offline_en-zh_unconstrained_primary 0.214 0.360 0.428 27.840 24.530 49.345 N/A N/A N/A N/A N/A N/A 0.427 0.719 0.856 55.680 49.060 98.690
NYA_IWSLT25_Offline_en-zh_unconstrained_primary 0.209 0.357 0.430 28.360 24.530 49.400 N/A N/A N/A N/A N/A N/A 0.418 0.713 0.860 56.720 49.060 98.800
NYA_IWSLT25_Offline_en-zh_unconstrained_contrastive3 0.209 0.357 0.430 28.360 24.530 49.400 N/A N/A N/A N/A N/A N/A 0.418 0.713 0.860 56.720 49.060 98.800
NYA_IWSLT25_Offline_en-de_unconstrained_contrastive4 0.179 0.356 0.410 18.885 32.950 24.705 0.357 0.711 0.820 37.770 65.900 49.410 N/A N/A N/A N/A N/A N/A
AIB_IWSLT25_Offline_en-de_unconstrained_contrastive2 0.186 0.354 0.411 17.330 32.300 25.695 0.372 0.709 0.822 34.660 64.600 51.390 N/A N/A N/A N/A N/A N/A
Bigwatermelon_IWSLT25_Offline_en-zh_unconstrained_CONTRASTIVE 0.219 0.352 0.422 28.050 24.620 49.375 N/A N/A N/A N/A N/A N/A 0.438 0.703 0.845 56.100 49.240 98.750
Bigwatermelon_IWSLT25_Offline_en-zh_unconstrained_PRIMARY 0.218 0.352 0.422 28.085 24.730 49.565 N/A N/A N/A N/A N/A N/A 0.436 0.703 0.845 56.170 49.460 99.130
AIB_IWSLT25_Offline_en-de_unconstrained_contrastive1 0.185 0.351 0.409 17.910 32.450 26.085 0.370 0.702 0.817 35.820 64.900 52.170 N/A N/A N/A N/A N/A N/A
NYA_IWSLT25_Offline_en-zh_unconstrained_contrastive2 0.220 0.351 0.426 27.375 23.745 49.485 N/A N/A N/A N/A N/A N/A 0.440 0.702 0.851 54.750 47.490 98.970
NYA_IWSLT25_Offline_en-zh_unconstrained_contrastive1 0.218 0.351 0.425 27.530 23.510 49.210 N/A N/A N/A N/A N/A N/A 0.435 0.702 0.850 55.060 47.020 98.420
NYA_IWSLT25_Offline_en-zh_unconstrained_contrastive4 0.214 0.349 0.419 27.835 23.680 49.185 N/A N/A N/A N/A N/A N/A 0.429 0.697 0.837 55.670 47.360 98.370
AIB_IWSLT25_Offline_en-de_unconstrained_primary 0.209 0.344 0.402 15.010 30.480 28.025 0.418 0.688 0.804 30.020 60.960 56.050 N/A N/A N/A N/A N/A N/A
AIB_IWSLT25_Offline_en-zh_unconstrained_contrastive1 0.248 0.328 0.407 25.520 22.410 49.590 N/A N/A N/A N/A N/A N/A 0.495 0.655 0.814 51.040 44.820 99.180
CUNI-NL_IWSLT25_Offline_en-de_constrained_primary 0.226 0.319 0.386 14.950 29.695 28.550 0.453 0.638 0.772 29.900 59.390 57.100 N/A N/A N/A N/A N/A N/A
NAIST_IWSLT25_Offline_en-de_unconstrained_primary 0.224 0.315 0.383 14.300 29.245 29.490 0.448 0.630 0.766 28.600 58.490 58.980 N/A N/A N/A N/A N/A N/A
CUNI-NL_IWSLT25_Offline_en-de_constrained_contrastive 0.248 0.308 0.377 13.405 28.125 30.285 0.496 0.616 0.754 26.810 56.250 60.570 N/A N/A N/A N/A N/A N/A
AIB_IWSLT25_Offline_en-zh_unconstrained_contrastive2 0.310 0.307 0.396 15.485 14.580 49.890 N/A N/A N/A N/A N/A N/A 0.620 0.615 0.793 30.970 29.160 99.780
NAIST_IWSLT25_Offline_en-zh_unconstrained_primary 0.300 0.295 0.386 20.075 16.690 49.835 N/A N/A N/A N/A N/A N/A 0.600 0.590 0.771 40.150 33.380 99.670
CUNI-NL_IWSLT25_Offline_en-de_constrained_contrastive 0.252 0.293 0.365 12.355 27.500 31.330 0.504 0.586 0.730 24.710 55.000 62.660 N/A N/A N/A N/A N/A N/A
NAIST_IWSLT25_Offline_en-de_constrained_primary 0.277 0.275 0.355 11.415 26.085 33.565 0.554 0.550 0.710 22.830 52.170 67.130 N/A N/A N/A N/A N/A N/A
NAIST_IWSLT25_Offline_en-zh_constrained_primary 0.362 0.243 0.355 15.480 13.280 49.920 N/A N/A N/A N/A N/A N/A 0.724 0.487 0.711 30.960 26.560 99.840