Instruction-Following Short Leaderboard
| Models | IWSLT25INSTRUCT | |||
|---|---|---|---|---|
| SQA-BERTScore | SSUM-BERTScore | ASR-WER | ST-COMET | |
| MEETWEEN_IWSLT25_IF_SHORT_EN-EN_UNCONSTRAINED_PRIMARY | 0.043 | N/A | 0.046 | N/A |
| NLE_IWSLT25_IF_SHORT_en-en_constrained_primary | 0.126 | N/A | 0.032 | N/A |
| NLE_IWSLT25_IF_SHORT_en-it_constrained_primary | 0.106 | N/A | N/A | 0.188 |
| CUNI-NL_IWSLT25_IF_SHORT_en-de_constrained_contrastive | 0.054 | N/A | 0.038 | N/A |
| IST_IWSLT25_IF_SHORT_en-en_unconstrained_primary | 0.036 | N/A | 0.037 | N/A |
| CUNI-NL_IWSLT25_IF_SHORT_en-de_constrained_contrastive | 0.091 | N/A | 0.061 | 0.173 |
| NLE_IWSLT25_IF_SHORT_en-zh_constrained_primary | 0.088 | N/A | N/A | 0.191 |
| NLE_IWSLT25_IF_SHORT_en-de_constrained_primary | 0.095 | N/A | N/A | 0.178 |
| CUNI-NL_IWSLT25_IF_SHORT_en-de_constrained_primary | 0.106 | N/A | 0.039 | 0.179 |
| IST_IWSLT25_IF_SHORT_en-de_unconstrained_primary | 0.055 | N/A | N/A | 0.086 |
| IST_IWSLT25_IF_SHORT_en-zh_unconstrained_primary | 0.053 | N/A | N/A | 0.086 |