| Findings of the 2019 conference on machine translation (WMT19) L Barrault, O Bojar, MR Costa-Jussa, C Federmann, M Fishel, Y Graham, ... ACL, 2019 | 878 | 2019 |
| Large language models are state-of-the-art evaluators of translation quality T Kocmi, C Federmann arXiv preprint arXiv:2302.14520, 2023 | 524 | 2023 |
| Findings of the 2022 conference on machine translation (WMT22) T Kocmi, R Bawden, O Bojar, A Dvorkovich, C Federmann, M Fishel, ... Proceedings of the Seventh Conference on Machine Translation (WMT), 1-45, 2022 | 363 | 2022 |
| Results of WMT22 metrics shared task: Stop using BLEU–neural metrics are better and more robust M Freitag, R Rei, N Mathur, C Lo, C Stewart, E Avramidis, T Kocmi, ... Proceedings of the Seventh Conference on Machine Translation (WMT), 46-68, 2022 | 283* | 2022 |
| To ship or not to ship: An extensive evaluation of automatic metrics for machine translation T Kocmi, C Federmann, R Grundkiewicz, M Junczys-Dowmunt, ... arXiv preprint arXiv:2107.10821, 2021 | 272 | 2021 |
| Findings of the 2021 conference on machine translation (WMT21) F Akhbardeh, A Arkhangorodsky, M Biesialska, O Bojar, R Chatterjee, ... Proceedings of the sixth conference on machine translation, 1-88, 2021 | 222 | 2021 |
| Trivial transfer learning for low-resource neural machine translation T Kocmi, O Bojar arXiv preprint arXiv:1809.00357, 2018 | 217 | 2018 |
| Curriculum learning and minibatch bucketing in neural machine translation T Kocmi, O Bojar Recent Advances in Natural Language Processing 2017, 2017 | 174 | 2017 |
| Findings of the WMT24 general machine translation shared task: The LLM era is here but MT is not solved yet T Kocmi, E Avramidis, R Bawden, O Bojar, A Dvorkovich, C Federmann, ... Proceedings of the Ninth Conference on Machine Translation, 1-46, 2024 | 132* | 2024 |
| GEMBA-MQM: Detecting translation quality error spans with GPT-4 T Kocmi, C Federmann arXiv preprint arXiv:2310.13988, 2023 | 126 | 2023 |
| Czeng 1.6: enlarged czech-english parallel corpus with processing tools dockered O Bojar, O Dušek, T Kocmi, J Libovický, M Novák, M Popel, R Sudarikov, ... International Conference on Text, Speech, and Dialogue, 231-238, 2016 | 110 | 2016 |
| Results of WMT23 metrics shared task: Metrics might be guilty but references are not innocent M Freitag, N Mathur, C Lo, E Avramidis, R Rei, B Thompson, T Kocmi, ... Proceedings of the Eighth Conference on Machine Translation, 578-628, 2023 | 109 | 2023 |
| NTREX-128–news test references for MT evaluation of 128 languages C Federmann, T Kocmi, Y Xin Proceedings of the first workshop on scaling up multilingual evaluation, 21-24, 2022 | 82 | 2022 |
| Aya expanse: Combining research breakthroughs for a new multilingual frontier J Dang, S Singh, D D'souza, A Ahmadian, A Salamanca, M Smith, ... arXiv preprint arXiv:2412.04261, 2024 | 80* | 2024 |
| An Exploration of Word Embedding Initialization in Deep-Learning Tasks T Kocmi, O Bojar ICON 2017 : 14th International Conference on Natural Language Processing, 56-64, 2017 | 67 | 2017 |
| Are LLMs breaking MT metrics? results of the WMT24 metrics shared task M Freitag, N Mathur, D Deutsch, CK Lo, E Avramidis, R Rei, B Thompson, ... Proceedings of the Ninth Conference on Machine Translation, 47-81, 2024 | 65 | 2024 |
| Error analysis prompting enables human-like translation evaluation in large language models Q Lu, B Qiu, L Ding, K Zhang, T Kocmi, D Tao Findings of the Association for Computational Linguistics: ACL 2024, 8801-8816, 2024 | 53 | 2024 |
| Gender coreference and bias evaluation at WMT 2020 T Kocmi, T Limisiewicz, G Stanovsky arXiv preprint arXiv:2010.06018, 2020 | 52 | 2020 |
| LanideNN: Multilingual Language Identification on Character Window T Kocmi, O Bojar Proceedings of the 15th Conference of the European Chapter of the …, 2017 | 52 | 2017 |
| Navigating the metrics maze: Reconciling score magnitudes and accuracies T Kocmi, V Zouhar, C Federmann, M Post arXiv preprint arXiv:2401.06760, 2024 | 45 | 2024 |
Ondřej BojarCharles University, Faculty of Mathematics and Physics, Institute of Formal and Applied LinguisticsVerified email at ufal.mff.cuni.cz
