Experiments using the mbr package
Code for research papers:
- Linear-time Minimum Bayes Risk Decoding with Reference Aggregation (Vamvas & Sennrich, 2024)
Reproductions of experiments from related research papers:
- It's MBR All the Way Down: Modern Generation Techniques Through the Lens of Minimum Bayes Risk (Bertsch et al., 2023)
- Epsilon Sampling Rocks: Investigating Sampling Strategies for Minimum Bayes Risk Decoding for Machine Translation (Freitag et al., 2023)
- Understanding the Properties of Minimum Bayes Risk Decoding in Neural Machine Translation (Müller & Sennrich, ACL-IJCNLP 2021)
Other experiments
- Comparison of fastChrF to standard sentence-level ChrF (Popović, 2015) as a metric for MBR.