Qualité estimation (QE) is one of the challenges in MT: it evaluates a system’s Qualité without access to reference translations. We released OpenKiwi, a PyTorch-based open-source framework that implements the best QE systems from WMT 2015-18 shared tasks. The accompanying Papier won the best system Papier at ACL 2019.
https://unbabel.github.io/OpenKiwi/