Kvalitet estimation (QE) is one of the challenges in MT: it evaluates a system’s Kvalitet without access to reference translations. We released OpenKiwi, a PyTorch-based open-source framework that implements the best QE systems from WMT 2015-18 shared tasks. The accompanying Papper won the best system Papper at ACL 2019.
https://unbabel.github.io/OpenKiwi/
