Official implementations for (1) BlonDe: An Automatic Evaluation Metric for Document-level Machine Translation and (2) Discourse Centric Evaluation of Machine Translation with a Densely Annotated Parallel Corpus
-
Updated
Sep 21, 2023 - Python
Official implementations for (1) BlonDe: An Automatic Evaluation Metric for Document-level Machine Translation and (2) Discourse Centric Evaluation of Machine Translation with a Densely Annotated Parallel Corpus
Code and data releases for the paper -- DelTA: An Online Document-Level Translation Agent Based on Multi-Level Memory
Repository for "Uncertainty-Aware Machine Translation Evaluation", accepted to Findings of EMNLP 2021.
MAchine Translation Evaluation Online (MATEO)
Repository for "BLEU Meets COMET: Combining Lexical and Neural Metrics Towards Robust Machine Translation Evaluation", accepted at EAMT 2023.
Tools for the evaluation of audio captioning.
LEPOR: A Robust Evaluation Metric for Machine Translation with Augmented Factors
We at the Telecommunication Research Center decided to test and evaluate the Tergoman machine translation system. This evaluation is done by 6 algorithms
Official repository of the ACL 2024 paper "Guardians of the Machine Translation Meta-Evaluation: Sentinel Metrics Fall In!".
hLEPOR: Language-independent Model for Machine Translation Evaluation with Reinforced Factors
Evaluate the BLEU score significance statistically comparing Ref file and Tgt files among different machine translation systems
Scripts for machine translation corpora filtering/ 机器翻译平行语料过滤的脚本
Code for "QE4PE: Word-level Quality Estimation for Human Post-Editing" ✍️
This repo contains the code for the paper "Don't Rank, Combine! Combining Machine Translation Hypotheses Using Quality Estimation"
MaTESe: Machine Translation Evaluation as a Sequence Tagging Problem
The code for ACL 2025 "RUBRIC-MQM : Span-Level LLM-as-judge in Machine Translation For High-End Models"
Phrase Tagset Mapping for French and English Treebanks and Its Application in Machine Translation Evaluation
Long Short-Term Memory (LSTM) Model Implementation in order to train it to translate over Cap-verdian criole to English.
Repo for our attempt at the Shared Task (Quality Estimation) WMT2020. http://www.statmt.org/wmt20/quality-estimation-task.html
several evaluation metrics for Machine Translation
Add a description, image, and links to the machine-translation-metrics topic page so that developers can more easily learn about it.
To associate your repository with the machine-translation-metrics topic, visit your repo's landing page and select "manage topics."