Quality reporting - Monitor the quality results for your translations

In order to empower you to be on top of the quality of translations across different language pairs and content types, Unbabel designed the Quality Reporting feature.

To see the Quality Reporting page, head to Reporting>Quality in the navigation panel to the left.

Quality reporting allows you to check how the quality of your translations is faring, at any time, by making use of the Customer Utility Analysis (CUA). The CUA consists of four levels of quality, and each is determined by a range of MQM scores. For each different channel (chat, email, FAQ), we break down quality into tiers, and you are then able to see the percentage of your translations that fall within each tier.

MQM (Multidimensional Quality Metric) is a standard quality framework that emerged from collaboration between academia and industry, designed to assess translation quality.

The report will include:

- An overview of quality across translations
- Total active language pairs (LPs) annotated
- Total translations made within the past 6 months
- Breakdown of quality per active LP
- In case the quality of any LP does not meet Unbabel's threshold (i.e over 10% in the red), the status of actions being taken to improve quality to meet the acceptance criteria

The four quality buckets are:

Excellent

The translation is practically fluent! There are almost no mistakes, and the occasional flaw does not affect the meaning and communication.

Good

Almost there! There are a few grammatical issues or inaccuracies in meaning, but the translation is generally understandable. 

Moderate

The translation has quite a few errors. The message and communication may only be partially understandable.

Weak

The translation has errors that critically impact the overall communication and meaning. The message may not be understandable at all.

The reporting page

When entering the reporting page, the top chart on the board will include data pertaining to the sum of all your subscribed language pairs - excluding those whose volumes have not yet allowed us to conduct a proper analysis. Information about the total of translations, their percentage and quality score according to the CUA will be displayed here, giving you an overall idea of how the operation is performing. You can select different time periods for your analysis.

Below the Quality Overview chart, you can find the same information broken down by language pair. Languages are sorted by their relative volumes. Clicking on a language will display the CUA chart for the LP. 

If not enough data is available yet to produce a relevant quality report, a screen reading that "Translation Quality Reports will appear here soon" will display instead.

Having the data broken down by language pair will allow you to detect languages where the quality may require more attention - this can either require actions from your side, such as elaborating/reviewing more language resources to send us, or from Unbabel's. If the quality drops below a certain threshold, we will automatically detect it and our Lang Ops department will program the necessary corrective actions.

To delve deeper into the methods we use to measure quality, you can click the "Learn about how we measure quality" link, which will direct you to the one pager on Translation Quality at Unbabel.

For any questions on Translation Quality, don't be afraid to reach out to your CSM or support at customer.happiness@unbabel.com.