Quality reports - Monitor the quality results for your translations

In order to empower you to be on top of the quality of translations across different language pairs and content types, Unbabel designed the Quality Reports feature.

To see the Quality Reports page, head to Reports > Quality in the navigation panel to the left.

Quality reporting allows you to check how the quality of your translations is faring, at any time, by making use of Customer Utility Analysis (CUA). CUA consists of five levels of quality, each being determined by a range of MQM scores. MQM (Multidimensional Quality Metric) is a standard quality framework that emerged from collaboration between academia and industry, designed to assess translation quality. For each different channel (chat, email, FAQ), we break down quality into predetermined buckets in which a certain percentage of your completed translations will fall in.

The report will include:

- An overview of quality across translations
- Total active language pairs (LPs) annotated
- Total translations made within the past 6 months
- Breakdown of quality per active LP
- In case the quality of any LP does not meet Unbabel's threshold (i.e over 10% in the red), the status of actions being taken to improve quality to meet the acceptance criteria

The five quality buckets are:

Best - Premium quality (MQM of >=98)

The translation is exceptional and displays outstanding fluency. Any potential errors are negligible and have minimal impact on the overall meaning and success of communication.

Excellent - High level of quality (MQM in the range 94 ≤ x < 98)

The translation is fluent and accurately conveys the intended meaning. Minor style or fluency issues may still occur, but communication is effective and successful.

Good - Good level of quality (MQM in the range 80 ≤ x < 94)

The translation is easily comprehensible and accurately conveys the intended message. Although there may be occasional grammatical errors, the overall quality is acceptable.

Moderate - Below target quality, area of attention (MQM in the range 60 ≤ x < 80)

This level requires attention, as errors may impact the clarity and understandability of the translations.

Weak - Poor quality (MQM of <60)

The translation requires review as errors will likely impact the comprehension of the message's core concepts.

The report page

When entering the report page, the top chart on the board will include data pertaining to the sum of all your subscribed language pairs - excluding those whose volumes have not yet allowed us to conduct a proper analysis. Information about the total of translations, their percentage and quality score according to the CUA will be displayed here, giving you an overall idea of how the operation is performing. You can select different time periods for your analysis.

Below the Quality Overview chart, you can find the same information broken down by language pair. Languages are sorted by their relative volumes. Clicking on a language will display the CUA chart for the LP. 

If not enough data is available yet to produce a relevant quality report, a screen reading that "Translation Quality Reports will appear here soon" will display instead.

Having the data broken down by language pair will allow you to detect languages where the quality may require more attention - this can either require actions from your side, such as elaborating/reviewing more language resources to send us, or from Unbabel's. If the quality drops below a certain threshold, we will automatically detect it and our Lang Ops department will program the necessary corrective actions.

To delve deeper into the methods we use to measure quality, you can click the "Learn about how we measure quality" link, which will direct you to the one pager on Translation Quality at Unbabel.

For any questions on Translation Quality, don't be afraid to reach out to your CSM or support at customer.happiness@unbabel.com.