1. I'm a Trainee Editor and I have finished 10 training tasks in a language pair, when I will be evaluated?
Once you deliver the training tasks the system will randomly pick 5 to be evaluated. Depending on demand, and if there are no further delays, your evaluation should take up to two weeks. While you are able to do as many training tasks as you'd like you'll only need to complete 10 to be evaluated.
2. What's the rating criteria?
Our Evaluators work on up to 5 random tasks out of the ones you delivered and evaluate them based on a "1 to 5" scale. Our platform automatically calculates the average from the last 5 evaluated tasks. This will be your rating until your next evaluation.
3. What does each rate mean on the 1 to 5 scale?
1 star (bad quality): the translated text has severe accuracy, fluency and style problems and does not convey the meaning of the source text;
2 stars (poor quality): the translated text has major problems that may affect the accuracy, fluency and/or style, making it difficult to read;
3 stars (fair quality): the translated text contains some issues that particularly affect its fluency, causing the text to sound unnatural;
4 stars (good quality): overall, the translated text is accurate and fluent, containing only minor errors that do not have much impact on the comprehension of the text;
5 stars (excellent quality): the translated text is perfect, with none or very few errors (as an extra whitespace or a small spelling mistake.
4. What information can I find on the evaluation results?
For training tasks, you will only receive your final score (an average of the five tasks). In the case of paid tasks, besides the final score, you will also get comments from our Evaluators.
5. Am I able to choose which tasks I want to be evaluated for?
All tasks are picked randomly from your latest tasks done at the language pair evaluated, so the rating is unbiased for every Editor.
6. If I have more then one language pair will I be evaluated for all of them?
Yes. Once a new language pair is added to your account and verified you’ll need to complete 10 training tasks and be evaluated for it. The same process goes for each added language pair.
7. In case I fail evaluation, how and when can I request to be evaluated one more time?
You may be evaluated again from 30 days onwards since your last evaluation whenever the language pair is open. When it is, you'll need to complete 10 new training tasks.
8. Can I dispute my evaluation?
We are unable to reconsider our decision at this point.
9. I am a paid editor with a high rate, am I going to be evaluated again?
All Editors, regardless of rating score, are subject to evaluation. Regular quality checks ensure that good quality translation is always delivered. Ratings are given by evaluators only, who are carefully selected and are well trusted by Unbabel.
10. Does Unbabel apply the same score criteria to all language pairs?
The same rating process and criteria are applied to every evaluation. The minimum score to get access to paid tasks may vary at different times and between language pairs.
11. My rating already qualifies me for paid tasks, do I really need to be evaluated again?
Evaluations provide valuable information for Unbabel and are thus mandatory. Evaluations are unbiased — they consist of objective quality checks designed to guarantee we keep delivering our customers the best translation possible. Your evaluation frequency may vary depending on platform activity.
12. May I share details of my results with others?
No. According to our Terms of Service, the pages and content on this platform are protected by copyright and may not be copied, distributed, modified, published, or transmitted in any manner.
13. I'm a trainee Editor. When will my language pair open for evaluation?
Each language pair has a capacity of Editors, based on the demand of Unbabel translation requests. If your language pair isn't currently open, don't worry — we'll be sure to open it as soon as we can.
14. How can I see my evaluation score?
To see your average evaluation score go to your dashboard and check it next to the language pair. To see the evaluation for each evaluated tasks select Evaluations on your dashboard.
15. What are the color markers on an evaluated text?
The color highlighting shows the changes you have done to the machine-translated text you have edited. Gray shows the words/letters you have deleted, and yellow marks the words/letters you have added to the text.