AI Translation Evaluator; Russian-English at CrowdGen by Appen

, , -

Full Time

Start Date

Immediate

Expiry Date

07 Sep, 26

Salary

20.0

Posted On

09 Jun, 26

Experience

2 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Skills

Russian Translation, English Proficiency, MQM Error Annotation, AI Evaluation, Linguistic Analysis, Quality Assurance, Attention To Detail

Industry

technology;Information and Internet

Description

Join the Appen team as an Independent Contractor for Project Centric. Project Centric is seeking individuals for an ongoing, ad-hoc project focused on improving AI-powered translation. In this project, participants will evaluate context-dependent translations produced by an AI chatbot, where each item includes a conversation history, a translation request with additional context (such as dialect preferences, selective non-translation rules, tone/register requirements, or domain-specific terminology), and the chatbot's response. You will apply MQM error annotations, verify auto-generated rubric items for relevance, and evaluate each applicable rubric item as Pass or Fail based on whether the translation meets the user's stated requirements. Help improve AI translation systems by evaluating Russian-English translations for accuracy, quality, and adherence to user-specified requirements. Key Responsibilities: - Review conversation history and translation requests with additional contextual instructions - Apply MQM error annotations with appropriate categories and severity levels - Verify auto-generated rubric items for relevance, marking spurious items as needed - Evaluate each rubric item as Pass or Fail based on the user's stated requirements - Provide accurate and consistent ratings based on project guidelines - Complete assigned tasks within the given timelines Key Requirements: - Must be a native Russian speaker with a strong command of English, including grammar, vocabulary, and translation conventions - Must be a language specialist, professional translator, or hold a Master's Degree in a language-related field - Keen attention to detail - Access to a stable internet connection and a computer This role is a project-based opportunity with CrowdGen, where you will join the CrowdGen Community as an Independent Contractor. If selected, you will receive an email from CrowdGen regarding the creation of an account using your application email address. You will need to log in to this account and reset the password, complete the setup requirements, and proceed with your application for this project-based role. If you have a passion for language and translation, this is a great opportunity to help shape AI systems that produce accurate, context-aware multilingual translations. Slots are limited — apply through CrowdGen and start evaluating! #crowdgen \n \n $20 - $20 an hour \n

Responsibilities

Evaluate AI-generated Russian-English translations using MQM error annotations and rubric-based assessments. Ensure translations adhere to specific context, tone, and domain requirements provided in conversation histories.