AI Prompt & Language Specialist (DUTCH)

at  Keywords Studios

Role overview: Candidate will be working with, testing, and training AI and will be responsible for building linguistic content that enables our client’s content moderation solutions to detect and classify a wide variety of online harms with cultural context.

REQUIREMENTS

• Native level fluency (Dutch)
• You have an in-depth understanding of the cultural specificities that govern the usage of the language
• Capable of following and executing deliverable according to a planning autonomously and on constrained timelines
• Capable of documenting pertinent cultural information into a knowledge repository, you enjoy doing research related tasks
• Capable of presenting your observations and information in a digestible format such as reports, presentations, or documents

TECHNICAL SKILLS:

• Native speaker of required language (Dutch)
• Excellent written & spoken English
• Computer literacy: Microsoft Office Suite, Google Suite

BEHAVIOURAL SKILLS:

• Communicative and outgoing you like to share your ideas with others
• You enjoy working in a team but are autonomous and capable or driving your own work
• You have strong critical thinking & decision-making skills
• Willing and understanding that Trust & Safety roles imply being exposed to unpleasant content at times

BONUS EXPERIENCE:

• Moderation experience either professional or hobby
• Experienced gamer
• Studies in cultural fields for the locale (sociology, ethics, education, anthropology etc.)
• Experiences related to inclusivity, child protection, or legal protection

RESPONSIBILITIES RELATING TO MAINTENANCE AND FUTURE DEVELOPMENT

• Building and maintaining their language of expertise in tools, using your knowledge of both the language and the cultures which speak this language to ensure that classification is accurate, and context based.
• Classifying words/phrases based on a defined taxonomy of online harms.
• Reviewing chat data to ensure accurate classification and address misclassifications as needed.
• Analyzing data for trends and creating classification improvement plans based on impact.
• Identify and add vocabulary based on client requests, global issues, current events, and other trends.
• Collaborating with the Client Success team to answer client questions and assist in tackling problems they may be facing within their communities.
• Participating in developing new and better ways of detecting content intended to circumvent content moderation.
• Support product testing when needed and identify and report product outages

RESPONSIBILITIES RELATING TO AI

• Data Generation
• Using various tools to curate and build datasets for evaluating and testing models and/or prompt effectiveness
• Labeling or analyzing data for our data scientists to assist in training AI
• Red-Teaming
• Test for potential harms in new AI features, evaluate response, report results
• Work with internal teams to refine policy input for AI
• Contribute native language prompts to red-teaming library for future use
• Quality Audits
• Label audit data provided
• Report results, identify areas of weakness and recommendations for improvement