WHAT DOES DAY-TO-DAY LOOK LIKE:

• Design and solve challenging STEM problems to probe the limitations of large language models.
• Create clear, high-quality, step-by-step solutions with well-articulated reasoning.
• Collaborate with LLM researchers to align problems with evaluation goals, especially in areas where models typically struggle (e.g., abstraction, multi-step reasoning, symbolic manipulation).
• Help define new evaluation benchmarks based on STEM curricula spanning early undergraduate to PhD-level topics.

REQUIREMENTS:

• Analytical Skills: Good research and analytical skills
• Feedback Skills: Ability to provide constructive feedback and detailed annotations.
• Creative Thinking: Creative and lateral thinking abilities.
• Communication: Excellent structured communication and collaboration skills in a remote setting.
• Independence: Self-motivated and able to work independently in a remote setting.
• Technical Setup: Desktop/Laptop set up with a good internet connection.

PREFERRED QUALIFICATION:

• Candidates currently pursuing a Master’s/Ph.D./Postdoctoral degree in STEM or a related field are eligible and encouraged to apply.
• Ability to analyze and solve complex STEM problems with a structured and logical approach.
• Ability to explain STEM concepts clearly using simple language, visuals, and simulations when needed.

• In this role, you will be working on projects to help fine-tune large language models (like ChatGPT) using your strong analytical and english comprehension skills.
• The ideal candidate should have a solid foundation in Physics/Chemistry/Mathematics or Biology (STEM), particularly at the level expected in college/engineering entrance exams, as well as graduate or PhD-level programs.
• You should be able to break down complex STEM concepts into simple, clear explanations and work efficiently.
• The projects will also help you learn how to leverage AI to be a better analyst. This is your chance to future-proof your career in an AI-first world!