Freelance Jobs, Openings, Vacancies in Overseas

Freelance Agent Evaluation Engineer at Mindrift

Busan, , South Korea - Full Time

Skills Needed
Python, Fastapi, Javascript, Typescript, React, Docker, Postgres, Kafka, Redis, Functional Testing, Integration Testing, Ai Evaluation

Specialization
Requires over 5 years of software development experience with a core stack including Python, JavaScript/TypeScript, and various infrastructure tools. Must have B2+ English proficiency and experience in functional and integration testing.

Experience Required
Minimum 5 year(s)

Freelance Agent Evaluation Engineer at Mindrift

Gdańsk, Pomeranian Voivodeship, Poland - Full Time

Skills Needed
Python, Fastapi, Javascript, Typescript, React, Docker, Postgres, Kafka, Redis, Functional Testing, Integration Testing, English Proficiency

Specialization
Requires over 5 years of software development experience with a core stack including Python, JavaScript/TypeScript, and various infrastructure tools. Must have strong experience in functional and integration testing and B2+ English proficiency.

Experience Required
Minimum 5 year(s)

Freelance Agent Evaluation Engineer at Mindrift

Wrocław, Lower Silesian Voivodeship, Poland - Full Time

Skills Needed
Python, Fastapi, Javascript, Typescript, React, Docker, Postgres, Kafka, Redis, Functional Testing, Integration Testing, English Proficiency

Specialization
Requires over 5 years of software development experience with a core stack including Python, JavaScript/TypeScript, and various infrastructure tools. Must have strong experience in functional and integration testing and B2+ English proficiency.

Experience Required
Minimum 5 year(s)

Freelance Agent Evaluation Engineer at Mindrift

, , South Korea - Full Time

Skills Needed
Python, Fastapi, Javascript, Typescript, React, Docker, Postgres, Kafka, Redis, Functional Testing, Integration Testing, Ai Evaluation

Experience Required
Minimum 5 year(s)

Freelance Agent Evaluation Engineer at Mindrift

Krakow, Lesser Poland Voivodeship, Poland - Full Time

Skills Needed
Python, Fastapi, Javascript, Typescript, React, Docker, Postgres, Kafka, Redis, Functional Testing, Integration Testing, English Proficiency

Specialization
Requires over 5 years of software development experience with a core stack including Python, JavaScript/TypeScript, and various infrastructure tools. Must have experience in functional and integration testing with B2+ English proficiency.

Experience Required
Minimum 5 year(s)

Freelance Agent Evaluation Engineer at Mindrift

Incheon, , South Korea - Full Time

Skills Needed
Python, Fastapi, Javascript, Typescript, React, Docker, Postgres, Kafka, Redis, Functional Testing, Integration Testing, English Proficiency

Specialization
Requires over 5 years of software development experience with a core stack including Python, JavaScript/TypeScript, and various infrastructure tools. Must have strong experience in functional and integration testing and B2+ English proficiency.

Experience Required
Minimum 5 year(s)

Freelance Agent Evaluation Engineer at Mindrift

, , Uruguay - Full Time

Skills Needed
Python, Fastapi, Javascript, Typescript, React, Docker, Postgres, Kafka, Redis, Functional Testing, Integration Testing, Ai Evaluation

Specialization
Requires over 5 years of software development experience with a core stack including Python, JavaScript/TypeScript, and various infrastructure tools. Must have strong English proficiency (B2+) and experience in functional and integration testing.

Experience Required
Minimum 5 year(s)

Freelance Agent Evaluation Engineer at Mindrift

, , Costa Rica - Full Time

Skills Needed
Python, Fastapi, Javascript, Typescript, React, Docker, Postgres, Kafka, Redis, Functional Testing, Integration Testing, Ai Evaluation

Specialization
Requires over 5 years of software development experience with a core stack including Python, JavaScript/TypeScript, and various infrastructure tools. Must have strong English proficiency (B2+) and experience in functional and integration testing.

Experience Required
Minimum 5 year(s)

Freelance Agent Evaluation Engineer at Mindrift

, , Colombia - Full Time

Skills Needed
Python, Fastapi, Javascript, Typescript, React, Docker, Postgres, Kafka, Redis, Functional Testing, Integration Testing, Ai Evaluation

Specialization
Requires over 5 years of software development experience with a core stack including Python, JavaScript/TypeScript, and various infrastructure tools. Must have strong English proficiency (B2+) and experience in functional and integration testing.

Experience Required
Minimum 5 year(s)

Freelance Agent Evaluation Engineer at Mindrift

, , Chile - Full Time

Skills Needed
Python, Fastapi, Javascript, Typescript, React, Docker, Postgres, Kafka, Redis, Functional Testing, Integration Testing, Ai Evaluation

Specialization
Requires over 5 years of software development experience with a core stack including Python, JavaScript/TypeScript, and various infrastructure tools. Must possess B2+ English proficiency and experience in functional and integration testing.

Experience Required
Minimum 5 year(s)

Freelance Agent Evaluation Engineer at Mindrift

Pune, maharashtra, India - Full Time

Skills Needed
Python, Fastapi, Javascript, Typescript, React, Docker, Postgres, Kafka, Redis, Functional Testing, Integration Testing, Ai Evaluation

Specialization
Requires over 5 years of software development experience with a core stack including Python, JavaScript/TypeScript, and various infrastructure tools. Candidates must have strong testing experience and English proficiency at a B2+ level.

Experience Required
Minimum 5 year(s)

Freelance Agent Evaluation Engineer at Mindrift

Chennai, tamil nadu, India - Full Time

Skills Needed
Python, Fastapi, Javascript, Typescript, React, Docker, Postgres, Kafka, Redis, Functional Testing, Integration Testing, Ai Evaluation

Specialization
Requires over 5 years of software development experience with a core stack including Python, JavaScript/TypeScript, and various infrastructure tools. Must have strong English proficiency (B2+) and experience in functional and integration testing.

Experience Required
Minimum 5 year(s)

Freelance Agent Evaluation Engineer at Mindrift

Yokohama, , Japan - Full Time

Skills Needed
Python, Fastapi, Javascript, Typescript, React, Docker, Postgres, Kafka, Redis, Functional Testing, Integration Testing, Ai Evaluation

Experience Required
Minimum 5 year(s)

Freelance Agent Evaluation Engineer at Mindrift

, , Japan - Full Time

Skills Needed
Python, Fastapi, Javascript, Typescript, React, Docker, Postgres, Kafka, Redis, Functional Testing, Integration Testing, Ai Evaluation

Specialization
Requires over 5 years of software development experience with a core stack including Python, JavaScript/TypeScript, and Docker. Must have B2+ English proficiency and experience in functional and integration testing.

Experience Required
Minimum 5 year(s)

Freelance Agent Evaluation Engineer at Mindrift

, , Mexico - Full Time

Skills Needed
Python, Fastapi, Javascript, Typescript, React, Docker, Postgres, Kafka, Redis, Functional Testing, Integration Testing, Ai Evaluation

Specialization
Requires over 5 years of software development experience with a core stack including Python, JavaScript/TypeScript, and various infrastructure tools. Must have strong English proficiency (B2+) and experience in functional and integration testing.

Experience Required
Minimum 5 year(s)

Freelance Agent Evaluation Engineer at Mindrift

, , Australia - Full Time

Skills Needed
Python, Fastapi, Pytest, React, Javascript, Typescript, Docker, Postgres, Kafka, Redis, Github Actions, Full Stack Development, Test Automation, Ai Evaluation, Linux, Async/Await

Specialization
Requires 5+ years of software development experience, primarily in Python and full-stack development with React. A degree in Computer Science or a related field and B2 English proficiency are preferred.

Experience Required
Minimum 5 year(s)

Freelance Agent Evaluation Engineer at Mindrift

, , Australia - Full Time

Skills Needed
Python, Fastapi, Pytest, React, Javascript, Typescript, Docker, Postgres, Kafka, Redis, Github Actions, Functional Testing, Integration Testing, Linux, Ai Evaluation, Software Engineering

Experience Required
Minimum 5 year(s)

Freelance Agent Evaluation Engineer at Mindrift

, Victoria, Australia - Full Time

Skills Needed
Python, Fastapi, Pytest, React, Javascript, Typescript, Docker, Postgres, Kafka, Redis, Github Actions, Test Automation, Full Stack Development, Linux, Ai Evaluation, Software Engineering

Experience Required
Minimum 5 year(s)

Freelance Agent Evaluation Engineer at Mindrift

Manchester, England, United Kingdom - Full Time

Specialization
Requires 5+ years of software development experience, primarily in Python and full-stack development with React. Candidates should be proficient in writing functional/integration tests and have a B2 level of English proficiency.

Experience Required
Minimum 5 year(s)

Freelance Agent Evaluation Engineer at Mindrift

, New South Wales, Australia - Full Time

Specialization
Requires 5+ years of software development experience, primarily in Python and full-stack development with React. Candidates should be proficient in Docker, CI/CD tools, and have a B2 level of English proficiency.

Experience Required
Minimum 5 year(s)

Freelance Agent Evaluation Engineer at Mindrift

Busan, , South Korea -

Full Time

Start Date

Immediate

Expiry Date

04 Oct, 26

Salary

50.0

Posted On

06 Jul, 26

Experience

5 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Skills

Python, FastAPI, JavaScript, TypeScript, React, Docker, Postgres, Kafka, Redis, Functional Testing, Integration Testing, AI Evaluation

Industry

technology;Information and Internet

Description

Please submit your CV in English and indicate your level of English proficiency. Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is project-based, not permanent employment. What this opportunity involves We're building a dataset to evaluate AI coding agents - how well a model handles real-world developer tasks. You'll create challenging tasks and evaluation criteria within realistic simulated environments: Build realistic developer environments - a virtual company with codebase, infrastructure, and context (tickets, docs, conversations) that forms a believable development history Design tasks from intermediate states of these environments - craft the prompt, define what "solved" means, and ensure the task is solvable by an AI agent Write tests that verify agent solutions - accept all valid approaches and reject incorrect ones, neither too strict nor too lenient Iterate on tasks and tests based on QA feedback - review agent solutions, analyze failures, and refine until the evaluation is fair and robust What this is NOT Not data labeling Not prompt engineering Not writing code from scratch - the agent writes most of the code; you guide and evaluate What we look for 5+ years in software development Core stack: Python (FastAPI), JavaScript/TypeScript (React), Docker, Postgres, Kafka, Redis Experience writing tests (functional, integration) English proficiency - B2+ Why this is hard Frontier models are already good at coding. Creating a task that genuinely challenges the best models is non-trivial. You need to deeply understand where models fail and what scenarios reveal the difference between a good and a bad solution. Tasks have many valid solutions - writing tests that accept all correct solutions and reject incorrect ones is harder than it sounds. How it works Apply → Pass qualification(s) → Join a project → Complete tasks → Get paid Effort estimate Tasks for this project are estimated to take 20 hours to complete, depending on complexity. This is an estimate and not a schedule requirement; you choose when and how to work. Tasks must be submitted by the deadline and meet the listed acceptance criteria to be accepted. Compensation Up to $50/hr equivalent, depending on level and pace. Tasks are estimated at ~20 hours each; you set your own schedule.

How To Apply:

Incase you would like to apply to this job directly from the source, please click here

Responsibilities

Create challenging tasks and evaluation criteria for AI coding agents within simulated developer environments. Write and iterate on tests to verify agent solutions and ensure robust evaluation.

Freelance Agent Evaluation Engineer at Mindrift

Busan, , South Korea - Full Time

Skills Needed
Python, Fastapi, Javascript, Typescript, React, Docker, Postgres, Kafka, Redis, Functional Testing, Integration Testing, Ai Evaluation

Experience Required
Minimum 5 year(s)

Freelance Agent Evaluation Engineer at Mindrift

Gdańsk, Pomeranian Voivodeship, Poland - Full Time

Skills Needed
Python, Fastapi, Javascript, Typescript, React, Docker, Postgres, Kafka, Redis, Functional Testing, Integration Testing, English Proficiency

Specialization
Requires over 5 years of software development experience with a core stack including Python, JavaScript/TypeScript, and various infrastructure tools. Must have strong experience in functional and integration testing and B2+ English proficiency.

Experience Required
Minimum 5 year(s)

Freelance Agent Evaluation Engineer at Mindrift

Wrocław, Lower Silesian Voivodeship, Poland - Full Time

Skills Needed
Python, Fastapi, Javascript, Typescript, React, Docker, Postgres, Kafka, Redis, Functional Testing, Integration Testing, English Proficiency

Specialization
Requires over 5 years of software development experience with a core stack including Python, JavaScript/TypeScript, and various infrastructure tools. Must have strong experience in functional and integration testing and B2+ English proficiency.

Experience Required
Minimum 5 year(s)

Freelance Agent Evaluation Engineer at Mindrift

, , South Korea - Full Time

Skills Needed
Python, Fastapi, Javascript, Typescript, React, Docker, Postgres, Kafka, Redis, Functional Testing, Integration Testing, Ai Evaluation

Experience Required
Minimum 5 year(s)

Freelance Agent Evaluation Engineer at Mindrift

Krakow, Lesser Poland Voivodeship, Poland - Full Time

Skills Needed
Python, Fastapi, Javascript, Typescript, React, Docker, Postgres, Kafka, Redis, Functional Testing, Integration Testing, English Proficiency

Specialization
Requires over 5 years of software development experience with a core stack including Python, JavaScript/TypeScript, and various infrastructure tools. Must have experience in functional and integration testing with B2+ English proficiency.

Experience Required
Minimum 5 year(s)

Freelance Agent Evaluation Engineer at Mindrift

Incheon, , South Korea - Full Time

Skills Needed
Python, Fastapi, Javascript, Typescript, React, Docker, Postgres, Kafka, Redis, Functional Testing, Integration Testing, English Proficiency

Specialization
Requires over 5 years of software development experience with a core stack including Python, JavaScript/TypeScript, and various infrastructure tools. Must have strong experience in functional and integration testing and B2+ English proficiency.

Experience Required
Minimum 5 year(s)

Freelance Agent Evaluation Engineer at Mindrift

, , Uruguay - Full Time

Skills Needed
Python, Fastapi, Javascript, Typescript, React, Docker, Postgres, Kafka, Redis, Functional Testing, Integration Testing, Ai Evaluation

Specialization
Requires over 5 years of software development experience with a core stack including Python, JavaScript/TypeScript, and various infrastructure tools. Must have strong English proficiency (B2+) and experience in functional and integration testing.

Experience Required
Minimum 5 year(s)

Freelance Agent Evaluation Engineer at Mindrift

, , Costa Rica - Full Time

Skills Needed
Python, Fastapi, Javascript, Typescript, React, Docker, Postgres, Kafka, Redis, Functional Testing, Integration Testing, Ai Evaluation

Specialization
Requires over 5 years of software development experience with a core stack including Python, JavaScript/TypeScript, and various infrastructure tools. Must have strong English proficiency (B2+) and experience in functional and integration testing.

Experience Required
Minimum 5 year(s)

Freelance Agent Evaluation Engineer at Mindrift

, , Colombia - Full Time

Skills Needed
Python, Fastapi, Javascript, Typescript, React, Docker, Postgres, Kafka, Redis, Functional Testing, Integration Testing, Ai Evaluation

Specialization
Requires over 5 years of software development experience with a core stack including Python, JavaScript/TypeScript, and various infrastructure tools. Must have strong English proficiency (B2+) and experience in functional and integration testing.

Experience Required
Minimum 5 year(s)

Freelance Agent Evaluation Engineer at Mindrift

, , Chile - Full Time

Skills Needed
Python, Fastapi, Javascript, Typescript, React, Docker, Postgres, Kafka, Redis, Functional Testing, Integration Testing, Ai Evaluation

Experience Required
Minimum 5 year(s)

Freelance Agent Evaluation Engineer at Mindrift

Pune, maharashtra, India - Full Time

Skills Needed
Python, Fastapi, Javascript, Typescript, React, Docker, Postgres, Kafka, Redis, Functional Testing, Integration Testing, Ai Evaluation

Experience Required
Minimum 5 year(s)

Freelance Agent Evaluation Engineer at Mindrift

Chennai, tamil nadu, India - Full Time

Skills Needed
Python, Fastapi, Javascript, Typescript, React, Docker, Postgres, Kafka, Redis, Functional Testing, Integration Testing, Ai Evaluation

Specialization
Requires over 5 years of software development experience with a core stack including Python, JavaScript/TypeScript, and various infrastructure tools. Must have strong English proficiency (B2+) and experience in functional and integration testing.

Experience Required
Minimum 5 year(s)

Freelance Agent Evaluation Engineer at Mindrift

Yokohama, , Japan - Full Time

Skills Needed
Python, Fastapi, Javascript, Typescript, React, Docker, Postgres, Kafka, Redis, Functional Testing, Integration Testing, Ai Evaluation

Experience Required
Minimum 5 year(s)

Freelance Agent Evaluation Engineer at Mindrift

, , Japan - Full Time

Skills Needed
Python, Fastapi, Javascript, Typescript, React, Docker, Postgres, Kafka, Redis, Functional Testing, Integration Testing, Ai Evaluation

Experience Required
Minimum 5 year(s)

Freelance Agent Evaluation Engineer at Mindrift

, , Mexico - Full Time

Skills Needed
Python, Fastapi, Javascript, Typescript, React, Docker, Postgres, Kafka, Redis, Functional Testing, Integration Testing, Ai Evaluation

Specialization
Requires over 5 years of software development experience with a core stack including Python, JavaScript/TypeScript, and various infrastructure tools. Must have strong English proficiency (B2+) and experience in functional and integration testing.

Experience Required
Minimum 5 year(s)

Freelance Agent Evaluation Engineer at Mindrift

, , Australia - Full Time

Skills Needed
Python, Fastapi, Pytest, React, Javascript, Typescript, Docker, Postgres, Kafka, Redis, Github Actions, Full Stack Development, Test Automation, Ai Evaluation, Linux, Async/Await

Experience Required
Minimum 5 year(s)

Freelance Agent Evaluation Engineer at Mindrift

, , Australia - Full Time

Experience Required
Minimum 5 year(s)

Freelance Agent Evaluation Engineer at Mindrift

, Victoria, Australia - Full Time

Experience Required
Minimum 5 year(s)

Freelance Agent Evaluation Engineer at Mindrift

Manchester, England, United Kingdom - Full Time

Experience Required
Minimum 5 year(s)

Freelance Agent Evaluation Engineer at Mindrift

, New South Wales, Australia - Full Time

Experience Required
Minimum 5 year(s)

Freelance Jobs overseas