AI Chatbot Evaluator (Small Business Owners) at Productive Playhouse

, , United States -

Full Time

Start Date

Immediate

Expiry Date

31 Jul, 26

Salary

375.0

Posted On

02 May, 26

Experience

0 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Skills

Attention to detail, Prompt engineering, Data collection, Chatbot evaluation, Communication, Technical documentation, Screenshot capture, English fluency

Industry

Information Services

Description

Location: Remote (United States-based only) Status: Project-based Pay: $375 USD for completing 4 tasks (~2–3 hours total) $100 USD for each additional task completed beyond the initial 4 Additional compensation may be provided based on total tasks completed Benefits: Flexible schedule Please note: To ensure eligibility for this project, applicants must currently reside in the United States and operate a small business with fewer than 10 employees. Project Requirements: Fluent in English (reading and writing) Must currently operate a small business (fewer than 10 employees) Must be based in the United States Strong attention to detail and ability to follow structured guidelines Comfortable using online tools and uploading screenshots With Productive Playhouse, contributors can earn extra income on a flexible schedule while supporting mobile messaging data collection efforts that help improve spam detection and reduce unwanted messages. The Project: We are seeking small business owners to participate in a short AI evaluation study. The task involves interacting with multiple chatbot platforms, entering prompts, reviewing responses, and completing a structured evaluation based on your experience. Some tasks may involve referencing your own business materials (e.g., documents or reports), which must be anonymized before use. All submissions will be reviewed and verified to ensure they meet quality standards before being approved for payment. This is a flexible, remote, task-based project. Workload is limited to a one-time engagement. To get started, please complete the short intake form below: 🔗 https://forms.gle/uypuS2Q63jjhPUm77 Please note: Completing the intake form is required for consideration. Qualified participants will receive next steps after review. Duties: Create prompts based on your business needs using provided guidelines Engage with multiple AI chatbot platforms Evaluate responses based on structured criteria Upload screenshots and complete evaluation forms Ensure all submissions are accurate and meet quality standards Engagement Requirements: Must use your own device and internet connection Must follow all project guidelines and quality standards Only completed and qualified submissions will be eligible for payment Must complete the task within the expected timeframe after onboarding A project-specific Google account will be provided; no personal account is required About Us: As a global data company, Productive Playhouse “PPH”, is pioneering our approach to language and data services, while incorporating their roots as a production company. Originally creating content to support children's language acquisition, our commitment to excellence, forward-thinking strategies, and world-wide cultural experience has proven key for delivering exceptional service. Originally founded as an educational production company, Productive Playhouse made a mark with our award winning children’s series, which taught fundamental subjects through engaging and effective programming. This early success paved the way for our evolution into a comprehensive data services provider. Since 2011, Productive Playhouse has expanded rapidly to offer an extensive suite of data services. Our current offerings include transcription, translation, linguistic analysis, rating, systems testing, localization, field and studio recording, language skill verification, and specialized data handling with a focus on sensitivity and diversity. Our commitment to innovation means we continually enhance our service portfolio to meet the evolving needs of our clients. At Productive Playhouse, we are proud of our reputation for addressing complex challenges with agility and delivering premium secure data solutions across diverse environments. Our dynamic team is dedicated to maintaining the highest standards and ensuring exceptional service every time. Disclaimer The job description provided is designed to convey information essential to understanding the scope of the position and the general nature of the work performed. It is not intended to be an exhaustive list of duties, responsibilities, or qualifications associated with the job. Productive Playhouse reserves the right to modify or revise the job description as necessary Productive Playhouse is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive work environment for all employees. Employment with Productive Playhouse is at-will, meaning that either the employee or the employer can terminate the employment relationship at any time, with or without cause or notice. All offers of employment at Productive Playhouse are contingent upon the candidate’s ability to provide valid documentation of identity and eligibility to work in the United States or relevant hiring location. Productive Playhouse participates in E-Verify. Productive Playhouse provides reasonable accommodation for qualified individuals with disabilities. If you need assistance or accommodation due to a disability, please contact the Human Resources Department.

Responsibilities

The evaluator will interact with various AI chatbot platforms to test responses and complete structured evaluations based on business needs. They are responsible for creating prompts, documenting findings with screenshots, and ensuring all submissions meet quality standards.