Exam Developer at American Welding Society Inc

, , -

Full Time

Start Date

Immediate

Expiry Date

24 Aug, 26

Salary

100000.0

Posted On

26 May, 26

Experience

2 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Skills

Exam Development, Instructional Design, Psychometric Principles, Job Task Analysis, Item Writing, Standard Setting, Stakeholder Management, Data Analysis, Editorial Skills, Workshop Facilitation, Project Management, Quality Control

Industry

Non-profit Organizations

Description

Role Overview: • Job Title: Exam Developer • Education: Associate's degree required, Bachelor’s degree preferred • Location: Hybrid for candidates based in Miami, FL; Fully remote opportunity available for candidates located outside of Florida within the U.S. • Travel: Up to 15% (Primarily to our headquarters in Miami, FL) • Compensation: $70,000 – $100,000 USD annually (Final salary determined by experience, skills, and location) Position Summary: The primary responsibility of this role is to manage the full end-to-end exam lifecycle, driving data-driven performance analysis, continuous quality improvement, and full-scale test design. In this role, you are responsible for independently managing AWS certification exam item pools, maintaining existing exam content, and developing new certification offerings. A key focus is collaborating with and leading volunteer subject matter experts (SMEs), the Assessment Group, and the Qualification and Certification Exam Bank (QCEB) Committee to uphold the validity, reliability, and rigor of all exams. Core Responsibilities: • Execute End-to-End Certification Development: Manage and support the full lifecycle of exams, including design, implementation, delivery, and ongoing maintenance. • Facilitate Assessment Workshops: Partner with Subject Matter Experts (SMEs) on Job Task Analysis (JTA), Minimally Qualified Candidate (MQC) definition, item writing, technical review, and standard setting. • Drive Exam Quality & Relevance: Lead rigorous development of exam test specifications, item development, review, and refinement to ensure all assessment content is clear and aligned with standards. • Conduct Exam Performance Analysis: Perform routine exam and item analysis to assess quality, monitoring item-level statistics, content relevance, exam security, and quality control. • Implement Adjustments: Make necessary quality improvement updates and editorial/proofing adjustments throughout the product lifecycle. • Build Stakeholder Relationships: Cultivate strong working relationships with volunteer exam committee, SMEs, assessment vendors, and peer exam developers. Recruit, train, and engage volunteer subject matter experts in item writing work. • Manage Program Logistics: Manage development schedules, milestones, and SME participation or review statuses. • Maintain Artifacts: Manage documentation and process artifacts, ensuring strict version control for items and certification programs. • Support Growth: Contribute to the overall growth of the AWS certification program by consistently seeking efficient and effective process improvements. • Perform Other Duties as Assigned. Required Qualifications: • Professional Experience: Minimum 1 year of experience in certification, assessment development, or instructional design. • Foundational Knowledge: Solid understanding of certification design, item writing, validation processes, and basic psychometric principles. • Exam Development Familiarity: Exposure to the core steps of exam development (MQC definition, JTA, technical review, and standard setting). • Communication & Collaboration: Excellent verbal and written communication skills, with a proven ability to lead meetings/workshops and work effectively with technical SMEs and diverse stakeholders. • Professional Attributes: Strong problem-solving abilities, exceptional editorial skills, and uncompromising attention to detail. • Adaptability: Highly versatile, eager to learn continuously, and comfortable pivoting quickly from one project to the next. Preferred Experience: • Hands-on Facilitation: Direct experience actively facilitating SME workshops for JTAs, MQC definitions, or standard settings. • Data & Psychometrics: Experience using psychometric tools, data collection, or statistical analysis to evaluate project outcomes and exam validity. • Technical Familiarity: Proficiency in industry standards for test development and direct experience working with test delivery systems • Program Impact: Experience in making significant, measurable contributions to an established certification or assessment program. Employment Details: • Sponsorship: Not available. Applicants must be currently authorized to work in the US on a full-time basis. • Work Arrangement: This position is primarily remote with no regular in-office requirement. However, estimated travel of up to 15% to our headquarters in Miami, FL, or other locations will be required based on business needs (such as major workshops or events).

Responsibilities

Manage the end-to-end lifecycle of AWS certification exams, including design, implementation, and maintenance. Lead subject matter experts in developing test specifications and performing data-driven performance analysis to ensure exam validity.