Consultancy for Conducting Item Response Theory (IRT) Analysis at Save the Children International

Bangkok, , Thailand -

Full Time

Start Date

Immediate

Expiry Date

30 Apr, 26

Salary

0.0

Posted On

30 Jan, 26

Experience

5 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Skills

Item Response Theory, Psychometrics, Statistical Software, Data Analysis, Education Assessment, Report Writing, Data Visualization, Rasch Analysis, Correlational Analysis, Proficiency Standards, Global Proficiency Framework, Literacy, Numeracy, Data Handling, Model Fit Evaluation, Feedback Incorporation

Industry

Non-profit Organizations

Description

2. Objectives of the Consultancy The primary objective of this consultancy is to: Conduct an Item Response Theory (IRT) analysis on the 2024 Learning Assessment datasets and generate psychometrically sound scaled scores and item-level statistics to determine student proficiency thresholds in alignment with the proficiency standards of the Global Proficiency Framework (GPF); Utilise IRT-scaled scores and conduct the correlational (bivariate) analysis between learning performance and school/student demographic factors such as gender, socioeconomic status, school location. Integrate the IRT and correlational analysis results (graphs, tables, interpretations) into the overall 2024 Learning Assessment Report and the eight partner-specific reports, ensuring coherence and clarity; To assess the degree of comparability between the 2022 baseline learning assessment and the 2024 assessment, and to conduct comparative analyses where feasible. Finalise the overall assessment report and eight partner-specific reports based on feedback from the Senior Management Team and the SPEL Department. 3. Expected Deliverables and Duration Deliverables Description Duration 1. Initial Review - Review the 2024 Learning Assessment design, sampling framework, and data collection tools (literacy and numeracy). - Review the existing datasets and the first draft of the overall and partner-specific reports. - Identify any gaps or inconsistencies relevant to IRT analysis (e.g., coding structure, missing data, scoring schemes). 2 days 2. Prepare the Datasets for IRT modeling and Conduct IRT Analysis - Prepare datasets for IRT modeling, including item recoding, missing data handling, and variable formatting. - Ensure data is structured for Rasch or 2PL/3PL model processing using appropriate statistical software (e.g., R, Stata, or Winsteps). - Conduct estimation of item difficulty, discrimination, and ability parameters, and evaluate model fit, reliability, and person–item interactions. 4 days 4. Generate Analysis Outputs and Interpretation - Produce IRT analysis outputs including: o Item–person map (Wright map) o Mean scaled scores by grade, gender, and partner to determine student proficiency thresholds in alignment with the proficiency standards of the Global Proficiency Framework (GPF) (graphs, tables, interpretations) o Correlational analysis results (graphs, tables, interpretations) o Comparative analysis between the 2022 baseline learning assessment and the 2024 assessment - Interpret results to show trends in proficiency levels, item difficulty hierarchy, and partner comparisons. 4 days 5. Editing and Integration into Reports - Revise the Overall Learning Assessment Report and eight partner-specific reports by incorporating IRT findings, graphs, and interpretations. - Ensure consistency between narrative sections, tables, and annexed analysis outputs. - Improve clarity, formatting, and coherence of analytical sections where necessary. 5 days 6. Feedback Incorporation and Reports Finalisation - Present key findings and draft revised reports to the Senior Management Team (SMT). - Incorporate feedback and finalise all deliverables (overall and partner reports, analysis annexes, and clean datasets). 2 days 4. Timeframe The consultancy is expected to be completed within 17 working days by beginning of March 2026, including feedback incorporation and final submission. The exact duration and level of effort may be further discussed and agreed upon during the contract agreement stage, subject to mutual agreement. Total days of work: 17 days -Estimated Commencement Date: 11 February 2026 -Estimated End Date: 6 March 2026 5. Reporting The consultant will report directly to the SPEL Director, with the EIM Manager copied. The SPEL department will provide access to datasets, existing reports, and assessment tools as well as necessary explanations on the learning assessment survey process. 6. Location and official travel involved The consultant will work remotely for all consultation meetings and deliverables. 7. Experience and skill set required • Advanced degree (Master’s or PhD) in Education Measurement, Statistics, Psychometrics, or Quantitative Social Science. • Proven experience (minimum 5 years) conducting Item Response Theory (IRT) or Rasch analysis for education assessments. • Strong proficiency in statistical software for IRT (R, ACER ConQuest, Stata, Winsteps, IRTPRO, or equivalent). • Experience in education sector assessments, preferably early grade literacy and numeracy as well as experience in applying the Global Proficiency Framework (GPF) • Excellent report-writing and data visualisation skills. 8. Payment Schedule Total cost payable within 30 days of satisfactory completion of deliverables, according to the following schedule. Please propose the budget proposal in lumpsum with a breakdown for the daily rate consultant(s), including the travel and accommodations. • 30% upon submission of inception summary and contract signing; • 40% upon submission of IRT analysis results and draft revised reports; • 30% upon submission and approval of final deliverables. 9. Payment Conditions • Any revenue occurring in Thailand is subject to withholding tax. If you are a Thai citizen, and or having a Thai work permit and or residing for over 180 days, then a 3% withholding tax will be applied. • If not, a 15% withholding tax will be applied for a non-Thai citizen, residing in Thailand less than 180 days. • If you are using an international bank account (apart from Thai and Myanmar), no withholding tax deduction will be applied, and you will be responsible for any applicable tax in your own country. • Any transfer from USD to THB and or MMK will use the exchange rate from our system on the transfer date. 10. Ethical Considerations and Data Confidentiality The consultant must maintain ethical standards and data confidentiality. All data and reports remain the property of our program and cannot be shared or published without written consent. 11. Application Process • Interested and qualified individuals are requested to send, by 2 February 2026 at 17:00 hrs, a Technical Proposal, including their Curriculum Vitae and a Financial Proposal to pariyaporn.lertvanichsutha@savethechildren.org. • The subject of the email should be “Consultancy for Learning Assessment IRT Analysis and Reporting” with your fully work-related reference documentations. • Applicants are also requested to mention in the applications if there are blood/marriage relationships with the existing employees. No requirement of photo or copy of certificates, and only short-listed candidates will be contacted. The Organization We employ approximately 25,000 people across the globe and work on the ground in over 100 countries to help children affected by crises, or those that need better healthcare, education and child protection. We also campaign and advocate at the highest levels to realise the right of children and to ensure their voices are heard. We are working towards three breakthroughs in how the world treats children by 2030: · No child dies from preventable causes before their 5th birthday · All children learn from a quality basic education and that, · Violence against children is no longer tolerated We know that great people make a great organization, and that our employees play a crucial role in helping us achieve our ambitions for children.We value our people and offer a meaningful and rewarding career, along with a collaborative and inclusive workplace where ambition, creativity, and integrity are highly valued. Application Information: Please apply using a cover letter and up-to-date CV as a single document. Please also include details of your current remuneration and salary expectations. A copy of the full role profile can be found at www.savethechildren.net/jobs We need to keep children safe so our selection process reflects our commitment to the protection of children from abuse.

Responsibilities

The consultant will conduct an Item Response Theory (IRT) analysis on the 2024 Learning Assessment datasets and generate psychometrically sound scaled scores. They will also integrate analysis results into the overall assessment report and partner-specific reports.