JOB SUMMARY:

The Assessment Program Supervisor is responsible for managing the assessment program to generate and optimally utilize assessment data at the Kaiser Permanente Bernard J. Tyson School of Medicine (KPSOM). This includes informing decisions about student achievement, supporting students in their academic progress, and providing insights into curriculum and assessment strengths and gaps to faculty, administrators, and students. This role trains faculty on assessment data, conduct analysis, promotes equity, inclusion and diversity in the assessment program and support educational scholarship This role will interface with Information Technology(IT) in the design and maintenance of analytics to support assessment-related efforts.

BASIC QUALIFICATIONS:

Experience

• Minimum three (3) years of experience in education, preferably in medical, health professions, or higher education
• Minimum two (2) years of experience in assessment principles/methods and educational measurement techniques including formative and summative assessments, and quantitative and qualitative approaches
• Minimum two (2) year of experience in a leadership role with or without direct reports

Education

• Bachelors degree in education related area OR four (4) years of experience in a directly related field.
• High School Diploma or General Education Development (GED) required.

License, Certification, Registration

• N/A

ADDITIONAL REQUIREMENTS:

• Experience in student performance and other data sets appropriate for historical and comparative analyses in program evaluation and medical education research projects
• Basic understanding of psychometric properties in educational assessments
• Familiar with curriculum development or academic administration, preferably in medical or health professions education
• Experience in using educational technology and/or assessment software
• Advanced proficiency in Excel, Word, PowerPoint, and other Microsoft suite tools
• Experience with statistical software packages (SAS, SPSS, STAT, R Programming Language), preferred
• Experience with data collection tools and survey platforms (Qualtrics, Survey Monkey, MedOasis, E*Value, MedHub, Explorance Blue)
• Experience with writing technical reports, including results of qualitative and quantitative analyses
• Experience with internet-based communication and collaboration platforms (e.g., MS Teams, Zoom, GoToMeeting, WebEx, Skype, etc.)
• Ability to apply qualitative analysis principles (e.g., inductive and deductive coding approaches, constant comparative method, etc.)
• Knowledge of database architecture principles
• Knowledge of current and emerging trends in medical education, preferred
• Demonstrated skill in training adults
• Service-oriented in support of faculty, staff, and students
• Strong written, verbal, presentation, and interpersonal skills
• Organized self-starter, with strong time management skills, detail oriented
• Ability to manage competing priorities in a fast-paced environment
• Analytical decision-making skills required to complete activities/tasks with minimal supervision
• Ability to become familiar with new topics quickly and meet challenging deadlines amidst multiple priorities. Orientation to collaborating with others and synthesizing information from multiple interested parties into a coherent work product.

PREFERRED QUALIFICATIONS:

• Five (5) years of program assessment and process improvement experience, preferably in medical education, health professions, higher education, or social sciences.
• Masters degree in Education or related field, preferred.
  PrimaryLocation : California,Pasadena,Green Street/IDS
  HoursPerWeek : 40
  Shift : Day
  Workdays : Mon, Tue, Wed, Thu, Fri
  WorkingHoursStart : 08:00 AM
  WorkingHoursEnd : 05:00 PM
  Job Schedule : Full-time
  Job Type : Standard
  Employee Status : Regular
  Employee Group/Union Affiliation : NUE-PO-01|NUE|Non Union Employee
  Job Level : Individual Contributor
  Job Category : Education / Training,School of Medicine,Education & Training
  Department : SCHOOL OF MEDICINE - Assessment and Evaluation - 9201
  Travel : Yes, 10 % of the Time
  Kaiser Permanente is an equal opportunity employer committed to fair, respectful, and inclusive workplaces. Applicants will be considered for employment without regard to race, religion, sex, age, national origin, disability, veteran status, or any other protected characteristic or status

• Provide support for faculty development through assessment data interpretation and utilizing assessment data and dashboards in the Curriculum as a Whole review, Phase Reviews, and other curricular evaluation efforts
• Coordinate and execute Competency Committee Review Processes for each Phase, including faculty development, data preparation and presentation, process review, and meeting facilitation
• In collaboration with IT, contribute to the ongoing development and maintenance of assessment related dashboards, including ensuring the creation and integrity of data flowing into the system from the Learning Management System (LMS) and other sources, and participating in the design of new dashboards and enhancements to the existing system
• Provide staff and faculty development to support the creation of accurate and aligned assessment data
• Researches and monitors trends in health professions and medical education assessment design and methodologies, and communicates findings to the Office of Assessment and Evaluation (OAE) leadership.
• Monitor project plan execution, addressing barriers and collaborating with OAE leadership to ensure necessary resources and timely completion, escalating concerns as needed
• Collaborate on the writing and production of the Medical Student Performance Evaluation letters (MSPE) and ensure effective project management
• Manage OAE support for National Board of Medical Examiners (NBME) products, including exams, testing blueprints, conduct web-based item review meetings with faculty, and inform course reviews process
• Oversee the preparation and provision of assessment data for reviews of courses, Phases and the Curriculum as a Whole
• Conduct analyses of assessment data as directed by OAE leadership for equity, validity, reliability, time trends, and curricular evaluation
• Coordinate and present student performance data, analyses, and visualizations for various academic and oversight teams, committees, and curricular governance bodies
• Oversee the timely in-house cataloguing and analysis of NBME score reports and annual summaries, and the uploading of NBME program level assessment data into the Learning Management System
• Ensure data management systems comply with regulatory requirements and institutional data governance guidelines
• Provide consultation and support as able to Objective Structured Clinical Examination (OSCE) assessment system and data analysis
• Supervises and coordinates daily activities of designated work team by monitoring the execution and completion of action items and work assignments; ensures all policies and procedures are followed.
• Aligns team efforts and standards, and measures progress in achieving results; determines and carries out processes and methodologies; resolves escalated issues as appropriate.
• Solicits and acts on performance feedback; provides team members with feedback; and mentors and coaches to drive performance improvement
• Pursues professional growth; provides training and development to talent for growth opportunities; supports execution of performance management guidelines and expectations. Implements, adapts, and stays up to date with organizational change, challenges, feedback, best practices, and processes.
• Participates in curriculum and planning meetings, as needed, presenting relevant assessment data
• Serve on other KPSOM workgroups and committees