Training Evaluator - ANALYST IV - Denver - Hybrid

at  State of Colorado Job Opportunities

MINIMUM QUALIFICATIONS, SUBSTITUTIONS, CONDITIONS OF EMPLOYMENT & APPEAL RIGHTS

Applicants must meet the minimum qualifications listed below to continue in the selection process for this position. Work experience must be specifically documented on your application. Do not use “see resume” or “see attached” statements on your application.
Minimum Qualifications

Experience:

• Seven (7) years of professional experience in an occupational field related to the work assigned to the position.

Substitutions:

• Bachelor’s degree from an accredited institution in a field of study related to the work assignment.

And

• Three (3) years of professional experience in an occupational field related to the work assigned to the position.

Strongly Preferred:

• Specializes in Kirkpatrick or other evidence-based Training Model.

Conditions of Employment:

• Standard Background ALL CDHS employees (non-direct contact): CBI name check, ICON Colorado court database, Medicare fraud database, Reference checks, Professional License verification (licensure requirements), and drug screen (commercial Driver’s license).
• Travel - Occasional in-state and out-of-state travel is required.
• Preferred Qualifications - Specializes in Kirkpatrick or other evidence-based Training Model.
• Former State employees who were disciplinarily terminated or resigned in lieu of termination must (1) disclose that information on the application (2) provide an explanation why the prior termination or resignation should not disqualify the applicant from the current position, (3) provide the employee number from the applicant’s prior State employment. Absent extraordinary circumstances, prior disciplinary termination or resignation in lieu of termination and failure to provide this information will disqualify the applicant from future State employment with CDHS.

ABOUT US:

If your goal is to build a career that makes a difference, consider joining the dedicated people of the Colorado Department of Human Services(CDHS). Our professionals strive to design and deliver high quality human and health services that improve the safety, independence, and well-being of the people of Colorado. In addition to a great location and rewarding and meaningful work, we offer:

• Strong, secure, yet flexible retirement benefits including a PERA Defined Benefit Plan or PERA Defined Contribution Plan www.copera.org plus 401(k) and 457 plans
• Medical and dental health plans
• Employer supplemented Health Savings Account
• Paid life insurance
• Short- and long-term disability coverage
• 11 paid holidays per year plus vacation and sick leave
• BenefitHub state employee discount program
• Employee Wellness program MotivateMe
• Excellent work-life programs, such as flexible schedules, training and more
• Remote work arrangements for eligible positions
• Some positions may qualify for the Public Service Loan Forgiveness Program. For more

information, go to https://www.colorado.gov/pacific/dhr/student-loan-forgiveness-programs.

Evaluation Program Management and Analysis of SDD Performance. The position has been designated by management as the authority for training performance interpretation and research strategies that drive SDD reporting, evaluation methodologies, and data interpretation necessary to ensure compliance with Federal and State training standards. The position provides essential guidance to management for measuring and understanding SDD program performance, training performance, and for strategizing and organizing performance improvement. Sets SDD training goals based on available data, statutory requirements, leadership priorities, and program priorities. Evaluates and interprets data on the training performance of the SDD and of the 64 county departments that administer the TANF, Adult Financial, SNAP, Medical Assistance, and other programs. Interpret training data to identify exceptional and poor performance among the counties, as well as the causes and possible solutions. Monitor performance outcomes necessary to comply with federal regulations. Implement training strategies to improve performance outcomes at the state and county levels.

• Lead data collection, evaluation, and analysis efforts for training.
• Provide high-level written material relating to county performance to internal and external stakeholders, federal partners, and for potential legislative inquiries for training purposes.
• Work with counties to evaluate and interpret training data to identify root causes impacting training performance; in collaboration, develop training strategies to address areas that do not meet expectations.
• Clean, prepare, and analyze training data.
• Advise counties on training evaluation projects.
• Contribute to monthly report preparation by interpreting data for assigned measures, and completing Action Items related to responsibilities for training.
• Communicate training strategic performance analysis in internally- and externally-facing meetings.
• This position must work closely and be able to communicate clearly with technical data staff.
• This position must ensure the accuracy and integrity of training data used to make decisions or reported to external partners

Evaluation Program Management and Analysis of SDD Performance. The position has been designated by management as the authority for training performance interpretation and research strategies that drive SDD reporting, evaluation methodologies, and data interpretation necessary to ensure compliance with Federal and State training standards. The position provides essential guidance to management for measuring and understanding SDD program performance, training performance, and for strategizing and organizing performance improvement. Sets SDD training goals based on available data, statutory requirements, leadership priorities, and program priorities. Evaluates and interprets data on the training performance of the SDD and of the 64 county departments that administer the TANF, Adult Financial, SNAP, Medical Assistance, and other programs. Interpret training data to identify exceptional and poor performance among the counties, as well as the causes and possible solutions. Monitor performance outcomes necessary to comply with federal regulations. Implement training strategies to improve performance outcomes at the state and county levels.

• Lead data collection, evaluation, and analysis efforts for training.
• Provide high-level written material relating to county performance to internal and external stakeholders, federal partners, and for potential legislative inquiries for training purposes.
• Work with counties to evaluate and interpret training data to identify root causes impacting training performance; in collaboration, develop training strategies to address areas that do not meet expectations.
• Clean, prepare, and analyze training data.
• Advise counties on training evaluation projects.
• Contribute to monthly report preparation by interpreting data for assigned measures, and completing Action Items related to responsibilities for training.
• Communicate training strategic performance analysis in internally- and externally-facing meetings.
• This position must work closely and be able to communicate clearly with technical data staff.
• This position must ensure the accuracy and integrity of training data used to make decisions or reported to external partners.

Guide and Direct Training Research and Evaluation Program. Establish a research and evaluation agenda to support the PMD and SDD’s goals. Encourage innovation, integrity, and effectiveness across the SDD’s trainings and activities. Integrate learnings from research projects and other projects nation-wide, into SDD practices and policies. Expand evaluation capacity through partnerships, including contracts with external research organizations, counties, and other government agencies. Oversee external contracts and projects as needed. Conduct research to evaluate the effectiveness of service delivery and recommend policy and practice changes to training performance and participant outcomes.

• Design evaluation materials (e.g., surveys, evaluation plans, logic models) and methods for trainings and programs across the SDD.
• Increase accessibility of training data for analysis and decision-making.
• Share national and independent research pertinent to performance and improved outcomes to internal and external stakeholders, including federal partners.
• Interpret and implement best practices based on national research and policy initiatives.
• Interpret data to evaluate impact of strategies.
• Interpret existing evaluation initiatives in other states and potential application in Colorado.
• This position requires the ability to firmly support decisions and recommendations with data and reasoning.
• This position must be able to communicate the interpretation of data to support program initiatives.
• This position must interpret federal and state rules accurately and translate requirements to practice.

Report Preparation and Follow-up. Decisions determined by this position will drive the direction for performance improvements in human services programs within all 62 counties. Aid in the preparation for monthly reports and meetings by meeting with training staff, obtaining and reviewing data, preparing evaluative notes, completing action item response plans, and ensuring any prep documents are submitted by required deadlines. Ensure accuracy of data analysis and related materials. Work with Department and County staff on a frequent and recurring basis to develop a thorough understanding of levers that impact performance measures and mechanisms for collecting data on the levers and the measures. Conduct critical analysis such as identifying patterns in the data and the underlying causes to observed changes in the data. Identify key questions to be asked to drive performance improvement. Develop and support new metrics and methodology.

• Recommend, design, and develop new metrics.
• Validate data and trends shared in monthly meetings and reports; interpret impact on training and program outcomes.
• Pull necessary and meaningful data; share interpretations to validate perspectives shared in prep notes and in developing new strategies.
• Identify key issues preventing the SDD from making progress towards its goals.
• Interpret monthly data; develop action item resolutions.
• This position must interpret internal data to drive internal strategy, but must also interpret external data tied to performance metrics.

Develop Relationships and Maintain Program Expertise. The position communicates with the 64 counties on the impact of their interpreted training data to the SDD’s overall performance and determines resolutions to be enacted. Establish and maintain effective working relationships with CDHS, HCPF and OIT staff at the Office, Division, and program area levels. Establish and maintain effective working relationships with county leadership and training staff. Represent the SDD and the Departments nationally by presenting research and working with other state and federal training experts on improving services, efficiency, and outcomes. Work closely with county human services leaders to address specific questions and provide guidance. Organize communication to counties around state-wide projects and opportunities, including written communications and presentations at statewide administrators’ meetings. May include some overnight visits within the state and to other states. This position represents the PMD and SDD at internal and external meetings. This position shares data openly and appropriately and provides technical assistance for interpreting and using data.

Other Duties as Assigned.

• Being available to PMD Director, SDD Director, and Performance Analysts to help as needed.
• Support programs and provide training regarding performance management or RDMS.
• Supports Performance Management and SDD ad hoc requests and projects.