Public Sector Experience: 5 points

• ​5+ years of experience working with federal/provincial/broader public-sector healthcare providers
• ​Knowledge of Public Sector Enterprise Architecture artifacts (or similar), processes and practices, and ability to produce technical documentation that comply with industry standard practices
• ​In-depth knowledge of industry standard such as Project Management Institute (PMI) and Public Sector I&IT project management methodologies.
• ​Knowledge and experience with Public Sector Health related projects
• ​Knowledge and understanding of Ministry policy and IT project approval processes and requirements Public Sector Experience adopting and adhering to Public Sector Unified I&IT Project Methodology, Public Sector Enterprise Architecture and Public Sector Gating process, and OPS Standard Systems Development Methodologies
• Experience with large complex IT Health-related projects

QA and Systems Testing Knowledge and Experience: 45 points

• 7+ years of experience in the following:
• As a lead Systems Testing/QA Specialist for various streams of work, providing guidance and oversight to junior testers, and planning, organizing and implementing testing efforts (includes preparation of test plans and coordination of test execution)
• Knowledge and understanding of testing methods in an object-oriented environment
• All stages of system testing, including strategy, selection of testing tools, test planning, preparing test cases and test data, manual and automated test execution and defect logging and tracking
• Experience with a variety of testing systems, including clinical systems testing, mission critical systems testing, and testing high volume transactional systems in highly available environments
• Knowledge and experience of structured methodologies for the development, design, implementation, maintenance of applications
• Performing functional and non-functional system testing of the following: Commercial Off-the-Shelf (COTS) solutions including testing of patches, new releases, acceptance testing of enhancement request functionality for modules of the product and other enhancements, and regression testing for implementation; in house web applications; HL7-FHIR based webservices (RESTFUL/JSON/XML); Application Programming Interfaces (API); reporting solutions; integration components, extensions, and enhancements
• Performing testing of Security Components including use of SAML and JWT
• Creating complete system testing documentation and artefacts such as: test strategies, test plans, test use cases, test scripts
• Develop automated test scripts (using tools such as Selenium framework)
• API testing tools to query and test interfaces at the messaging layer
• Web service queries using tools such as Rational ClearQuest, SOAP-UI, POSTMAN or via Programming Languages
• Knowledge and experience with information retrieval packages, and data queries and ad-hoc queries (using SQL) and other query languages
• Performing Accessibility testing to websites, web content and mobile applications to conform to the World Wide Web Consortium Web Content Accessibility Guidelines (WCAG) 2.0
• Tools to support Web Accessibility testing in support of AODA legislation
• Test results reports, including performance and security testing results, for use in Defect Reviews with clients, partners and project team
• Business Intelligence (BI) solution to plan, prepare, and execute testing of BI solution, including data setup/integration and validating data in the BI solution accessed through predefined analytical reports, ad-hoc reporting tools and dashboards to ensure accuracy, completeness, and data integrity of the solution
• Validating successful deployment of releases in production environments, preparing reports on testing results
• Performing business scenarios and cross-system integration testing on Product Modules (e.g., Ontario Health Client Registry, Provider Registry and Audit Services)
• Reviewing and providing input to technical and business requirements from a testing perspective, including business intelligence solutions
• Executing automated tests scripts
• Knowledge and experience working in traditional and agile teams using standard and DevOps processes and tools
• Knowledge and experience using at least one programming language
• Knowledge and experience with all phases of the Systems Development Life Cycle (SDLC)
• Reviewing business and technical documentation from a testing perspective to identify issues early in the SDLC
• Knowledge and understanding of Information Management principles, concepts, policies and practices

10+ years of experience with:

• ​Identifying and documenting issues and risks
• ​Creating and maintaining defect logs and defect summary reports (using tools such as Jira or Confluence, Test rail)
• ​Updating tasks and project status
• ​Participating in QA and cross functional team meetings
• ​Prioritizing test execution based on business priority, defect patterns, and available testing time
• ​Dealing creatively with problems stemming from shared resources, such as test environments and test data
• ​Actively participating in walkthroughs and triage sessions

​General Skills: 15 points

• ​Proven technical leadership skills, with ability to identify areas for improvement, and recommend solutions
• Exceptional analytical, problem solving and decision-making skills
• ​Demonstrated strong interpersonal, verbal and written communication, and presentation skills
• ​Proven troubleshooting and critical thinking experience
• ​Demonstrated ability to apply strong listening skills to facilitate issue resolution
• ​Effective consulting skills to engage with all stakeholders with proven track record for building strong working relationships
• ​Excellent customer service skills, including tact and diplomacy to ensure client needs are managed effectively
• A motivated, flexible, detail-oriented and creative team player with perseverance, excellent organization and multi-tasking abilities, and a proven track record for meeting strict deadlines

RESPONSIBILITIES:

• Perform functional and non-functional system testing of Panorama’s Immunization Module, Inventory Module and extension applications, enhancements, defect resolutions, etc.)
• Provide ongoing testing for the routine and incident management of DHIR /Panorama & extensions:
• ICON (Immunization Connect Ontario),
• Immunization Forecaster
• m-IMMS (Mobile Immunizations),
• Student Information Exchange (STIX),
• Public Health Information Exchange (PHIX),
• Immunization Reconciliation Tool (IRT),
• Panorama Enhanced Analytic Reporting (PEAR)
• Test bug fixes in reporting as per defects found by business and as per Panorama critical changes
• Create complete system testing documentation and artefacts, including test plans, test cases, test scripts, automated test scripts, test results reports, defect logs for the Immunization Module, and associated business objects and Cognos reports
• Transform functional, business, and system knowledge into effective test case planning and execution.
• Create test data according to the test plan; analyze testing results and retesting until expected results are obtained; perform reviews with users and ensures client acceptability levels are met (e.g. participating in walk throughs); recommend changes to ensure acceptable testing results; retest all criteria in a live environment and recommend user sign off for implementation.
• Work closely with developers, architects, product owners, and others in establishing effective test plans based on feature documentation.
• Apply QA and technical expertise and engage other expertise to track and resolve testing and production issues and other IT related problems with quality deficiencies and maintain client service integrity.
  Skills
  Experience and Skill Set Requirements

Public Sector Experience: 5 points

• ​5+ years of experience working with federal/provincial/broader public-sector healthcare providers
• ​Knowledge of Public Sector Enterprise Architecture artifacts (or similar), processes and practices, and ability to produce technical documentation that comply with industry standard practices
• ​In-depth knowledge of industry standard such as Project Management Institute (PMI) and Public Sector I&IT project management methodologies.
• ​Knowledge and experience with Public Sector Health related projects
• ​Knowledge and understanding of Ministry policy and IT project approval processes and requirements Public Sector Experience adopting and adhering to Public Sector Unified I&IT Project Methodology, Public Sector Enterprise Architecture and Public Sector Gating process, and OPS Standard Systems Development Methodologies
• Experience with large complex IT Health-related projects.

QA and Systems Testing Knowledge and Experience: 45 points

• 7+ years of experience in the following:
• As a lead Systems Testing/QA Specialist for various streams of work, providing guidance and oversight to junior testers, and planning, organizing and implementing testing efforts (includes preparation of test plans and coordination of test execution)
• Knowledge and understanding of testing methods in an object-oriented environment
• All stages of system testing, including strategy, selection of testing tools, test planning, preparing test cases and test data, manual and automated test execution and defect logging and tracking
• Experience with a variety of testing systems, including clinical systems testing, mission critical systems testing, and testing high volume transactional systems in highly available environments
• Knowledge and experience of structured methodologies for the development, design, implementation, maintenance of applications
• Performing functional and non-functional system testing of the following: Commercial Off-the-Shelf (COTS) solutions including testing of patches, new releases, acceptance testing of enhancement request functionality for modules of the product and other enhancements, and regression testing for implementation; in house web applications; HL7-FHIR based webservices (RESTFUL/JSON/XML); Application Programming Interfaces (API); reporting solutions; integration components, extensions, and enhancements
• Performing testing of Security Components including use of SAML and JWT
• Creating complete system testing documentation and artefacts such as: test strategies, test plans, test use cases, test scripts
• Develop automated test scripts (using tools such as Selenium framework)
• API testing tools to query and test interfaces at the messaging layer
• Web service queries using tools such as Rational ClearQuest, SOAP-UI, POSTMAN or via Programming Languages
• Knowledge and experience with information retrieval packages, and data queries and ad-hoc queries (using SQL) and other query languages
• Performing Accessibility testing to websites, web content and mobile applications to conform to the World Wide Web Consortium Web Content Accessibility Guidelines (WCAG) 2.0
• Tools to support Web Accessibility testing in support of AODA legislation
• Test results reports, including performance and security testing results, for use in Defect Reviews with clients, partners and project team
• Business Intelligence (BI) solution to plan, prepare, and execute testing of BI solution, including data setup/integration and validating data in the BI solution accessed through predefined analytical reports, ad-hoc reporting tools and dashboards to ensure accuracy, completeness, and data integrity of the solution
• Validating successful deployment of releases in production environments, preparing reports on testing results
• Performing business scenarios and cross-system integration testing on Product Modules (e.g., Ontario Health Client Registry, Provider Registry and Audit Services)
• Reviewing and providing input to technical and business requirements from a testing perspective, including business intelligence solutions
• Executing automated tests scripts
• Knowledge and experience working in traditional and agile teams using standard and DevOps processes and tools
• Knowledge and experience using at least one programming language
• Knowledge and experience with all phases of the Systems Development Life Cycle (SDLC)
• Reviewing business and technical documentation from a testing perspective to identify issues early in the SDLC
• Knowledge and understanding of Information Management principles, concepts, policies and practices.

Logging, Tracking and Defect Reporting: 35 points

10+ years of experience with:

• ​Identifying and documenting issues and risks
• ​Creating and maintaining defect logs and defect summary reports (using tools such as Jira or Confluence, Test rail)
• ​Updating tasks and project status
• ​Participating in QA and cross functional team meetings
• ​Prioritizing test execution based on business priority, defect patterns, and available testing time
• ​Dealing creatively with problems stemming from shared resources, such as test environments and test data
• ​Actively participating in walkthroughs and triage sessions.

​General Skills: 15 points

• ​Proven technical leadership skills, with ability to identify areas for improvement, and recommend solutions
• Exceptional analytical, problem solving and decision-making skills
• ​Demonstrated strong interpersonal, verbal and written communication, and presentation skills
• ​Proven troubleshooting and critical thinking experience
• ​Demonstrated ability to apply strong listening skills to facilitate issue resolution
• ​Effective consulting skills to engage with all stakeholders with proven track record for building strong working relationships
• ​Excellent customer service skills, including tact and diplomacy to ensure client needs are managed effectively
• A motivated, flexible, detail-oriented and creative team player with perseverance, excellent organization and multi-tasking abilities, and a proven track record for meeting strict deadlines.