Data Engineer

at  Covenant House Toronto

QUALIFICATIONS / EXPERIENCE

• Bachelor’s degree or College Diploma in Computer Science/Math/Engineering.
• Minimum of 5 years of relevant experience in a similar role.
• Strong understanding of data warehouse best practices, data governance, data modeling, and data architecture.
• Advanced knowledge in python scripts and SQL scripts.
• Advanced knowledge with Microsoft SQL Server SSIS Package, Stored Procedures, or other ETL tools like Azure Data Factory, Snowflake.
• Advanced SQL skills, including experience Data Warehouse ETL, running and writing queries and stored procedures, performing inserts and updates.
• Experience implementing data governance principles and experience implementing security measures to protect sensitive data.
• Experience in project management, including task prioritization, time management, and delivering projects within deadline and within the budget working through cross-functional teams.
• Experience working with CRM and marketing data required.

PURPOSE OF THE POSITION:

The Data Engineer is responsible for the development and management of Covenant House Toronto’s Data Warehouse that is essential to the day-to-day tactical planning and the longer-term investment planning of the Development and Communications Department.
The Data Engineer develops and maintains the data warehouse architecture frameworks, standards, and principles within the CRM, marketing automation and the data integration software and tools that extract key data from internal and external business systems and transforms and loads it to our data warehouse and data analytics environment.
Working with cross-functional teams this position is responsible for developing the data architecture, models and integration services that provide the capability to view and analyze CRM data and other marketing data from the Data Warehouse. The individual will interact effectively with business owners, data analyst, and other teams within the department to bring new features and platform enhancements from conception to release by following best practices in data governance, communicating, documenting, and interacting effectively with both technical and non-technical professionals.

DUTIES / RESPONSIBILITIES:

• Define and implement data architectures that align with business requirements to support on premise CRM and Marketing Automation.
• Develop and maintain data models, ensuring they support scalability, performance, and data integrity both on premise and on cloud.
• Develop data architecture, models and integration services that provide a cross-cutting view of data from our Data Warehouse.
• Create and maintain ETL Data Warehouse, SSIS Package on premise and on cloud.
• Ensure ETL pipelines are produced with the highest quality standards, metadata and validated for completeness and accuracy.
• Managing schema changes and ensuring data consistency.
• Implement Event Handlers in managing various events in the ETL process.
• Create and maintain secured data connectivity via REST API to Engaging Networks, Payment Gateway (iATS), AKA Raisin and Canada Post.
• Keep up with the technology trend of Data Warehouse, Marketing Automation, Data Integration, Data Visualization and Analytics.
• Responsible for the completion of high quality, well designed, and well tested data ETL pipelines (data streams) which tailored to marketing and CRM needs.
• Establish quality assurance and data integrity checks to ensure accurate reporting and data records.
• Implementing error handling and recovery mechanisms for ETL process failures.
• Implement the quality check in the Data Warehouse ETL process. All the error and mismatch codes will be treated as exceptions.
• Making sure all business rules are translated correctly into technical specifications.
• Implement best practices in data governance, data management, security, and privacy, with a focus on CRM and marketing data.
• Collaborate with cross-functional teams to understand project requirements and translate to technical specifications to deliver data engineering solutions on time, within scope and on budget.
• Prioritize and manage multiple tasks and projects effectively.
• Provide status updates of the Data Warehouse project to the stakeholders.
• Document data engineering processes, data models, and architecture changes to maintain a clear and up-to-date record of the system.
• Facilitate knowledge sharing within the Data Services team and promote a culture of continuous learning.
• Conduct training sessions and share knowledge with team members.
• Other duties as assigned.