Data Engineer (big data processing or relational databases with SQL)

at  Atlantis IT group

Toronto
Role name: Engineer
Role Description: 1 Designing and developing data pipelines using Cloud Technologies based on business requirements and technical design.2 Collaborating with Stakeholders, Business Analysts and Data Architects to assist and translate business requirements to technical solutions3 Develop big data and analytic solutions leveraging new or existing technology to advance Manulife’s all lines of business4 Exploratory data analysis by querying and processing data stores and databases and generate reports.5 Design, upgrade and implement new data workflows.6 Write and maintain technical documentation7 Executes updates, patches, and other activities required to maintain and enhance the operations of on-premise or cloud-based environments
Competencies: Data Structures
Experience (Years): 4-6
Essential Skills: Experience working as Data Engineer with focus on big data processing and/or relational databases with good understanding of SQL Experienced with working on Structured and Semi-Structured datasets. Experience working with Microsoft Azure Data Platform, specifically Azure SQL Database, Azure Data Factory, ADLS storage account, Azure DataBricks and DevOps Experienced in creating data pipelines & developing complex and optimized queries Experienced with Workflow Management Tools: Airflow, Crontab, CA Workload Automation Experience with implementing CI / CD pipeline on GitHub, Jenkins / JGP. Experience writing complex SQL and NoSQL jobs to analyze data in traditional DBMS (MS-SQL, Oracle) environments Experience with integrating to back-end/legacy environments Experience integrating business and technology teams Experienced in any of the following programming/scripting languages (SQL, Python, Shell, Scala) Excellent organizational and time management skills, strong business presence with ability to multi-task and effectively deal with competing priorities
Desirable Skills: Previous work experience in the financial sector (insurance or benefits industry). Knowledgeable or at least have the basic concept of Data Visualization in any of the following tools: Tableau, PowerBI, QlikView/QlikSens

Please refer the Job description for details