Data Engineer Senior Consultant at NTT DATA

Montreal, Quebec, Canada -

Full Time

Start Date

Immediate

Expiry Date

27 Jan, 26

Salary

0.0

Posted On

29 Oct, 25

Experience

10 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Skills

Snowflake, Airflow, DBT, Spark, SQL, PLSQL, Python, Pandas, NumPy, PySpark, Data Warehousing, Performance Tuning, E-R Data Models, CI/CD, Data Pipelines, Analytical Skills

Industry

IT Services and IT Consulting

Description

To design, develop, and manage our Snowflake data warehouse. To contribute towards the establishment of best practices for the optimal and efficient usage of Snowflake with tooling like Airflow, DBT and Spark. To assist with the testing and deployment of our data pipeline framework utilizing standard testing frameworks and CI/CD tooling. To monitor the performance of queries and data loads and perform tuning as necessary. To provide assistance and guidance during the QA & UAT phases to quickly confirm the validity of potential issues and to determine the root cause and best resolution of verified issues. Bachelor's degree in Computer Science, Software Engineering, Information Technology, or related field required. At least 10 years of experience in data development and solutions in highly complex data environments with large data volumes. At least 7 years of SQL / PLSQL experience with the ability to write ad-hoc and complex queries to perform data analysis. At least 5 years of experience with developing data solutions on Snowflake. At least 3 years of data pipelines and data warehousing solutions using Python and libraries such as Pandas, NumPy, PySpark, etc. At least 3 years of experience developing solutions in a hybrid data environment (on-Prem and Cloud) Hands on experience with Airflow (or similar tools like Dagster) a must. Snowflake SnowPro Core a must Snowflake SnowPro Advanced Architect and Advanced Data Engineer a plus. Experience with performance tuning SQL queries, Spark job, and stored procedures. An understanding of E-R data models (conceptual, logical, and physical). Understanding of advanced data warehouse concepts (Factless Fact Tables, Temporal Bi-Temporal models, etc.) a plus. Strong analytical skills, including a thorough understanding of how to interpret customer business requirements and translate them into technical designs and solutions. Capable of collaborating effectively across a variety of IT and Business groups, across regions, roles and able to interact effectively with all levels. Self-starter. Proven ability to manage multiple, concurrent projects with minimal supervision. Can manage a complex ever changing priority list and resolve conflicts to competing priorities. Ability to identify where focus is needed and bring clarity to business objectives, requirements, and priorities.

Responsibilities

Design, develop, and manage the Snowflake data warehouse while establishing best practices for its usage. Assist with testing, deployment, and performance monitoring of data pipelines.