Data & AI Engineering - Data Engineer

at  Capgemini

Job Location: Toronto, Canada
Job Description:
As Sr Data Engineer, you will work on one of the world’s largest social media platform which deals with a few petabytes of data coming to the system daily. You will supply as part of R&D self-organized team working in an ambitious, innovative environment for our client. Investigate, build, and implement the solutions for many technical challenges using groundbreaking technologies, including building/improving Data processing platform enabling work of software used by hundreds of millions of users.

REQUIRED SKILLS:

• University degree in Computer Related Sciences or similar
• We needed 7+ Year of experience as Data engineer in crafting data pipelines for a cloud data warehouse.
• Strong python and SQL skills.
• Experience building data pipelines in python.
• Experience with extracting data from Rest APIs and ingesting it to a cloud data warehouse.
• Experience working with S3 buckets and writing DAGs on Airflow
• Experience programmatically working with any cloud data warehouse.
• Rigor in high code quality, automated testing, and other engineering standard processes.
• Effective communication, collaboration, and social skills.
• Result oriented approach.
• Good English (oral & written) and communication skills in general.
• Experience in AWS.

• Collaborate with multi-functional customers to collect data requirements.
• Develop data pipelines using python to import data into snowflake.
• Ensures that assigned area/areas are delivered within set deadlines and required quality objectives.
• Provides estimations, agrees task duration with the manager and supplies to project plan of assigned area.
• Analyzes scope of alternative solutions and makes decisions about area implementation based on their experience and technical expertise.
• Reports about area readiness/quality, and raise red flags in crisis situations which are beyond their AOR.
• Responsible for resolving crisis situations within their AOR.
• Initiates and conducts code reviews, crafts code standards, conventions, and guidelines.
• Suggests technical and functional improvements to supply to the product.
• Constantly improves their professional level.