Data & AI Engineering - Data Engineer

at  Capgemini

JOB DESCRIPTION:

As Sr Data Engineer, you will work on one of the world’s largest social media platform which deals with a few petabytes of data coming to the system daily. You will chip in as part of R&D self-organized team working in a complicated, innovative environment for our client.
Investigate, build, and implement the solutions for many technical challenges using groundbreaking technologies, including building/improving Data processing platform enabling work of software used by hundreds of millions of users.

REQUIRED SKILLS:

• University degree in Computer Related Sciences or similar
• demonstrated ability as Data engineer in creating data pipelines for a cloud data warehouse.
• Strong python and SQL skills
• Experience building data pipelines in python Experience with extracting data from Rest APIs and ingesting it to a cloud data warehouse
• Experience working with S3 buckets and writing DAGs on Airfloow
• Rigor in high code quality, automated testing, and other engineering standard processes
• Effective communication, collaboration, and social skills
• Result oriented approach.
• Good English (oral & written) and communication skills in general.
• Experience in AWS.

• Collaborate with multi-functional partners to collect data requirements.
• Develop data pipelines using python to import data into snowflake.
• Ensures that assigned area/areas are delivered within set deadlines and required quality objectives.
• Provides estimations, agrees task duration with the manager and chips in to project plan of assigned area.
• Analyzes scope of alternative solutions and makes decisions about area implementation based on their experience and technical expertise.
• Reports about area readiness/quality, and raise red flags in crisis situations which are beyond their AOR.
• Responsible for resolving crisis situations within their AOR.
• Initiates and conducts code reviews, builds code standards, conventions, and guidelines.
• Suggests technical and functional improvements to make valuable contributions to the product.
• Constantly improves their professional level.