Software Engineer - Senior Data Engineer
at Capgemini
Toronto, ON, Canada -
Start Date | Expiry Date | Salary | Posted On | Experience | Skills | Telecommute | Sponsor Visa |
---|---|---|---|---|---|---|---|
Immediate | 15 Aug, 2024 | Not Specified | 15 May, 2024 | 5 year(s) or above | Communication Skills,Programming Languages,Spark,Sql,Airflow | No | No |
Required Visa Status:
Citizen | GC |
US Citizen | Student Visa |
H1B | CPT |
OPT | H4 Spouse of H1B |
GC Green Card |
Employment Type:
Full Time | Part Time |
Permanent | Independent - 1099 |
Contract – W2 | C2H Independent |
C2H W2 | Contract – Corp 2 Corp |
Contract to Hire – Corp 2 Corp |
Description:
JOB DESCRIPTION:
As a Senior Engineer, you will build distributed data processing solution and highly loaded database solutions for various cases including reporting, product analytics, marketing optimization and financial reporting. Supply as part of self-organized team of experience data engineers working in an exciting, innovative environment for our client, creating the foundation for decision-making at a company dealing with billions of events per day. Investigate, create, and implement the solutions for existing technical challenges. Provide guidance, instruction, direction, leadership to a development team with the purpose of achieving project goals.
REQUIRED SKILLS:
- 5+ years of professional experience.
- University degree or equivalent experience in Computer Related Sciences or similar.
- Proficiency in Complicated SQL.
- In-depth knowledge of Data Warehousing and Data Modeling techniques.
- Proficiency in Python programming languages.
- Proficiency in Airflow for efficient workflow automation
- Experience with Spark/EC2/S3 will be useful.
- Familiarity with Snowflake/Databricks.
- confirmed 3 yr of experience in ETL orchestration and workflow management tool Airflow.
- Guide in Database fundamentals, SQL and distributed computing.
- Excellent communication skills and experience working with technical and non-technical teams.
- Able to clear hacker rank code test!
Responsibilities:
- Obtain tasks from the project lead or Team Lead (TL), prepares functional and design specifications, approves them with all collaborators.
- Ensures that assigned area/areas are delivered within set deadlines and required quality objectives.
- Provides estimations, agrees task duration with the manager and gives to project plan of assigned area.
- Analyzes scope of alternative solutions and makes decision about area implementation based on their experience and technical expertise.
- Leads functional and architectural design of assigned areas. Makes sure design decisions on the project meet architectural and design requirements.
- Addresses area-level risks, provides and implements mitigation plan.
- Reports about area readiness/quality, and raises red flags in crisis situations which are beyond their AOR.
- Responsible for resolving crisis situations within their AOR.
- Initiates and conducts code reviews, creates code standards, conventions and guidelines.
- Suggests technical and functional improvements to give to the product;
- Constantly improves their professional level.
- Collaborates with other teams.
REQUIREMENT SUMMARY
Min:5.0Max:10.0 year(s)
Information Technology/IT
IT Software - Other
Software Engineering
Graduate
Computer related sciences or similar
Proficient
1
Toronto, ON, Canada