Data Engineer
at Capgemini
Mississauga, ON, Canada -
| Start Date | Expiry Date | Salary | Posted On | Experience | Skills | Telecommute | Sponsor Visa |
|---|---|---|---|---|---|---|---|
| Immediate | 17 Dec, 2024 | Not Specified | 18 Sep, 2024 | 5 year(s) or above | Business Acumen,Data Solutions,It,Communication Skills,Teams,Critical Thinking,Creativity,Python,Oozie | No | No |
Required Visa Status:
| Citizen | GC |
| US Citizen | Student Visa |
| H1B | CPT |
| OPT | H4 Spouse of H1B |
| GC Green Card |
Employment Type:
| Full Time | Part Time |
| Permanent | Independent - 1099 |
| Contract – W2 | C2H Independent |
| C2H W2 | Contract – Corp 2 Corp |
| Contract to Hire – Corp 2 Corp |
Description:
JOB DESCRIPTION:
We are looking for a Senior Data Engineer to be part of our scrum teams and perform functional
& system development for Hadoop applications for our Enterprise Data Lake initiative. This is
high visibility fast paced key initiative will integrate data across internal and external sources
provide analytical insights and integrate with our critical systems.
REQUIRED SKILLS:
- Bachelor’s degree in a quantitative field (such as Engineering Computer Science Statistics Econometrics) and a minimum of 10 years of experience
- Minimum 5 years’ experience working with and developing big data solutions
- Experts in the following Ab Initio tools: GDE Graphical Development Environment Co>Operating System Control Center Metadata Hub Enterprise Meta>Environment Enterprise Meta>Environment Portal Acquire>It Express>It Conduct>It Data Quality Environment Query>It.
- Hands-on experience on writing shell scripts complex sql queries
- Hadoop commands and Git Ability to write abstracted reusable code components
- Programming experience in at least two of the following languages: Scala Java or Python
Responsibilities:
- Participate in the agile development process
- Develop functional and technical specifications from business requirements for the commercial platform
- Ensure application quality and adherence to performance requirements
- Help create project estimates and plans.
- Represent engineering team in project meetings and solution discussions
- Participate code review process
- Work with team members to achieve business results in a fast paced and quickly changing environment
- Pair up with data engineers to develop cutting edge
- Analytic applications leveraging Big Data technologies: Hadoop NoSQL and In-memory Data Grids
- Mentor and influence up and down the chain of command
- Support design strategy production promotion processes (DevOps) software change control specifically related to Ab Initio as well as DW technology.
- Hands on Experience in building Ab Initio Graphs.
- Good Knowledge of Databases and hands on experience in writing SQL code.
- Working experience with scheduling tools such as Autosys.Perform other duties and/or projects as assigned
REQUIREMENT SUMMARY
Min:5.0Max:10.0 year(s)
Information Technology/IT
IT Software - Other
Software Engineering
Graduate
A quantitative field (such as engineering computer science statistics econometrics and a minimum of 10 years of experience
Proficient
1
Mississauga, ON, Canada
