Lead Data Engineer

at  Absa Bank Limited

Empowering Africa’s tomorrow, together…one story at a time.
With over 100 years of rich history and strongly positioned as a local bank with regional and international expertise, a career with our family offers the opportunity to be part of this exciting growth journey, to reset our future and shape our destiny as a proudly African group.
Job Summary
Do you love or enjoy working with data integration on Hadoop data lake? Are you an innovative, responsible, fast learning and goal oriented data engineer that is not afraid to go the extra mile to ensure successful team project delivery? Do you see project roadblocks as challenges that motives you to be better at what you do? Is your desire to automate repetitive tasks? Do you want to treat data as an asset?
If you answered yes to all of the above questions, the Data Rails team within CIB Transactional Banking Tech has the perfect opportunity for you. Be part of the young, energetic team that provides one stop data lake service to our customers. As a senior engineer you will onboard new data assets to the data lake, as well as optimize existing data pipelines to the latest data integration standards using mostly SPARK, SCALA and JAVA on Hadoop ecosystem. You will also be part of the exciting migration journey to Cloud (AWS) that the team will embark on in the near future.
Job Description
Key Accountabilities:

Development and program support

• Development of data integration and analysis solutions using various big data technologies with a focus mainly on Spark/Scala and Java development.
• Attend all scoping and planning workshops for BAU and project initiatives and provide input into the design process to ensure that the solution meets the business requirements.
• Accurately estimate project activities and communicate deviations promptly to the lead or project manager for appropriate action by participating in development planning and progress review sessions.
• Testing and peer code review.

Stakeholder and Management Reporting

• Attend relevant project progress review sessions and provide feedback when required.

Key critical skills and experience required:

• 7+ years of Big Data development experience using Spark, Scala, Java
• Strong understanding of batch processing and scripting
• Strong Hadoop architecture knowledge with the ability to troubleshoot and optimize poorly performing tasks
• Good understanding of Java programming
• Good understanding of metadata driven architecture
• Understanding the end to end solutions delivery lifecycle
• Some exposure to AWS services utilizing but not limited to EMR, Glue, Athena, S3, RDR, Step Functions, Lambda, Pipeline is beneficial

Competencies required:

• Team collaboration
• Mentoring and positively influencing other team members
• Ability to effectively multi-task
• Resilience - the ability to cope with pressure and setbacks while still meeting the deadlines
• Planning, organizing and documentation
• Delivering results and exceeding/meeting customer expectations
• Excellent English and communication skills
• Application development and support
• Participate in future Architecture build

Education
Absa Bank Limited is an equal opportunity, affirmative action employer. In compliance with the Employment Equity Act 55 of 1998, preference will be given to suitable candidates from designated groups whose appointments will contribute towards achievement of equitable demographic representation of our workforce profile and add to the diversity of the Bank.
Absa Bank Limited reserves the right not to make an appointment to the post as advertise

Please refer the Job description for details