Senior EDL Data Engineer (UK)

at  Bank of Ireland

WHAT IS THE OPPORTUNITY?

Join our Data Engineering team in this exciting time as we implement Bank of Ireland’s new cloud based data lake, take advantage of AI opportunities and transition workloads to that new Enterprise Data Lake platform.
As Senior Data Engineer, you will be responsible for the technical leadership, hands on engineering and mentoring of data engineers within the Data Engineering function.
We work in a very collaborative environment with a learning culture and you will use your experience to help guide future development across the team, the tools we use, help drive automation and introduce new and exciting test engineering patterns and frameworks.

WHAT WILL MAKE YOU STAND OUT

We are seeking a leader with enthusiasm and a growth mentality who prioritises collaboration with others. You are proactive to achieve the necessary outcome while improving processes, people and tooling along the way!
You have a proven track record (7+ years) as a Senior Engineer in the Data Lake or Data Warehouse domain working in an agile team. You have deep technical knowledge of Data Lakes, Cloud Technologies and Architecture, preferably AWS.

Further technical knowledge and/or experience in the below are necessary to apply:

• Proficiency in SQL, Python and Scala.
• Expertise in processing large datasets, streaming data, and unstructured data using HBase, Hive, Impala, Spark.
• Streaming Data Pipelines with tools like Kafka, NiFi, Spark Streaming.
• Workflow orchestration skills using Oozie, Airflow, Ctrl-M.
• Familiar with AI concepts and willingness to explore LLM’s, Generative AI and Machine Learning
• Knowledge in Metadata Management, Governance frameworks (Atlas, Collibra), and Reporting tools (Observability, Looker, Tableau, Qlikview).
• Building data solutions on AWS
• Strong knowledge of Cloud Data Platforms and data pipelines
• Data Ops expertise including Bitbucket, Jenkins, Terraform.
• Scrum/Kanban, SAFe delivery methodologies.

Experience with any of the following will help you to stand out but is not necessary in order to apply for this role;

• REST APIs
• Cloudera CDH/CDP platform and appropriate Cloudera certifications
• The ability to derive and share Data-Driven insights with Business and Technical teams
• The ability of identifying and introducing process optimizations

ESSENTIAL QUALIFICATIONS

There are no specific qualifications or minimum educational requirements needed for this role.

IN THIS ROLE, YOU WILL

• Provide technical leadership and guidance to other data engineers
• Take the lead in the design and build of complex data flows and process’s using our Enterprise Data Lake and Cloud Data Platform
• Make decisions on engineering frameworks, tooling and patterns
• Advocate and drive Automation and the adoption of processes such as TDD
• Be naturally curious and have experimented the use of AI to enhance software engineering processes
• Solve complex technical problems and provide creative solutions from your experience or through a rational problem solving process.
• Ensure teams are following engineering best practices, our engineering standards and process’s while driving improvements in parallel
• Ensure that technical development processes, standards, governance and tooling are appropriate and effective for the Enterprise Data Lake and Operational Data Store and meet business requirements

WHERE AGENCY ASSISTANCE IS REQUIRED BANK OF IRELAND RECRUITMENT TEAM WILL ENGAGE DIRECTLY WITH SUPPLIERS. UNSOLICITED CVS / PROFILES SUPPLIED TO BANK OF IRELAND BY RECRUITMENT AGENCIES WILL NOT BE ACCEPTED FOR THIS ROLE.

We’re on a continuous journey to build an inclusive and diverse workplace. We welcome applications from people of all backgrounds, lived experience, abilities and perspectives. Reasonable accommodations are offered at every stage of our recruitment process. If you require any assistance, please complete this form and one of our recruitment team members will be in touch via email. Any information provided will be treated as confidential within the recruitment team and used only for the purpose of determining and providing appropriate accommodations for the application and recruitment process

Experience with any of the following will help you to stand out but is not necessary in order to apply for this role;

• REST APIs
• Cloudera CDH/CDP platform and appropriate Cloudera certifications
• The ability to derive and share Data-Driven insights with Business and Technical teams
• The ability of identifying and introducing process optimization