Lead Data Engineer

at  Chambers and Partners

OVERVIEW

We are seeking a talented and experienced Data Engineering leader to play a pivotal role in shaping the future of data at Chambers and Partners.
In this role, you’ll design, build, and deploy innovative solutions across our products, platforms, and applications. You’ll lead by example as a technical expert, ensuring the highest standards of data engineering and quality assurance are consistently met.
As the go-to Data Lead for your project or area, you’ll drive performance, share expertise, and inspire your team to excel. You’ll manage a skilled team of data engineers, fostering a culture of best practices and continuous improvement. Your leadership will help ensure that our data projects meet the highest standards while contributing to the implementation of our ambitious data strategy and transformation roadmap.
If you’re passionate about leading a diverse and innovative team in a collaborative environment, we’d love to hear from you.

SKILLS AND EXPERIENCE

• Extensive professional Data experience
• Excellent understanding of DataBricks and PySpark
• Excellent understanding of SQL and CosmosDB databases
• Excellent knowledge of designing, constructing, administering, and maintaining data warehouses and data lakes.
• Knowledge of Azure Cloud Services and data warehouse technologies around Azure
• Proven track record of leading development projects and teams.
• Excellent knowledge of T-SQL programming
• Experience with Tableau, PowerBI or similar data visualisation platforms
• Excellent oral and written communications skills
• Highly driven, positive attitude, team player, self-motivated and very flexible
• Strong analytical skills, attention to detail and excellent problem solving/troubleshooting
• Good time management skills
• Knowledge of agile methodology
• Knowledge of GitHub and branching strategies
• Prioritisation skills to handle fast passed dynamic environment

• Lead a team of data engineers to effectively create, optimise and maintain automated systems and processes across a given project(s) or technical domain.
• Coordinate engineering resources ensuring adherence to standards and effective delivery. Provide mentorship and guidance where required.
• Write clean and testable code using SQL and Python scripting languages, to enable our customer data products and business applications
• Build and manage data pipelines and notebooks, deploying code in a structured, trackable and safe manner
• Effectively create, optimise and maintain automated systems and processes across a given project(s) or technical domain
• Data Analyse, profile and plan work, aligned with project priorities
• Perform reviews of code, refactoring where necessary
• Deploy code in a structured, trackable and safe manner
• Document your data developments and operational procedures
• Ensure adherence to data/software delivery standards and effective delivery.
• Help monitor, troubleshoot and resolve production data issues when they occur
• Contribute to the continuous improvement of the team
• Contribute to the team’s ability to make and deliver on their commitments
• Innovate and experiment with technology to deliver real business benefits.
• Regularly launch products and services based on your work and be an integral part of making these a success.
• Guide, influence and challenge the technology team and stakeholders to understand the benefits, pros and cons of various technical options.
• Promote an innovative thinking process and encourage it in others.
• Working within the agile framework at Chambers
• Assist with the recruitment of the engineering team.
• Guide, instruct, motivate and manage assigned staff on projects.
• Lead an innovative thinking process and encourage it in others.
• Lead the development of technical specifications and architecture