Data Engineer

at  Chambers and Partners

SKILLS AND EXPERIENCE

• Demonstrable professional Data experience
• Strong understanding of DataBricks and PySpark
• Understanding of SQL and CosmosDB databases
• Knowledge of designing, constructing, administering, and maintaining data warehouses and data lakes.
• Knowledge of Azure Cloud Services
• Good understanding T-SQL programming
• Good exposure to Azure Data Lake technologies such as ADF, HDFS and Synapse
• Good knowledge of Data Governance, Data Catalog, Master Data Management
• Knowledge of Advanced Analytics and Model Management including Azure Databricks, Azure ML/ MLFlow as well as deployment of models using Azure Kubernetes Service
• Excellent oral and written communications skills
• Highly driven, positive attitude, team player, self-motivated and very flexible
• Strong analytical skills, attention to detail and excellent problem solving/troubleshooting
• Good time management skills
• Knowledge of agile methodology
• Knowledge of GitHub
• Prioritisation skills to handle fast passed dynamic environment

• Write clean and testable code using SQL and Python scripting languages, to enable our customer data products and business applications
• Build and manage data pipelines and notebooks, deploying code in a structured, trackable and safe manner
• Effectively create, optimise and maintain automated systems and processes across a given project(s) or technical domain
• Data Analyse, profile and plan work, aligned with project priorities
• Perform reviews of code, refactoring where necessary
• Deploy code in a structured, trackable and safe manner
• Document your data developments and operational procedures
• Ensure adherence to data/software delivery standards and effective delivery.
• Help monitor, troubleshoot and resolve production data issues when they occur
• Contribute to the continuous improvement of the team
• Contribute to the team’s ability to make and deliver on their commitments
• Innovate and experiment with technology to deliver real business benefits.
• Regularly launch products and services based on your work and be an integral part of making these a success.
• Guide, influence and challenge the technology team and stakeholders to understand the benefits, pros and cons of various technical options.
• Guide and mentor less experienced developers assigned on projects.
• Promote an innovative thinking process and encourage it in others.
• Working within the agile framework at Chambers