JOB SUMMARY :

We are seeking a highly skilled Sr. Azure Data Engineer with 12 to 14 years of experience to join our team.
The ideal candidate will have extensive experience in PySpark, Azure Databricks, and Azure.
This role involves designing and implementing robust data solutions in a hybrid work model.
The candidate will play a crucial role in driving our data strategy and ensuring the successful delivery of projects.

TECHNICAL SKILLS:

PySpark, Azure Databricks, Azure

QUALIFICATIONS –

• Must have strong experience in PySpark for data processing and analysis
• Must have extensive experience with Azure Databricks for building and managing data pipelines
• Must have solid understanding of Azure services and their integration
• Nice to have experience with other big data technologies and tools
• Nice to have strong problem-solving skills and ability to troubleshoot complex issues
• Nice to have excellent communication and collaboration skills

RESPONSIBILITIES :

• Lead the design and implementation of scalable data architectures using PySpark and Azure Databricks
• Oversee the development and deployment of data pipelines and workflows on Azure
• Provide technical guidance and mentorship to the development team
• Collaborate with cross-functional teams to gather and analyze requirements
• Ensure the performance, security, and reliability of data solutions
• Develop and maintain documentation for data architectures and processes
• Conduct code reviews and ensure adherence to best practices and standards
• Troubleshoot and resolve issues related to data processing and storage
• Optimize data processing workflows for efficiency and scalability
• Stay updated with the latest industry trends and technologies in data engineering
• Contribute to the continuous improvement of data engineering practices within the organization
• Engage with stakeholders to understand business needs and translate them into technical solutions
• Drive innovation and adoption of new technologies to enhance data capabilities