Overview:

We are seeking a skilled Data Engineer to join our dynamic team. The ideal candidate will have a strong background in data modeling, SQL, ETL processes, and expertise working within Azure cloud environment, particularly with Databricks. You will play a pivotal role in designing, developing, and maintaining scalable data pipelines and supporting our data strategy initiatives.

Key Responsibilities:

• Design, develop, and optimize data models and schemas to support business needs.
• Develop, implement, and maintain efficient ETL pipelines using Spark, Databricks, and other tools.
• Write complex SQL queries, stored procedures, and functions to extract, transform, and load data from various sources.
• Collaborate with data analytics and business teams to understand data requirements and deliver solutions accordingly.
• Leverage Azure Data Services, including Azure Data Lake, Azure Data Factory, and Azure Databricks, to build scalable data solutions.
• Ensure data quality, governance, and security standards are maintained throughout all data processes.
• Monitor, optimize, and troubleshoot data pipelines to ensure high performance and availability.
• Document data architecture, workflows, and procedures, and participate in code reviews and best practice development.