We are seeking a skilled Data Platform Engineer to join our team and drive the evolution of our data infrastructure, which includes on-premises SQL Server environments, Azure SQL environments, and a modern, cloud-native Microsoft Fabric ecosystem. This role combines database expertise with modern data engineering practices, focusing on building scalable, real-time data pipelines and maintaining high-performance data platforms.
You will be instrumental in our data transformation journey, leveraging change data capture technologies, event-driven architectures, and Microsoft’s latest data platform offerings to create robust, near-real-time data solutions that power our analytics and business intelligence initiatives.
Responsibilities
Data Platform Architecture & Management
- Design, implement, and maintain scalable data infrastructure across on-premises SQL Server and Azure SQL environments
- Support migration and modernization efforts in collaboration with team members across engineering
- Contribute to the development of lakehouse solutions using Microsoft Fabric for enterprise-scale data processing
- Follow established data governance, security, and compliance frameworks across hybrid environments
Real-Time Data Integration
- Build and maintain near-real-time data pipelines using SQL Server Change Data Capture (CDC) and Change Stream features
- Assist with the integration of CDC technologies such as Debezium with SQL Server for streaming change data capture into Microsoft Fabric and Event Hubs
- Support event-driven data architectures and integration efforts that support real-time analytics and operational intelligence
- Optimize data flow patterns for minimal latency and maximum throughput
Database Engineering & Optimization
- Develop high-performance SQL and T-SQL solutions for complex data transformations and business logic
- Design and implement stored procedures, functions, and database objects following best practices
- Conduct performance tuning and optimization across SQL Server instances and Azure SQL databases
- Monitor system performance and proactively identify opportunities for improvement
Cloud Data Engineering
- Build and orchestrate ETL/ELT processes using Azure Data Factory and other Azure integration services
- Develop serverless data processing solutions using Azure Functions and Logic Apps
- Support CI/CD practices in collaboration with platform or DevOps teams
- Manage Azure Data Lake storage and optimize data organization for analytics workloads
Collaboration & Documentation
- Partner with engineering, analytics, and product teams to understand data requirements and deliver solutions
- Create comprehensive technical documentation for data architectures, processes, and procedures
- Collaborate with team members to share best practices
- Participate in technical reviews and collaborate on implementation decisions
Qualifications
Technical Expertise
- 4+ years of hands-on experience with Microsoft SQL Server, including database design, development, optimization, and administration
- Proficiency in SQL Azure environments (Azure SQL Database and Azure SQL Managed Instance), with experience in provisioning, migration, performance tuning, and security implementation
- Practical experience with Microsoft Fabric (formerly Azure Synapse), particularly in data pipeline development, Lakehouse architecture, and real-time integration scenarios
- Deep understanding of SQL Server Change Data Capture (CDC) and Change Stream technologies
- Experience integrating or supporting the use of Debezium with SQL Server for real-time change data capture and streaming to modern data platforms
- Experience contributing to real-tie or near-real-time data pipelines in production environments
Development & Automation Skills
- Advanced SQL and T-SQL development capabilities for complex data transformations and performance optimization
- Hands-on experience with ETL/ELT processes using Azure Data Factory or similar enterprise integration tools
- Proficiency with scripting languages (PowerShell, Python, or Bash) for automation and pipeline orchestration
- Experience with version control systems and collaborative development practices
Cloud & DevOps Proficiency
- Hands-on experience with Azure cloud data infrastructure including Azure Data Lake, Azure Functions, Logic Apps, and Event Hubs
- Working knowledge of CI/CD practices for database and data pipeline deployments using Azure DevOps, GitHub Actions, or similar platforms
- Strong understanding of data governance, access control, security frameworks, and compliance requirements in cloud environments
- Experience with infrastructure as code and automated deployment practices
Professional Skills
- Proven ability to work independently while collaborating effectively with cross-functional teams including engineering, analytics, and product organizations
- Strong analytical and troubleshooting skills with demonstrated ability to diagnose and resolve complex performance issues
- Excellent written and verbal communication skills for technical documentation and stakeholder engagement
Preferred Qualifications
- Experience with additional Azure services such as Azure Synapse Analytics, Azure Stream Analytics, or Power BI
- Knowledge of data modeling techniques and dimensional modeling principles
- Familiarity with containerization technologies (Docker, Kubernetes) and microservices architectures
- Background in agile development methodologies and DevOps practices
- Relevant Microsoft certifications (Azure Data Engineer, SQL Server, or Fabric certifications)
What We Offer
- Opportunity to contribute to data platform transformation initiatives
- Collaborative environment with cross-functional teams and modern technology stack
- Professional development opportunities and support for continuous learning
- Competitive compensation and a comprehensive benefits package
Incase you would like to apply to this job directly from the source, please click here