Senior Platform Data Engineer - Azure Databricks at Grow Talent

Melbourne, Victoria, Australia -

Full Time

Start Date

Immediate

Expiry Date

13 Jan, 26

Salary

0.0

Posted On

15 Oct, 25

Experience

5 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Skills

Azure Databricks, Data Lake Storage Gen2, Delta Lake, Data Factory, Spark, Python, SQL, CI/CD, Terraform, Bicep, ARM, Azure DevOps, GitHub Actions, Performance Tuning, Troubleshooting, Cost Optimisation

Industry

Human Resources

Description

About the company A global consulting and technology partner delivering complex data and cloud programs for enterprise and public sector clients. Teams combine engineering depth with practical delivery, and operate in a culture that values clear thinking, collaboration, and continuous learning. What you’ll do Design and implement a modern Azure lakehouse platform using Synapse, Databricks, Data Lake Storage Gen2, Delta Lake, and Data Factory Lead migrations from legacy on-premise data systems to Azure with a focus on integrity, reliability, and minimal disruption Build and maintain scalable ETL and ELT pipelines with Spark, Python, and SQL, integrated into CI and CD workflows Provision cloud resources using Terraform, Bicep, or ARM, and automate deployments via Azure DevOps or GitHub Actions Monitor and optimise performance, storage, and compute, implementing diagnostics, logging, and alerting with Azure Monitor and Log Analytics Partner with squads and stakeholders in Melbourne, Sydney, Brisbane, and Canberra, providing documentation and support for platform components Experience Hands-on with Azure data services such as Databricks, Synapse, Data Lake, and Data Factory Strong Spark, Python, and SQL, including modular, reusable pipeline design Proven delivery of cloud data platforms and migration of on-premise assets to Azure CI and CD using Azure DevOps or GitHub Actions Infrastructure as Code with Terraform, Bicep, or ARM Strength in performance tuning, troubleshooting, observability, and cost optimisation Benefits Hybrid work and flexible hours to support work life balance Structured career pathways, mentoring, and communities of practice Certification support across leading cloud platforms including Microsoft Azure Employee assistance and well-being programs Modern hardware, tooling, and access to large scale enterprise projects We recognize that diverse perspectives fuel innovation. Studies show that women and people of color are less likely to apply for positions unless they meet every qualification. At our company, we value diversity and inclusivity, and we encourage you to apply even if you don't meet every requirement. You might be the ideal candidate for this or other opportunities. To discover more roles, please visit www.growtalent.com.au.

Responsibilities

Design and implement a modern Azure lakehouse platform and lead migrations from legacy on-premise data systems to Azure. Build and maintain scalable ETL and ELT pipelines integrated into CI and CD workflows.