Data Platform Engineer at Australian Financial Complaints Authority

Melbourne, Victoria, Australia -

Full Time

Start Date

Immediate

Expiry Date

08 Sep, 26

Salary

0.0

Posted On

10 Jun, 26

Experience

5 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Skills

Azure Data Factory, Azure SQL, Databricks, Synapse Analytics, Python, PySpark, Spark SQL, SQL, CI/CD, Infrastructure As Code, Terraform, Azure DevOps, Delta Lake, Data Modelling, Lakehouse Architecture, Azure AI Foundry

Industry

Financial Services

Description

Company Description Fairness feels good Make a real impact at AFCA. Where fairness drives every decision. Help us deliver world-class, independent complaints resolution for Australians. As a not-for-profit and progressive financial ombudsman, we’re championing positive change. Achieving our purpose takes progressive thinking, accountability and resilience. At AFCA, our inclusive leadership values every voice. We offer our people flexible work options, thoughtful benefits and opportunities to deepen expertise. Flourish in a diverse, caring culture. Feel the difference of belonging to an organisation intentionally designed to put people first. Job Description As a Data Platform Engineer, you’ll be at the heart of building and evolving our modern data platform, powered by Azure Data Factory, Azure SQL, Databricks, Synapse Analytics, and AI Foundry. This platform is critical to how we deliver analytics, insights, and AI capability across the organisation. You’ll ensure the platform is reliable, scalable, and high-performing, enabling trusted data delivery at pace, while playing a key role in supporting AFCA’s growing data and AI ambitions. Staying ahead of cloud-native innovation, you’ll continuously look for ways to enhance architecture, drive automation, and improve efficiency, helping future-proof our platform and keep us aligned to our enterprise vision. What you’ll be doing: Design, build and maintain scalable data pipelines, lake and lakehouse architectures across Azure (ADF, Databricks, Synapse, Azure SQL) Develop robust batch and streaming pipelines to deliver reliable, high-quality data across the organisation Drive best practice through CI/CD, infrastructure as code, automated testing and observability Monitor and optimise performance, cost and reliability (clusters, jobs, queries and governance) Contribute to data models and architectures that enable analytics and AI/ML use cases Ensure solutions align with security, privacy and data governance standards Partner closely with data analysts, engineers, scientists and AI teams to improve platform capability and developer experience Qualifications To be successful in this role, you will need: Strong experience in data engineering or data platform roles, with demonstrated hands-on expertise in Azure Data Factory, Azure SQL, Databricks, Synapse Analytics and the broader Azure data ecosystem or similar (e.g. Fabric). A Bachelor degree in Computer Science, Information Systems or relevant field Proficiency in SQL, Python, PySpark and Spark SQL, with experience building and optimising data pipelines at scale. Experience with lakehouse, Delta Lake and medallion architecture patterns. Familiarity with infrastructure-as-code tools (e.g. Terraform, ARM) and Azure DevOps CI/CD practices for data platform deployments. Understanding of data modelling concepts, data warehousing principles and modern data platform architectures. Exposure to supporting AI/ML workloads on Databricks (e.g. MLflow, model serving, feature engineering) highly regarded. Experience with or exposure to Azure AI Foundry highly regarded. Experience in financial services, digital‑first organisations or highly regulated environments highly regarded. Excellent stakeholder management skills, with the ability to clearly communicate end elicit requirements from non-technical audiences. Growth mindset with a practical, outcome‑focused approach. Customer‑centred, pragmatic and delivery‑oriented. Additional Information Silver AWEI Accreditation 2025 – Recognised for LGBTQ+ workplace inclusion. Accredited Family Friendly Workplace – Supporting work-life balance and inclusivity. Hybrid working – Flexible arrangements with two days a week in our modern offices designed for collaboration and wellbeing. Additional and inclusive leave options – Flexible public holidays, gender affirmation leave, women’s health leave, and bonus paid time off over the end of year holiday period. To apply If you’re passionate about fairness and believe your skills align with this role, we encourage you to apply even if you don’t meet every single criterion. We welcome applications from people of all backgrounds, cultures, abilities, sexual orientations, and gender identities. If you require any accessibility support during the recruitment process, please reach out to our team at [email protected]. We believe fairness starts with people. That’s why we don’t use AI or automated tools to screen candidates. As a result, our processes may take a little longer, and we thank you for your patience. About AFCA The Australian Financial Complaints Authority (AFCA) was established in 2018 as a private not-for-profit ombudsman service providing free, fair and independent help with financial disputes. The original team has grown to over 1600 dedicated professionals. Since 2018, AFCA has received more than 634,000 complaints, helping to secure $2.1 billion in compensation for consumers. AFCA is a 2026 Circle Back Initiative Employer - we are committed to responding to every applicant.

Responsibilities

Design, build, and maintain scalable data pipelines and lakehouse architectures using the Azure data ecosystem. Ensure platform reliability and performance while supporting the organization's analytics and AI/ML ambitions.