Senior Data Engineer / Consultant - Databricks at ICM Asia Pacific

Southbank, Victoria, Australia -

Full Time

Start Date

Immediate

Expiry Date

30 Jul, 26

Salary

0.0

Posted On

01 May, 26

Experience

5 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Skills

Databricks, Data Engineering, Python, SQL, Delta Live Tables, Data Modeling, CI/CD, DevOps, Microsoft Fabric, Cloud Consultancy, Data Pipelines, Medallion Architecture, Power BI, Consulting, Mentoring, API-led Design

Industry

IT Services and IT Consulting

Description

About Us Adaptiv is a true Kiwi success story! Recognised for our commitment to premium client delivery, we provide world-class integration, AI consulting and development service, along with data and analytics. We have a wealth of development and integration experience in moving clients from around the world onto cloud platforms. Our integration work focuses on the exciting challenge of designing innovative API-led and event driven solutions. Leveraging the latest technologies, such as Databricks, MuleSoft, Boomi, Azure, and Solace, we develop services that unlock access to existing data within legacy business systems in new and ingenious ways. These solutions enable organizations to drive major process efficiencies, engineer new operational workflows, and extract deeper insights from their data. Ultimately, this empowers businesses to operate more effectively and engage with their customers in modern, cutting-edge ways. Our services also include cloud consultancy, round-the clock middleware support, integration development, application lifecycle management, load and performance testing and customised integration training. Based in our stylish Southbank offices in Melbourne, our team enjoys a collaborative, people-first culture where curiosity, initiative, and growth are valued. We combine serious technical capability with a down-to-earth, can-do approach and we’re looking for someone who shares that mindset. About the Role We have an exciting opportunity for a Senior Data Engineer / Consultant to join our growing Data Engineering practice here at Adaptiv Integration to drive the delivery of data engineering engagements on behalf of our clients. In this role, you will ensure high-quality technical outcomes, foster strong client collaboration, and provide effective support to delivery teams. This position combines advanced data engineering expertise with consulting leadership. You will own engineering delivery across assigned engagements, contribute to solution design within architectural guidelines, and mentor junior and intermediate team members to maintain consistent quality and standards. This role will be responsible for the delivery of cutting-edge Databricks technology, driving innovative data engineering solutions for clients. You will leverage your expertise to design, implement, and optimise Databricks-based pipelines and solutions, ensuring high-quality technical outcomes and efficient, scalable data architectures. The role is highly hands-on and delivery-focused, requiring autonomous execution and a strong emphasis on billable contribution. What You’ll Be Doing Build, maintain, and optimise data pipelines across lakes, lakehouses, and warehouses. Write, test, and maintain high-quality code; develop transformations for reporting, analytics, and AI/ML. Apply data modelling principles; troubleshoot and resolve issues efficiently. Work with Databricks, Delta Live Tables, Lakeflow, Git, and CI/CD pipelines. Implement automated testing, data validation, and performance optimisation. Lead unit and integration testing; ensure solutions meet quality and documentation standards. Support knowledge sharing and improvement of internal frameworks and templates. Act as primary engineering contact, leading technical discussions and translating business needs into technical tasks. Communicate progress, risks, and blockers; contribute to estimation, scoping, and planning. Mentor and coach junior/intermediate team members; conduct peer reviews. Ensure accountability for code quality, documentation, and adherence to best practices. Collaborate with architects on technical solutions and delivery planning. Participate in learning sessions and knowledge sharing; adopt modern data concepts (AI/ML, data visualisation, cloud-native). Contribute to process, template, and documentation improvements; pursue relevant training and certification. What You’ll Bring 6+ years of professional experience in data engineering or a related field. At least 4 years of hands-on experience developing data pipelines and transformations using Databricks, including Delta Live Tables, notebooks, and workflows. Familiarity with Microsoft Fabric concepts and experience contributing to projects that incorporate Fabric components. Proficiency in Python and SQL for data transformation and analysis. Understanding of data modelling including Star and Snowflake schema design for analytics workloads. Knowledge of Medallion architecture principles and well-architected, scalable data solution design. Experience applying DevOps practices such as version control, CI/CD, and environment automation. Experience with testing and data quality frameworks to ensure reliable, accurate data delivery. Experience with visualisation and data consumption concepts, including Power BI or similar tools. Relevant industry certifications (Databricks Professional and Databricks Associate) or a demonstrated commitment to ongoing professional development. If you are looking for your next role with an organisation where you can elevate your career, this could be the perfect opportunity for you.

Responsibilities

You will lead the delivery of data engineering engagements by designing, implementing, and optimizing Databricks-based pipelines and scalable data architectures. Additionally, you will mentor junior team members, manage client technical discussions, and ensure high-quality code standards across all projects.