Lead Data Engineer at V2 Digital

Sydney, New South Wales, Australia -

Full Time

Start Date

Immediate

Expiry Date

20 Sep, 26

Salary

0.0

Posted On

22 Jun, 26

Experience

10 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Skills

Databricks, Apache Spark, Lakehouse Architecture, AWS, Azure, GCP, Data Modeling, Data Pipeline Development, Generative AI, RAG, Vector Search, LLM Applications, Python, Distributed Data Processing, Data Orchestration, Mentoring

Industry

IT Services and IT Consulting

Description

About V2 AI V2 AI is a leading AI-Native consultancy backed by $30m in VC funding, allowing us to meet our customers' needs. We harness the power of AI to accelerate business outcomes for some of the world's largest brands. We bring decades of experience and a unique delivery model to partner with our customers on the most complex problems for immense, measurable impact. Our Services AI Strategy & Governance AI Enablement Applied AI Data & AI Security About the Role As a Lead Data Engineer (Databricks), you'll drive the design and development of modern data platforms and scalable data pipelines. You'll lead data engineering initiatives using Databricks and lakehouse architecture, building robust data pipelines and deploying scalable cloud data platforms across AWS, Azure, or GCP. You'll collaborate with product teams, architects, AI engineers, data scientists, and other data engineers to deliver end-to-end data solutions, including modern data platforms, advanced analytics capabilities, and AI-ready data foundations that enable machine learning, generative AI, agentic AI, conversational analytics, and intelligent business applications. You'll also mentor team members, influence technical decisions, and help shape data engineering standards and practices across V2 AI while helping customers unlock value from their data through modern AI capabilities. Responsibilities: Lead the design, development, and deployment of data platforms and pipelines using Databricks, Spark, and cloud technologies Build and optimise batch and streaming data pipelines to support analytics, machine learning, generative AI, agentic workflows, and AI-driven business applications Design and implement AI-ready data models and architectures that enable conversational analytics, intelligent applications, and enterprise AI use cases Ensure scalable, secure, and maintainable cloud data architectures leveraging AWS, Azure, or GCP services Mentor and guide engineers on data engineering best practices, code quality, and architectural decisions Implement data platform workflows, including orchestration, monitoring, data quality, and performance optimisation Work with structured and unstructured data to enable advanced analytics, AI-powered applications, conversational experiences, and intelligent business solutions Contribute to reusable data frameworks, pipelines, and engineering standards Contribute to the design and delivery of data platforms that provide trusted, governed, and accessible data for AI and machine learning initiatives About You: Extensive experience designing and delivering data engineering solutions and modern data platforms Strong expertise with Databricks, Spark, and lakehouse architecture Experience building scalable data pipelines and distributed data processing systems that support analytics, machine learning, and AI workloads Experience working with modern data platforms such as Databricks Strong cloud experience across AWS, Azure, or GCP Deep understanding of data modelling, data architecture, and data engineering best practices Experience delivering AI-ready data platforms and data models that enable machine learning, generative AI, conversational analytics, and intelligent business applications Understanding of modern AI architectures including RAG, vector search, embeddings, agentic workflows, context engineering, and LLM-powered applications Exposure to AI frameworks and platforms such as LangGraph, LangChain, MCP, OpenAI, Anthropic, AWS Bedrock, Azure OpenAI, Databricks, or similar ecosystems Experience mentoring engineers and influencing technical decisions across projects Passionate about building scalable data platforms, reusable frameworks, and high-quality engineering solutions Excellent communicator and collaborator, able to work across engineering, product, AI, and data teams Benefits: Competitive Salary package Pick your equipment Gifted Day Off ("VersionUp Day") Generous parental leave Well funded start up $$$ Annual Training budget Mentorship Program Clear promotion pathways Flexible working Meet-ups & socials 97% Rating on corporate social responsibility APPLY NOW: If you are keen to join one of the fastest-growing consultancies in this space and interested in shaping the future of V2 AI, then APPLY NOW!

Responsibilities

Lead the design and deployment of scalable data platforms and pipelines using Databricks and cloud technologies. Collaborate with cross-functional teams to build AI-ready data foundations for generative AI and advanced analytics.