Senior Analyst Developer – Data Engineering | Kaiwhakawhanake Tātari Mātāmua

at  Statistics New Zealand

This role is fixed term based in Christchurch. This role is a key part of the Processing Service Line in Technology Services to begin our journey of the modern data platform (Databricks).
Reporting to a Technology Delivery Manager you will work collaboratively with business stakeholders, notably product owners and other technical subject matter specialists, to help with the development and enhancement of our data services using advanced data processing tools and platforms, including Databricks and data warehousing solutions.
You will work closely with multi-disciplinary technology teams to help deliver the solutions that are consistent with the Stats NZ ICT architecture guidance.
Nōu te rourou | What you bring

This role would suit someone who can show:

• 3-5 years of experience as a Data Engineer with proven expertise in data engineering patterns including ingestion, processing, quality and storage.
• Recent expertise in Databricks Lakehouse Platform including Delta Lake, Notebooks, SQL/PySQL, Python/PySpark, Unity Catalog and pipeline orchestration.
• Proficient in ETL/ELT pipeline design, data modelling, and data partitioning optimisation against a Medallion architecture.
• Proficient in Python, PySpark, and SQL for building and optimizing data pipelines.
• Skilled in orchestration (Databricks Workflows), pipeline monitoring and optimizing Spark jobs/Databricks clusters.
• Experience in working with Data Warehousing solutions (Azure SQL DB, Redshift, Snowflake, BigQuery, Azure Synapse).
• Skilled in BI Tools (Tableau, Power BI).
• Skilled in CI/CD (Azure DevOps, GitLab, Github).
• Experienced in Agile, cross-team collaboration, documentation.

Ko mātou | About Us
Tatauranga Aotearoa - Stats NZ is a Central Government employer of 1600+ people across Aotearoa. We provide data and statistics to support the decisions of Government, Māori and Iwi organisations, businesses, NGOs, and New Zealanders. Our work is About Aotearoa, for Aotearoa - data that improves lives today and for generations to come.
Me pēhea te tuku tono | How to apply
If this sounds like you, click on the Apply now button to be redirect to the application page on our careers site. The position description is located on the right-hand side of the page.
We are truly committed to diversity, equity, inclusion and lifting our cultural capability. You don’t need to be knowledgeable in all these areas already, but you do need to be on board with learning and have a genuine interest and willingness to grow on this journey with us.
We will be screening applications as we receive them to move swiftly to interview shortly after the advert closes. You may be asked to complete a pre-interview screen via phone or video. Please let us know in your application if we need to make any specific accommodations during our process.
Please reach out to recruitment@stats.govt.nz if you have any questions.