Y-Axis Jobs Logo
Send us feedback
telephone  +91 7670 800 001
Log in Sign up Try Premium

Jobs in New South Wales

About 12506 results in (1) seconds Clear Filters

Jobs Search

About 12506 results in (1) seconds
Senior Data Engineer at CMC Markets
London, New South Wales, United Kingdom - Full Time
Skills Needed
N/A
Operations Team Lead at Adactin Group
new south wales, New South Wales, Australia - Full Time
Skills Needed
N/A
Experience Required
Minimum 5 year(s)
Assistant Front Office Manager at InterContinental Hotels
new south wales, New South Wales, Australia - Full Time
Skills Needed
N/A
Experience Required
Minimum 10 year(s)
Data Analyst at PRA
sydney, New South Wales, Australia - Full Time
Skills Needed
N/A
Experience Required
Minimum 1 year(s)
Assistant Front Office Manager at The Star Entertainment Group
new south wales, New South Wales, Australia - Full Time
Skills Needed
N/A
Experience Required
Minimum 10 year(s)
AML Analyst at Administration Intelligence AG
Sydney, New South Wales, Australia - Full Time
Skills Needed
N/A
Experience Required
Minimum 1 year(s)
Warehouse Supervisor at AkzoNobel
melbourne, New South Wales, Australia - Full Time
Skills Needed
N/A
Experience Required
Minimum 1 year(s)
Pharmacy Technician at kitjobs
Sydney, New South Wales, Australia - Full Time
Skills Needed
N/A
Experience Required
Minimum 7 year(s)
Program Manager - Technology Transformation at Talenza
Sydney, New South Wales, Australia - Full Time
Skills Needed
N/A
Outbound Logistics Coordinator at Elmo Talent Management Software
sydney, New South Wales, Australia - Full Time
Skills Needed
N/A
Experience Required
Minimum 1 year(s)
Senior Cloud Engineers at Charterhouse Group
Sydney, New South Wales, Australia - Full Time
Skills Needed
N/A
Senior Cloud Engineers at Clicks IT Recruitment
Sydney, New South Wales, Australia - Full Time
Skills Needed
N/A
Senior Cloud Engineers at Clicks IT Recruitment
Sydney, New South Wales, Australia - Full Time
Skills Needed
N/A
Assistant Store Manager at Elmo Talent Management Software
sydney, New South Wales, Australia - Full Time
Skills Needed
N/A
Child Care Assistant Teacher at BrightPath Early Learning & Child Care
Syedney, New South Wales, Australia - Full Time
Skills Needed
N/A
Aged Care Worker at NORTHERN DISABILITY AND AGED CARE
Sydney, New South Wales, Australia - Full Time
Skills Needed
N/A
Waiter at The Clifford Wallace Agency
Sydney, New South Wales, Australia - Full Time
Skills Needed
N/A
Experience Required
Minimum 5 year(s)
Instructional Designer at Private Advertiser
victoria, New South Wales, Australia - Full Time
Skills Needed
N/A
Instructional Designer at SEEK - Australia
victoria, New South Wales, Australia - Full Time
Skills Needed
N/A
Child Care Assistant Teacher at BrightPath Early Learning & Child Care
Syedney, New South Wales, Australia - Full Time
Skills Needed
N/A
Experience Required
Minimum 2 year(s)
Senior Data Engineer at CMC Markets
London, New South Wales, United Kingdom -
Full Time

Start Date

Immediate

Expiry Date

18 Nov, 26

Salary

0.0

Posted On

20 Aug, 26

Experience

0 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

No

Skills

Industry

Information Technology & Services;Software Development & Publishing

Description

Full job description

Senior Data Engineer – Market Data

We are looking for a Senior Data Engineer to build and operate a high-performance market data platform supporting quantitative research and production trading systems. You'll design scalable data pipelines, process billions of market data records, and deliver reliable, production-quality datasets for research, analytics and real-time applications.

Key Responsibilities

  • Build scalable ETL/ELT pipelines for batch and streaming market data.
  • Develop production-grade Python and SQL solutions.
  • Ingest, normalise and validate market data, including trades, ticks, Level 1 & 2 quotes, order books, reference data and corporate actions.
  • Implement automated data quality, reconciliation and monitoring frameworks.
  • Optimise data storage using Parquet, Arrow and modern data lake technologies.
  • Partner with quantitative researchers, traders and engineering teams to deliver trusted datasets.

Essential Skills

  • Strong Python and SQL.
  • Experience building scalable, production data pipelines.
  • Expertise with Parquet and modern data storage formats.
  • Deep understanding of high-frequency market data, including tick data, order books and market data normalisation.
  • Experience handling time-series challenges such as timestamp precision, sequence gaps, duplicate and out-of-order events.
  • Experience with distributed processing (Spark, Polars, Dask, Ray or similar).
  • Experience with Kafka or similar streaming technologies.
  • Familiarity with PostgreSQL, ClickHouse, Snowflake, Databricks, kdb+ or similar.
  • Docker, Linux, Git and CI/CD experience.

Highly Desirable

  • Familiarity with OneTick, PostgreSQL, ClickHouse, Snowflake, Databricks, kdb+ or similar.
  • Order book reconstruction
  • Tick-to-bar aggregation
  • Airflow, Dagster, Prefect or MLflow
  • Experience supporting quantitative research or trading systems
  • Multi-asset market data (Equities, Futures, FX, Options, ETFs, CFDs)

What We're Looking For

The successful candidate will have a strong background in market data engineering with proven experience building reliable, scalable data platforms.

Our non-negotiable requirements are:

  • Expert Python
  • Strong SQL
  • Scalable data pipeline development
  • Apache Parquet
  • Market data normalisation
  • Automated data quality controls
  • Deep tick and market data expertise

Experience in MLOps is advantageous but not essential. We welcome candidates with strong experience in either market data engineering or MLOps, provided they have the skills to build and operate production-grade data platforms.

  • Skills
Responsibilities
Senior Data Engineer at CMC Markets
London, New South Wales, United Kingdom - Full Time
Skills Needed
N/A
Operations Team Lead at Adactin Group
new south wales, New South Wales, Australia - Full Time
Skills Needed
N/A
Experience Required
Minimum 5 year(s)
Assistant Front Office Manager at InterContinental Hotels
new south wales, New South Wales, Australia - Full Time
Skills Needed
N/A
Experience Required
Minimum 10 year(s)
Data Analyst at PRA
sydney, New South Wales, Australia - Full Time
Skills Needed
N/A
Experience Required
Minimum 1 year(s)
Assistant Front Office Manager at The Star Entertainment Group
new south wales, New South Wales, Australia - Full Time
Skills Needed
N/A
Experience Required
Minimum 10 year(s)
AML Analyst at Administration Intelligence AG
Sydney, New South Wales, Australia - Full Time
Skills Needed
N/A
Experience Required
Minimum 1 year(s)
Warehouse Supervisor at AkzoNobel
melbourne, New South Wales, Australia - Full Time
Skills Needed
N/A
Experience Required
Minimum 1 year(s)
Pharmacy Technician at kitjobs
Sydney, New South Wales, Australia - Full Time
Skills Needed
N/A
Experience Required
Minimum 7 year(s)
Program Manager - Technology Transformation at Talenza
Sydney, New South Wales, Australia - Full Time
Skills Needed
N/A
Outbound Logistics Coordinator at Elmo Talent Management Software
sydney, New South Wales, Australia - Full Time
Skills Needed
N/A
Experience Required
Minimum 1 year(s)
Senior Cloud Engineers at Charterhouse Group
Sydney, New South Wales, Australia - Full Time
Skills Needed
N/A
Senior Cloud Engineers at Clicks IT Recruitment
Sydney, New South Wales, Australia - Full Time
Skills Needed
N/A
Senior Cloud Engineers at Clicks IT Recruitment
Sydney, New South Wales, Australia - Full Time
Skills Needed
N/A
Assistant Store Manager at Elmo Talent Management Software
sydney, New South Wales, Australia - Full Time
Skills Needed
N/A
Child Care Assistant Teacher at BrightPath Early Learning & Child Care
Syedney, New South Wales, Australia - Full Time
Skills Needed
N/A
Aged Care Worker at NORTHERN DISABILITY AND AGED CARE
Sydney, New South Wales, Australia - Full Time
Skills Needed
N/A
Waiter at The Clifford Wallace Agency
Sydney, New South Wales, Australia - Full Time
Skills Needed
N/A
Experience Required
Minimum 5 year(s)
Instructional Designer at Private Advertiser
victoria, New South Wales, Australia - Full Time
Skills Needed
N/A
Instructional Designer at SEEK - Australia
victoria, New South Wales, Australia - Full Time
Skills Needed
N/A
Child Care Assistant Teacher at BrightPath Early Learning & Child Care
Syedney, New South Wales, Australia - Full Time
Skills Needed
N/A
Experience Required
Minimum 2 year(s)