Principal Data Engineer at Commonwealth Bank
Sydney, New South Wales, Australia -
Full Time


Start Date

Immediate

Expiry Date

15 May, 25

Salary

0.0

Posted On

16 Feb, 25

Experience

0 year(s) or above

Remote Job

No

Telecommute

No

Sponsor Visa

No

Skills

Java, Avro, Beam, Performance Tuning, Data Services, Python, Etl Tools, Amazon Web Services, Control Center, Kafka, Test Automation

Industry

Information Technology/IT

Description

Principal Data Engineer (Flink / Big Data)

  • You are passionate, driven, flexible and collaborative.
  • We are a high performing engineering uplifting engineering standards & instrumentations across the group team.
  • Together we can rewrite the experience for millions of customers.

TECH SKILLS

  • Experience across Apache Flink, Beam, AWS Glue, BI/Big Data/DW/ETL technologies such as Iceberg, Parquet and AVRO and AWS-native data services like EMR, Redshift, etc
  • Big data platform experience for ETL development
  • Java and Python programming
  • Cloud infrastructure experience preferably with Amazon Web Services
  • Experience with NoSQL databases. SQL performance tuning, and data modelling
  • ETL Tools: GDE, ADC, Express-IT, Control center, Meta programming, Co>Relate is a plus
  • Knowledge on event-driven technology like Kafka (must), AWS SQS, SNS, Kinesis
  • Knowledge in developing test automation for ETL / ELT, CI/CD pipelines with GitHub Actions
  • At least one AWS associate level+ certification desirable
Responsibilities

Please refer the Job description for details

Loading...