Organization: At CommBank, we never lose sight of the role we play in other people’s financial wellbeing. Our focus is to help people and businesses move forward to progress. To make the right financial decisions and achieve their dreams, targets, and aspirations. Regardless of where you work within our organisation, your initiative, talent, ideas, and energy all contribute to the impact that we can make with our work. Together we can achieve great things.
Job Title: Data Engineer
Location: Bangalore-Manyata Tech Park

ESSENTIAL SKILLS:

• Experience: 4 to 8 years of experience in cyber security, with a focus on incident response.
• Experience in designing, building, and delivering enterprise-wide data ingestion, data integration and data pipeline solutions using common programming language (Scala, Java, or Python) in a Big Data and Data Warehouse platform. Preferably with at least 5+ years of hands-on experience in a Data Engineering role.
• Experience in building data solution in Hadoop platform, using Spark, MapReduce, Sqoop, Kafka and various ETL frameworks for distributed data storage and processing. Preferably with at least 5+ years of hands-on experience.
• Experience in building data solution using AWS Cloud technology (EMR, Glue, Iceberg, Kinesis, MSK/Kafka, Redshift, Document DB, S3, etc.). Preferably with 3+ years of hands-on experience and certified AWS Data Engineer.
• Strong Unix/Linux Shell scripting and programming skills in Scala, Java, or Python.
• Proficient in SQL scripting, writing complex SQLs for building data pipelines.
• Experience in leading and mentoring data engineers, including ownership of internal business stakeholder relationships and working with consultants.
• Experience in working in Agile teams, including working closely with internal business stakeholders.
• Familiarity with data warehousing and/or data mart build experience in Teradata, Oracle or RDBMS system is a plus.
• Certification on Cloudera CDP, Hadoop, Spark, Teradata, AWS Data Engineer, Ab Initio is a plus.
• Experience in Ab Initio software products (GDE, Co>Operating System, Express>It, etc.) is a plus.
  Education Qualification: Bachelor’s degree or Master’s degree in Engineering in Computer Science/Information Technology
  If you’re already part of the Commonwealth Bank Group (including Bankwest, x15ventures), you’ll need to apply through Sidekick to submit a valid application. We’re keen to support you with the next step in your career.
  We’re aware of some accessibility issues on this site, particularly for screen reader users. We want to make finding your dream job as easy as possible, so if you require additional support please contact HR Direct on 1800 989 696.
  Advertising End Date: 30/05/202

• Design and develop highly reliable and scalable data pipelines and data platforms with comprehensive test coverage.
• Collaborate with stakeholders to analyse and translate requirements to technical implementation.
• Identify and drive opportunities for continuous improvement within the team and in delivery of products.
• Provide mentoring and technical assistance to other members of the team, including more junior Data Engineers.
• Produce high quality, sustainable solutions to meet business requirements, leveraging approved delivery frameworks and by applying industry best practice.
• Provide technical governance of product delivery to ensure successful delivery and adoption.
• Deliver data engineering solutions aligned to core concepts of data design, preparation, transformation, and load.
• Build and implement data pipelines in distributed data platforms including warehouses, databases, data lakes and cloud lakehouses to enable data predictions and models, reporting and visualisation analysis via data integration tools and frameworks.
• Contribute to domain planning, providing guidance to ensure that technical deliveries are aligned to engineering direction and strategy