AWS- Data Engineer - AU (Melbourne)
at Rackspace
Melbourne, Victoria, Australia -
Start Date | Expiry Date | Salary | Posted On | Experience | Skills | Telecommute | Sponsor Visa |
---|---|---|---|---|---|---|---|
Immediate | 20 Sep, 2024 | Not Specified | 20 Jun, 2024 | 3 year(s) or above | Dbt,Computer Science,Data Modeling,Sql,Glue | No | No |
Required Visa Status:
Citizen | GC |
US Citizen | Student Visa |
H1B | CPT |
OPT | H4 Spouse of H1B |
GC Green Card |
Employment Type:
Full Time | Part Time |
Permanent | Independent - 1099 |
Contract – W2 | C2H Independent |
C2H W2 | Contract – Corp 2 Corp |
Contract to Hire – Corp 2 Corp |
Description:
AWS DATA ENGINEERING FRAMEWORK SPECIALIST
Description: We are looking for a Data Engineer who is adept at building and maintainingdata engineering frameworks such as DBT, SQLMesh, and Coalesce within AWS EMR/Glue environments. This role involves hands-on development and optimization of data pipelines, ensuring they are efficient and aligned with the bank’s data strategy.
MINIMUM QUALIFICATIONS:
Bachelor’s degree in Computer Science, Engineering, or a related technical field.
3+ years of hands-on experience with AWS services, specifically EMR and Glue.
Proficiency in building data engineering frameworks like DBT, SQLMesh, or Coalesce.
Solid understanding of SQL, data modeling, and ETL processes.
PREFERRED QUALIFICATIONS:
Experience with version control systems and CI/CD pipelines.
Familiarity with additional AWS services and data analytics tools.
Responsibilities:
Experience with AWS data services, including AWS EMR, Glue, S3, Redshift, and other related technologies.
Proven experience in building advanced data engineering frameworks on AWS EMR/Glue, Apache Spark and other AWS Data services technology.
Strong understanding of writing efficient, reliable, and maintainable code to manage data workflows.
Solid foundation in software engineering, including Object-Oriented Design (OOD) and design patterns.
Optimize data processing pipelines for performance and scalability.
Collaborate with data architects to implement best practices and improve data framework capabilities.
Assist in resolving technical challenges and provide support to the data engineering team.
REQUIREMENT SUMMARY
Min:3.0Max:8.0 year(s)
Information Technology/IT
IT Software - Other
Software Engineering
Graduate
Computer science engineering or a related technical field
Proficient
1
Melbourne VIC, Australia