Sr. Data Engineer (1 yr renewable)
at Randstad
Singapore, Southeast, Singapore -
Start Date | Expiry Date | Salary | Posted On | Experience | Skills | Telecommute | Sponsor Visa |
---|---|---|---|---|---|---|---|
Immediate | 16 Jul, 2024 | Not Specified | 17 Apr, 2024 | 2 year(s) or above | Ansible,Code,Containerization,Kubernetes,Bash,Automation,Data Engineering,Sql,Sql Server,Scripting,Languages,Python,Jenkins | No | No |
Required Visa Status:
Citizen | GC |
US Citizen | Student Visa |
H1B | CPT |
OPT | H4 Spouse of H1B |
GC Green Card |
Employment Type:
Full Time | Part Time |
Permanent | Independent - 1099 |
Contract – W2 | C2H Independent |
C2H W2 | Contract – Corp 2 Corp |
Contract to Hire – Corp 2 Corp |
Description:
Opporutnity to work in a leading team
diversified culture
good learning & growth opportunities
about the company
Our client is a leading oil & gas organization.
about the job
- Design, develop, and maintain robust, scalable and sustainable data products and build & optimize data pipeline and infrastructure.
- Collaborate with stakeholders to understand their data requirements and translate them into technical solutions.
- Identify and implement data quality monitoring and validation processes to ensure data integrity.
- Implement data quality frameworks and ensure data governance best practices, including data lineage, data documentation, and data security.
- Build out the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using Synapse, ADF, Spark, Kafka, or similar technologies.
- Work closely with Data Analysts and Data Architect to support their data needs and enable advanced analytics and machine learning initiatives.
- Contribute to the development of the organization’s data strategy, including evaluating new technologies, tools, and frameworks to enhance the data engineering ecosystem.
skills and experience required
- 4- 8 years to total IT experience preferably in field of data engineering
- 4+ years’ experience with Azure services including IAM, Synapse, DataLake, SQL Server, ADF etc.
- 2+ years’ experience in creating and deploying docker containers on Kubernetes.
- 2+ years’ experience in supporting development teams on Kubernetes best practices, troubleshooting, and performance optimization.
- 2+ years’ experience with CI/CD pipelines toll such as Jenkins and GitHub Actions
- 2+ years’ experience with Synapse data warehousing and data lake solutions
- Strong programming skill in Python, PySpark and SQL
- 4+ years of experience in scripting and automation using languages such as Bash, Python, or Go
- 2+ years of experience with infrastructure-as-code tools such as Terraform, Ansible, or CloudFormation and containerization technologies (e.g., Docker, Kubernetes).
To apply online please use the ‘apply’ function
(EA: 94C3609/ R1324990
Responsibilities:
Please refer the Job description for details
REQUIREMENT SUMMARY
Min:2.0Max:8.0 year(s)
Information Technology/IT
IT Software - DBA / Datawarehousing
Software Engineering
Graduate
Proficient
1
Singapore, Singapore