Data Engineer
at EVO OUTSOURCING SOLUTIONS PTE LTD
Singapore, Southeast, Singapore -
| Start Date | Expiry Date | Salary | Posted On | Experience | Skills | Telecommute | Sponsor Visa |
|---|---|---|---|---|---|---|---|
| Immediate | 22 Apr, 2025 | Not Specified | 23 Jan, 2025 | 6 year(s) or above | Spark,Hive,Query Optimization,Database Design,Mapreduce,Kafka,Data Engineering,Analytical Skills,Yarn | No | No |
Required Visa Status:
| Citizen | GC |
| US Citizen | Student Visa |
| H1B | CPT |
| OPT | H4 Spouse of H1B |
| GC Green Card |
Employment Type:
| Full Time | Part Time |
| Permanent | Independent - 1099 |
| Contract – W2 | C2H Independent |
| C2H W2 | Contract – Corp 2 Corp |
| Contract to Hire – Corp 2 Corp |
Description:
Responsibilities
- Design, build, and optimize scalable data pipelines using Scala and Hadoop frameworks.
- Develop and implement techniques and analytics applications to transform raw data into meaningful information using data-oriented programming languages and visualisation software.
- Write and optimize complex SQL queries for efficient data retrieval and transformation.
- Troubleshoot and resolve performance issues in queries and data workflows.
- Manage Hadoop-based data infrastructure, including HDFS, Hive, and related components.
- Monitor system performance and optimize resource utilization in a distributed environment.
Skills/Requirement
- Proficiency in Scala programming and functional programming principles.
- Strong SQL skills, including query optimization and database design.
- Hands-on experience with Hadoop ecosystem tools (HDFS, Hive, YARN, MapReduce).
- Familiarity with other big data tools like Spark, Kafka, or Flink is a plus.
- Strong analytical skills with the ability to troubleshoot and resolve complex data issues.
- 6+ years of experience in data engineering, big data technologies, or a similar role.
How To Apply:
Incase you would like to apply to this job directly from the source, please click here
Responsibilities:
- Design, build, and optimize scalable data pipelines using Scala and Hadoop frameworks.
- Develop and implement techniques and analytics applications to transform raw data into meaningful information using data-oriented programming languages and visualisation software.
- Write and optimize complex SQL queries for efficient data retrieval and transformation.
- Troubleshoot and resolve performance issues in queries and data workflows.
- Manage Hadoop-based data infrastructure, including HDFS, Hive, and related components.
- Monitor system performance and optimize resource utilization in a distributed environment
REQUIREMENT SUMMARY
Min:6.0Max:11.0 year(s)
Information Technology/IT
IT Software - DBA / Datawarehousing
Software Engineering
Graduate
Proficient
1
Singapore, Singapore
