Data Engineer
at AVN DIGITAL PTE LTD
Singapore, Southeast, Singapore -
Start Date | Expiry Date | Salary | Posted On | Experience | Skills | Telecommute | Sponsor Visa |
---|---|---|---|---|---|---|---|
Immediate | 14 Sep, 2024 | USD 5000 Monthly | 18 Jun, 2024 | N/A | Apache Spark,Transformation,Communication Skills,Scala,Data Extraction,Python,Programming Languages,Java | No | No |
Required Visa Status:
Citizen | GC |
US Citizen | Student Visa |
H1B | CPT |
OPT | H4 Spouse of H1B |
GC Green Card |
Employment Type:
Full Time | Part Time |
Permanent | Independent - 1099 |
Contract – W2 | C2H Independent |
C2H W2 | Contract – Corp 2 Corp |
Contract to Hire – Corp 2 Corp |
Description:
AVN-Digital is an expert in providing technology enabled business solutions and services. Since inception, AVN-Digital has helped clients Cyber-security, Data Analytics and Robotic Process Automation to improve their operations and profitability, focus on core competencies and achieve business results such as increased agility, innovation and profitable growth. Our in-depth technical knowledge coupled with industry experience and our unique methodologies enable us to successfully deliver and meet our customer’s expectations.
We are currently looking to hire a “Data Engineer, This is an exciting opportunity to expand your skill set, achieve job satisfaction and work-life balance. More details as below.
Seeking a talented Data Engineer to join the team. In this role, you will be responsible for designing, building, and maintaining data pipelines to support data analytics and business intelligence initiatives. Will collaborate with cross-functional teams to develop efficient data pipelines and ensure the integrity and quality of the data.
Responsibilities:
- Develop ETL processes to extract, transform, and load data from various sources into our data warehouse.
- Develop and maintain scalable data pipelines for batch and real-time processing.
- Collaboration with cross-functional teams to understand and meet data requirements.
- Monitor data pipelines and troubleshoot issues as they arise.
- Ensure data quality and integrity throughout the data pipeline.
- Optimize and tune existing data pipelines for performance and efficiency.
- Monitor data pipelines and troubleshoot issues as needed.
- Conducting performance tuning and optimization of database systems for improved efficiency.
- Designing and implementing data models and schema designs for efficient data storage and retrieval.
- Providing post-deployment support and troubleshooting assistance to address any issues or challenges encountered by users or stakeholders.
Requirements:
- Proven experience as a Data Engineer or similar role.
- Ability to develop ETL processes for data extraction, transformation, and loading.
- Proficiency in programming languages such as Python, Java, or Scala.
- Experience with distributed computing frameworks (e.g., Apache Spark, Hadoop).
- Strong understanding of SQL and database technologies.
- Excellent problem-solving and communication skills.
How To Apply:
Incase you would like to apply to this job directly from the source, please click here
Responsibilities:
- Develop ETL processes to extract, transform, and load data from various sources into our data warehouse.
- Develop and maintain scalable data pipelines for batch and real-time processing.
- Collaboration with cross-functional teams to understand and meet data requirements.
- Monitor data pipelines and troubleshoot issues as they arise.
- Ensure data quality and integrity throughout the data pipeline.
- Optimize and tune existing data pipelines for performance and efficiency.
- Monitor data pipelines and troubleshoot issues as needed.
- Conducting performance tuning and optimization of database systems for improved efficiency.
- Designing and implementing data models and schema designs for efficient data storage and retrieval.
- Providing post-deployment support and troubleshooting assistance to address any issues or challenges encountered by users or stakeholders
REQUIREMENT SUMMARY
Min:N/AMax:5.0 year(s)
Information Technology/IT
IT Software - DBA / Datawarehousing
Software Engineering
Graduate
Proficient
1
Singapore, Singapore