Senior Data Engineer
at Epam Systems
Praha, Praha, Czech -
| Start Date | Expiry Date | Salary | Posted On | Experience | Skills | Telecommute | Sponsor Visa |
|---|---|---|---|---|---|---|---|
| Immediate | 28 Nov, 2024 | Not Specified | 31 Aug, 2024 | N/A | Working Experience,Apache Spark,Aws,Azure,Github,Scala,Landscape | No | No |
Required Visa Status:
| Citizen | GC |
| US Citizen | Student Visa |
| H1B | CPT |
| OPT | H4 Spouse of H1B |
| GC Green Card |
Employment Type:
| Full Time | Part Time |
| Permanent | Independent - 1099 |
| Contract – W2 | C2H Independent |
| C2H W2 | Contract – Corp 2 Corp |
| Contract to Hire – Corp 2 Corp |
Description:
We are looking for a Senior Data Engineer to make a team even stronger.
REQUIREMENTS
- Expertise in Apache Spark along with Spark streaming & Spark SQL
- Good hands on experience with Databricks and delta-lake
- Fluency in Scala programming language
- Good understanding & hands-on experience with CI/CD
- Rich working experience with Github
- Fluency working with any cloud (AWS, Azure, GCP) landscape
- Ability to build Apache Airflow pipelines
Responsibilities:
- Develop, monitor, and operate the most used and most critical curated data pipeline - Sales Order Data (incl. Post-order information, e.g. shipment, return, payment). This pipeline is processing hundreds of millions of records to provide high-quality datasets for analytical and machine learning use-cases
- Consulting with analysts, data scientists, and product managers to build and continuously improve “Single Source of Truth” KPI for business steering such as the central Profit Contribution measurement (PC II)
- Leverage and improve a cloud-based tech stack that includes AWS(Azure), Databricks, Kubernetes, Spark, Airflow, Python, and Scala
REQUIREMENT SUMMARY
Min:N/AMax:5.0 year(s)
Information Technology/IT
IT Software - Application Programming / Maintenance
Software Engineering
Graduate
Proficient
1
Praha, Czech
