Sign up with

Already have an account? Log in here

Need some help?
Talk to us at +91 7670800001

Senior Data Engineer at onebeat

Ramat Gan, Tel Aviv, Israel -

Full Time

Start Date

Immediate

Expiry Date

11 Apr, 26

Salary

0.0

Posted On

11 Jan, 26

Experience

5 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Skills

Data Engineering, Spark, Iceberg, SQL, AWS, Python, Data Pipelines, ETL, Microservices, Orchestration, Data Lakehouse, Governance, BI, Temporal Workflow, ClickHouse, K8S

Industry

Software Development

Description

We are seeking an experienced Senior Data Engineer. The ideal candidate is a self-motivated, multi-tasking team player with a proven track record of collaboration. You will be responsible for designing, developing, managing, and maintaining our open-source data platform, including our Data Lakehouse (S3, Spark, Iceberg, and ClickHouse), ETL processes, and orchestration tool (Temporal Workflow). What You Will Do Develop a scalable data platform that integrates multiple sources for easy access. Design and enhance data tools, including orchestration, governance, Data Lakehouse, BI, and more. Ensure the smooth operation of data systems for analysts, data scientists, and engineers. Optimize data pipelines—ingestion, processing, and output—within a microservices environment. Requirements 5+ years of experience in a data engineering-related position. Experience with Spark. Experience with Iceberg. SQL expertise, including working with various databases, data warehouses, third-party data sources, and AWS cloud services. Proficient in Python (OOP + Processing packages like Polars). Experience in building, designing, and optimizing data pipelines. Self-driven, can-do attitude. Nice to Have: Experience with ClickHouse. Experience with Glue Data Catalogue. Experience with K8S. Experience with Temporal Workflow. Familiarity with ERP systems (big advantage). Familiarity with supply chain systems (advantage).

Responsibilities

You will be responsible for designing, developing, managing, and maintaining our open-source data platform. This includes developing a scalable data platform, optimizing data pipelines, and ensuring smooth operation for analysts and data scientists.