Sign up with

Already have an account? Log in here

Need some help?
Talk to us at +91 7670800001

Assistant Manager at EXL Talent Acquisition Team

Pune, maharashtra, India -

Full Time

Start Date

Immediate

Expiry Date

05 Oct, 26

Salary

0.0

Posted On

07 Jul, 26

Experience

5 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Skills

PySpark, SQL, Python, Hive, Oozie, AWS, Hadoop, ETL, Databricks, Linux/Unix, DBT, Dagster, Data Warehousing, Data Pipelines, Data Processing, Data Validation

Industry

Business Consulting and Services

Description

Job Title: Data Engineer (5+ Years Experience) Job Summary We are seeking a Data Engineer with 5+ years of experience in building and maintaining data pipelines using PySpark, SQL, and Python. The candidate should have a solid understanding of Bigdata tools like Hadoop, Hive, Oozie and have basic knowledge of cloud environments (preferably AWS). The role requires working closely with teams to support data processing and analytics needs. Key Responsibilities * Develop and maintain data pipelines using PySpark and Python, Hive, Oozie * Write efficient SQL queries for data extraction, transformation, and validation * Assist in integrating data from multiple sources and ensuring data accuracy * Support debugging, monitoring, and optimization of data pipelines * Collaborate with team members to understand data requirements and deliver solutions * Follow best practices for data engineering and documentation Required Skills (Primary) * 5+ years of hands-on experience in PySpark, SQL, and Python * 5+ years of hands-on experience in Big Data Tools like Hive ,Oozie * Working knowledge of cloud environments (preferably AWS) * Understanding of data processing and ETL concepts Secondary Skills * Basic experience with Databricks * Familiarity with Linux/Unix commands for working on edge nodes * Exposure to scheduling or orchestration tools Good to Have * Basic understanding of finance domain * Exposure to Hive and Oozie * Understanding of data warehousing concepts * DBT, DAGSTER Qualifications * Bachelor's degree in computer science, Engineering, or related field * 5+ years of relevant experience in data engineering or big data technologies Soft Skills * Good analytical and problem-solving skills * Effective communication and teamwork abilities * Willingness to learn and adapt in a fast-paced environment

Responsibilities

Develop and maintain data pipelines using PySpark, Python, Hive, and Oozie. Write efficient SQL queries for data extraction and transformation while collaborating with teams to support analytics needs.