Data Engineer at PayPal

Bengaluru, karnataka, India -

Full Time

Start Date

Immediate

Expiry Date

13 Feb, 26

Salary

0.0

Posted On

15 Nov, 25

Experience

0 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Skills

Data Engineering, Data Pipelines, Data Quality, Data Transformation, Big Query, Apache Spark, Scala, Java, ETL, Data Modeling, Cloud Platforms, Data Orchestration, Streaming Data, Version Control, Data Security, Problem Solving, Communication

Industry

Software Development

Description

Design and develop data pipelines for efficient data collection and processing. Build and maintain scalable data storage solutions. Ensure data quality and consistency through validation and cleansing processes. Implement data transformation techniques to prepare data for analysis. Collaborate with cross-functional teams to understand data requirements and provide solutions. Optimize data engineering processes for performance and reliability. Data Pipeline Development Design, build, and maintain efficient data platforms to process large volumes of data Develop and optimize data workflows using modern data engineering tools and frameworks Ensure data quality, reliability, and performance across all data processing systems Monitor and troubleshoot data pipeline issues, implementing proactive solutions Work with Big Query and other cloud data platforms to optimize data storage and retrieval Implement data governance best practices and ensure compliance with data standards Collaborate on data architecture decisions and technical design reviews Participate in agile development processes and contribute to team planning and retrospectives 1+ years relevant experience and a Bachelor's degree OR Any equivalent combination of education and experience. Apache Spark Framework: Deep understanding of Spark Core, including RDDs, Data Frames, and Datasets. Experience with Spark SQL for structured data processing Big Query: Hands-on experience with Google Big Query, including query optimization and cost management Programming: Proficiency in Scala / Java ETL Knowledge: Solid understanding of ETL concepts, tools, and best practices Data Modeling: Experience with dimensional modeling, data warehousing concepts, and schema design 1 - 2 years of experience in data engineering Strong problem-solving abilities and attention to detail Excellent communication skills and ability to explain technical concepts to non-technical stakeholders Experience working in collaborative, cross-functional team environments Experience with cloud platforms (Google Cloud Platform, AWS, or Azure) Knowledge of data orchestration tools (Apache Airflow, Prefect, or similar) Familiarity with streaming data technologies (Apache Kafka, Pub/Sub) Experience with version control systems (Git) and CI/CD practices Understanding of data security and privacy principles Bachelor's degree in computer science & engineering, or related field

Responsibilities

Design and develop data pipelines for efficient data collection and processing while ensuring data quality and consistency. Collaborate with cross-functional teams to understand data requirements and optimize data engineering processes for performance and reliability.