Data Engineer at PayPal

Chennai, tamil nadu, India -

Full Time

Start Date

Immediate

Expiry Date

04 Feb, 26

Salary

0.0

Posted On

06 Nov, 25

Experience

2 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Skills

Data Pipeline Development, SQL Expertise, BigQuery, Programming, ETL Knowledge, Data Modeling, Problem-Solving, Communication, Cloud Platforms, Data Orchestration Tools, Streaming Data Technologies, Version Control Systems, Data Security, Data Privacy Principles

Industry

Software Development

Description

Design and develop data pipelines for efficient data collection and processing. Build and maintain scalable data storage solutions. Ensure data quality and consistency through validation and cleansing processes. Implement data transformation techniques to prepare data for analysis. Collaborate with cross-functional teams to understand data requirements and provide solutions. Optimize data engineering processes for performance and reliability. Data Pipeline Development Design, build, and maintain efficient ETL/ELT pipelines to process large volumes of data Develop and optimize data workflows using modern data engineering tools and frameworks Ensure data quality, reliability, and performance across all data processing systems Monitor and troubleshoot data pipeline issues, implementing proactive solutions Work with BigQuery and other cloud data platforms to optimize data storage and retrieval Implement data governance best practices and ensure compliance with data standards Collaborate on data architecture decisions and technical design reviews Participate in agile development processes and contribute to team planning and retrospectives 1+ years relevant experience and a Bachelor's degree OR Any equivalent combination of education and experience. SQL Expertise: Advanced proficiency in SQL for complex data manipulation, optimization, and analysis BigQuery: Hands-on experience with Google BigQuery, including query optimization and cost management Programming: Proficiency in Python or other scripting languages for data processing and automation ETL Knowledge: Solid understanding of ETL concepts, tools, and best practices Data Modeling: Experience with dimensional modeling, data warehousing concepts, and schema design 2-4 years of experience with 1+ years of relevant experience in data engineering or related field Strong problem-solving abilities and attention to detail Excellent communication skills and ability to explain technical concepts to non-technical stakeholders Experience working in collaborative, cross-functional team environments Experience with cloud platforms (Google Cloud Platform, AWS, or Azure) Knowledge of data orchestration tools (Apache Airflow, Prefect, or similar) Familiarity with streaming data technologies (Apache Kafka, Pub/Sub) Experience with version control systems (Git) and CI/CD practices Understanding of data security and privacy principles Bachelor's degree in Computer Science, Engineering, or related field

Responsibilities

Design and develop data pipelines for efficient data collection and processing while ensuring data quality and consistency. Collaborate with cross-functional teams to understand data requirements and optimize data engineering processes for performance and reliability.