Data Engineer (1 - 2 years of experience as SDET, Big Data Testing, PySpark at Visa

Bengaluru, karnataka, India -

Full Time

Start Date

Immediate

Expiry Date

19 Apr, 26

Salary

0.0

Posted On

19 Jan, 26

Experience

0 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Skills

Data Engineering, Big Data Testing, PySpark, Test Automation, Hadoop, Data Validation, Performance Testing, CI/CD Pipelines, Spark SQL, ETL Processes, Collaboration, Quality Assurance, Documentation, Problem Solving, Communication, Teamwork

Industry

IT Services and IT Consulting

Description

Company Description Visa is a world leader in payments technology, facilitating transactions between consumers, merchants, financial institutions and government entities across more than 200 countries and territories, dedicated to uplifting everyone, everywhere by being the best way to pay and be paid. At Visa, you'll have the opportunity to create impact at scale — tackling meaningful challenges, growing your skills and seeing your contributions impact lives around the world. Join Visa and do work that matters — to you, to your community, and to the world. Progress starts with you. Job Description At Visa, the Corporate Information Technology, Billing & Incentives Platforms team, enables Visa's revenue growth through flexible pricing engines and global revenue platforms built on next-generation technologies. This includes managing system requirements, evaluating cutting-edge technologies, design, development, integration, quality assurance, implementation and maintenance of corporate revenue applications. The team works closely with business owners of these services to deliver customer developed solutions, as well as implement industry leading packaged software. This team has embarked on a major transformational journey to build and implement best of breed revenue and billing applications to transform our business as well as technology. The candidate should enjoy working on diverse technologies and should be excited to take initiatives to solve complex business problems and get the job done while taking on new challenges. You should thrive in team-oriented and fast-paced environments where each team-member is vital to the overall success of the projects. Key Responsibilities Develop and maintain test automation scripts using PySpark for big data applications. Collaborate with data engineers and developers to understand data processing workflows and requirements. Design and implement automated tests for data ingestion, processing, and transformation in a Hadoop ecosystem. Perform data validation, data integrity, and performance testing for Spark applications. Utilize Spark-specific concepts such as RDDs, Data Frames, Datasets, and Spark SQL in test automation. Create and manage CI/CD pipelines for automated testing in a big data environment. Identify, report, and track defects, and work with the development team to resolve issues. Optimize and tune Spark jobs for performance and scalability. Maintain and update test cases based on new features and changes in the application. Document test plans, test cases, and test results comprehensively. Perform QA and manual testing for payments applications, ensuring compliance with business requirements and standards. Work with limited direction, usually within a complex environment, to drive delivery of solutions and meet service levels. Productively work with stakeholders in multiple countries and time zones. With active engagement, collaboration, effective communication, quality, integrity, and reliable delivery develop and maintain a trusted and valued relationship with the team, customers and business partners. This is a hybrid position. Expectation of days in office will be confirmed by your hiring manager. Qualifications Basic Qualifications: Bachelor's degree, OR 3+ years of relevant work experience Preferred Qualifications: Bachelor’s degree in computer science, Information Technology, or related field. Relevant certifications in Big Data, Spark, QA. Experience with on premise infrastructure Knowledge of ETL processes and tools. Additional Information Visa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law. Job Family Group: Technology and Operations

Responsibilities

The candidate will develop and maintain test automation scripts using PySpark for big data applications and collaborate with data engineers and developers to understand data processing workflows. They will also perform data validation and maintain test cases based on new features and changes in the application.