Sr. Data Engineer (PySpark / Scala) at Visa

Bengaluru, karnataka, India -

Full Time

Start Date

Immediate

Expiry Date

05 May, 26

Salary

0.0

Posted On

04 Feb, 26

Experience

5 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Skills

Data Pipelines, Spark, PySpark, Scala, Hadoop, MySQL, NoSQL, HBase, Docker, Kubernetes, AWS, Azure, GenAI, Agile, Test-Driven Development, Continuous Integration, Automated Testing

Industry

IT Services and IT Consulting

Description

Company Description Visa is a world leader in payments technology, facilitating transactions between consumers, merchants, financial institutions and government entities across more than 200 countries and territories, dedicated to uplifting everyone, everywhere by being the best way to pay and be paid. At Visa, you'll have the opportunity to create impact at scale — tackling meaningful challenges, growing your skills and seeing your contributions impact lives around the world. Join Visa and do work that matters — to you, to your community, and to the world. Progress starts with you. Job Description Proficient in developing scalable data pipelines utilizing Spark (PySpark / Scala). Demonstrated proficiency in Hadoop ecosystem. Hands-on experience with distributed, scalable, concurrent, and low-latency systems, including database technologies like MySQL and NoSQL data warehouses such as HBase. Experience working with Docker and Kubernetes. Experience working with cloud platforms such as AWS or Azure. Knowledge of GenAI and agentic frameworks is advantageous. Experience working in an Agile and Test-Driven Development environment. Experience with Continuous Integration and Automated Test tools such as Jenkins, Artifactory, Git, Selenium, Chef desirable. Strong on driving for results and self-motivated, strong learning mindset, with good understanding of related advanced/new technology. Keep up with the technology development in the related areas in the industry, which could be leveraged to enhance current architectures and build durable new ones. Strategic thinker and good business acumen to orient data engineering to the business needs of internal clients. Demonstrated intellectual and analytical rigor, strong attention to detail, team oriented, energetic, collaborative, diplomatic, and flexible style. This is a hybrid position. Expectation of days in office will be confirmed by your hiring manager. Qualifications Bachelor degree in a technical field such as computer science, computer engineering or related field required 5+ years of software development experience (with a concentration in data centric initiatives), with demonstrated expertise in leveraging standard development best practice methodologies Minimum of 3 years of hands-on expertise with Spark (PySpark / Scala), Hadoop and related technologies Additional Information Visa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law. Job Family Group: Technology and Operations

Responsibilities

Develop scalable data pipelines utilizing Spark (PySpark / Scala) and demonstrate proficiency in the Hadoop ecosystem. Work with distributed systems and various database technologies to enhance current architectures.