Sr Data Engineer at Visa

Bengaluru, karnataka, India -

Full Time

Start Date

Immediate

Expiry Date

03 Jun, 26

Salary

0.0

Posted On

05 Mar, 26

Experience

5 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Skills

Hadoop, Spark, Python, Pandas, Iceberg, Data Modeling, Data Pipelines, Data Integration, CI/CD, Scala, SQL, PySpark, Bash, Airflow, Postgres, Cassandra

Industry

IT Services and IT Consulting

Description

Company Description Visa is a world leader in payments technology, facilitating transactions between consumers, merchants, financial institutions and government entities across more than 200 countries and territories, dedicated to uplifting everyone, everywhere by being the best way to pay and be paid. At Visa, you'll have the opportunity to create impact at scale — tackling meaningful challenges, growing your skills and seeing your contributions impact lives around the world. Join Visa and do work that matters — to you, to your community, and to the world. Progress starts with you. Job Description With data being the fuel that drives our future - our strategies, policies, and business successes around data will define our future growth prospects. Unlocking the value available through the innovative use of data on behalf of consumers, businesses, and communities is key to our future. With our ongoing commitment to Visa’s Data Values and the responsible use of data, we at Visa have a bold vision to continue to grow and accelerate our data-related businesses and capabilities. Led by Visa’s first Chief Data Officer, the Global Data Office coordinates high-impact, complex, company-wide projects related to data business strategy, critical investments, policy development, and marketplace execution. Working closely with Visa’s Chief Privacy Officer, the Technology organization, the wider data community, and the full set of Visa’s global lines of business, the Global Data Office is evolving Visa’s data-related work with momentum and enthusiasm. Driven by its commitment to trusted use of data, Visa is seeking enthusiastic leaders who are change-agents and passionate about the future of data around the world. About the Team We are a Data Engineering team within GDO, responsible for designing, building, and optimizing data pipelines and platforms that power Visa’s analytics, and decisioning capabilities. Our focus is on data quality, scalability, and reliability, enabling seamless integration of complex datasets across regions. By partnering with product and business teams, we ensure that data-driven solutions deliver measurable impact and support Visa’s global innovation strategy. About the role As a Senior Data Engineer, you will play a critical role in designing and delivering scalable, high-quality data solutions that enable intelligent decision-making across Global Data Engineering capabilities. You will leverage your expertise to design and implement large-scale data pipelines and integrated data solutions using the latest technologies, ensuring efficient data storage, processing, and presentation. You will also build and utilize advanced data modeling frameworks and adopt modern architectural patterns such as Medallion Architecture to deliver well-structured, efficient, and future-ready data solutions. Primary Responsibilities: Experience in Requirement Gathering, Estimating, Managing large scale Data Engineering Projects. Requirement Analysis: Understand and translate business needs into data models supporting long-term solutions. Data Modeling: Work with the Business team to implement data strategies, build data flows and develop conceptual data models. Data Pipeline Design: Create robust and scalable data pipelines and data products in a variety of domains. Data Integration: Develop and maintain data lakes by acquiring data from primary and secondary sources and build scripts that will make our data evaluation process more flexible or scalable across data sets. Testing: Define and manage the data load procedures to reject or discard datasets or data points that do not meet the defined business rules and quality thresholds. Operations: Able to independently manage the data load operations of the solutions or products in scope and be able to debug, manage stakeholder communications and provide clarification on the data produced. Understanding of and ability to Implement Data Engineering principles and best practices. Team Leadership: Lead and mentor a team of data engineers. Coordinate with other teams to manage and prioritize work packets. Stakeholder Management: Collaborate with stakeholders across the organization to understand their data needs and deliver solutions. Continuous Integration and Continuous Deployment (CI/CD): Implement and maintain CI/CD pipelines for data solutions, ensuring rapid, reliable, and streamlined updates to the data environment. Leverage AI on day to day tasks to bring in efficiency in implementation and quicker time to market. This is a hybrid position. Expectation of days in office will be confirmed by your hiring manager. Qualifications Qualifications: 5+ yrs. work experience with a bachelor’s degree with specialization in computer science, data engineering, information science, electronics, etc. Working knowledge of Hadoop ecosystem and associated technologies, (For e.g. Apache Spark, Python, Pandas etc.), Open table formats (e.g. Iceberg) Leadership Skills: Exhibits intellectual curiosity and a desire for continuous learning. Demonstrates integrity, maturity, and a constructive approach to business challenges. Role model for the organization and implementing core Visa Values Respect for the Individuals at all levels in the workplace Strive for Excellence and extraordinary results. Use sound insights and judgments to make informed decisions in line with business strategy and needs. Leadership skills include an ability to allocate tasks and resources across multiple lines of businesses and geographies. Leadership extends to ability to influence senior management within and outside Analytics groups. Ability to successfully persuade/influence internal stakeholders for building best-in-class solutions. Technical Skills: Extensive experience in big data tools: Hadoop, Hive, and Spark. Proficiency in Scala, Python, SQL, and PySpark. Experience with Unix/Linux systems with scripting experience in Bash. Experience with data pipeline and workflow management tools like Airflow, etc. Experience with relational SQL and NoSQL databases, including Postgres and Cassandra. Experience with cloud services AWS or Azure. Experience with stream-processing systems: Kafka, Spark-Streaming, etc. Strong analytic skills related to working with structured & unstructured datasets. Proficiency in managing and communicating data warehouse plans to internal clients. Experience with building processes supporting data transformation, data structures, metadata, dependency, and workload management. A successful history of manipulating, processing, and extracting value from large, disconnected datasets. Additional Information Visa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law. Job Family Group: Technology and Operations

Responsibilities

The Senior Data Engineer will be critical in designing and delivering scalable, high-quality data solutions, leveraging expertise to implement large-scale data pipelines and integrated data solutions using modern architectural patterns like Medallion Architecture. Primary duties include requirement analysis, data modeling, designing robust data pipelines, data integration from various sources, and managing data quality testing and operational loads.