Data Engineer Operations at Visa

Bengaluru, karnataka, India -

Full Time

Start Date

Immediate

Expiry Date

12 Feb, 26

Salary

0.0

Posted On

14 Nov, 25

Experience

5 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Skills

Data Engineering, Data Operations, Apache Airflow, Hadoop Ecosystem, PySpark, Python, Shell Scripting, SQL, GenAI Solutions, Cloud Services, Data Visualization Tools, Analytical Skills, Troubleshooting, Documentation, Collaboration, Problem-Solving

Industry

IT Services and IT Consulting

Description

Company Description Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and secure payments network, enabling individuals, businesses, and economies to thrive while driven by a common purpose – to uplift everyone, everywhere by being the best way to pay and be paid. Make an impact with a purpose-driven industry leader. Join us today and experience Life at Visa. Job Description Data Engineer role for Asia Pacific Region is based out of Bangalore. We are looking for an expert Data Engineer (Analyst level), who will be responsible for data pipeline development, optimization, deployment and operational support as required for client deliveries across AP markets. This is a Pan-regional position and plays a critical role in enabling the data solutions through which Data Scientists, Analysts, and BI Users drive solutions for our Visa clients. He/she will bring in deep expertise in data pipeline design and development with a strong background in deploying and operationalizing data Pipelines at scale to unlock business value. Data Pipeline build, optimization and Support: Take ownership of build, deployment and operational quality of data engineering pipelines, ensuring efficiency, reliably, and timeliness. Deployment and Scaling: Manage the deployment and scaling of data pipelines using configuration-driven and parameterized Airflow DAGs. Productivity improvement: Think out of the box to improve operational efficiency using AI /log analytics/automated failure recovery. Troubleshooting and Resolution: Proactively identify, investigate, and resolve complex issues and errors within the data pipelines, minimizing downtime and ensuring data integrity. Performance Monitoring: Monitor performance of data pipelines, identify bottlenecks, and collaborate with engineering teams to implement optimizations. Documentation: Maintain comprehensive documentation for operational procedures, troubleshooting guides, and pipeline configurations. Standardization: Contribute to the development of internal frameworks, templates, and accelerators for data engineering and data science consulting. This is a hybrid position. Expectation of days in office will be confirmed by your Hiring Manager. Qualifications We are looking for a motivated, analytical-minded individual with a track record of using data and analytics to unlock business value. The candidate should have accumulated good industry work experience, in designing, deploying and maintaining /supporting complex big data pipelines. Basic Qualifications: • 5+ years of relevant work experience and a Bachelors degree, OR 5+ years of relevant work experience • Skill Level: Hands on experience in a data engineering and data operations role. • Apache Airflow: Proven proficiency in deploying, running, and troubleshooting complex, parameterized, and configuration-driven Airflow DAGs. Comprehensive knowledge of Airflow native Operators. • Hadoop Ecosystem: Strong understanding of Hadoop architecture and its core components, including HDFS, YARN, and MapReduce. • PySpark : Demonstrable experience in writing, optimizing, and supporting PySpark/ Scala jobs for large-scale data processing. • Programming: Proficient in Python for data manipulation and automation, along with strong skills in Shell scripting. • Problem-Solving: Excellent analytical and troubleshooting skills with the ability to diagnose and resolve technical issues independently. • Database Knowledge: Solid understanding of SQL and experience working with various database systems. • Familiar/Skilled in identifying and implementing GenAI solutions is desirable. • Self-motivated, results oriented individual with ability to handle multiple projects concurrently. (Good to Have) • Knowledge of Cloud Services such as AWS/Azure. • Understanding GenAI Tools. • Understanding of Data Visualization Tools like Tableau / Power BI. Preferred Qualifications: • Self-Driven and Proactive: A highly motivated individual who takes initiative to identify potential issues and implement solutions without direct supervision. • Dedicated: Committed to ensuring the highest standards of quality and reliability for our data operations. • Proactive Communicator: Excellent verbal and written communication skills, with the ability to provide clear and timely updates to stakeholders on pipeline status and incidents. • Collaborative Spirit: A team player who can work effectively with data engineers, analysts, and other teams to achieve common goals. • Detail-Oriented: A keen eye for detail to ensure data accuracy and process integrity. Additional Information Visa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.

Responsibilities

The Data Engineer will be responsible for data pipeline development, optimization, deployment, and operational support for client deliveries across AP markets. This role is critical in enabling data solutions for Data Scientists, Analysts, and BI Users at Visa.