Lead Cloud Data Engineer - Manager at State Street Corporation - United States

Hyderabad, Telangana, India -

Full Time

Start Date

Immediate

Expiry Date

10 Jun, 26

Salary

0.0

Posted On

12 Mar, 26

Experience

10 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Skills

Cloud Data Engineering, Databricks, Spark, PySpark, SQL, Data Pipelines, Lakehouse Architecture, Delta Tables, Data Quality, Performance Tuning, CI/CD, Git, Jenkins, Airflow, Python, Agile

Industry

Financial Services

Description

Who we are looking for: We are seeking an experienced Lead Cloud Data Engineer to design, build, and optimize scalable data solutions on cloud platforms. The candidate should have industry experience (preferably in Financial Services) in building cloud based database engineering platforms. The role requires strong technical expertise in Databricks and Spark. What you will be responsible for: Design, develop, and optimize end‑to‑end data pipelines using Databricks Implement and manage Lakehouse architecture with Delta tables Develop high‑performance PySpark and SQL transformations Ensure data quality, integrity, and performance across pipelines Lead troubleshooting, root cause analysis, and performance tuning Collaborate with Architects, Business Analysts, and downstream consumers Support CI/CD implementation for Databricks jobs and notebooks Mentor junior engineers and review code for quality and best practices Ensure adherence to security, governance, and compliance standards What we value: Technical leadership and mentoring mindset Strong ownership and delivery focus Collaboration and teamwork across global teams Proactive identification of risks and improvement opportunities Mandatory skills / experience: 10-14 years of hands on experience with AWS Cloud Data Engineering with Databricks platform Expertise in Data Modeling and DB design Hands on experience in setting up data pipelines for ETL jobs across multiple data sources. Hands‑on experience with performance tuning, Git, Jenkins, and enterprise job scheduling tools (Autosys / Airflow) Basic understanding of Data warehousing and ETL concepts Knowledge of CI/CD tools (GitHub, Azure DevOps) Advanced SQL and Python skills Experience working in Agile delivery environments Additional requirements / Good to have skills: Experience in regulatory or financial services domain Databricks or Cloud certifications Experience with visualization tools (PowerBI, Tableau) Exposure to Starburst, Spotfire, TDV, ServiceNow Mode of work: Hybrid (Hyderabad or Bangalore) Are you the right candidate? Yes! We truly believe in the power that comes from the diverse backgrounds and experiences our employees bring with them. Although each vacancy details what we are looking for, we don’t necessarily need you to fulfil all of them when applying. If you like change and innovation, seek to see the bigger picture, make data driven decisions and are a good team player, you could be a great fit. Why this role is important to us: Our technology function, Global Technology Services (GTS), is vital to State Street and is the key enabler for our business to deliver data and insights to our clients. We’re driving the company’s digital transformation and expanding business capabilities using industry best practices and advanced technologies such as cloud, artificial intelligence and robotics process automation. We offer a collaborative environment where technology skills and innovation are valued in a global organization. We’re looking for top technical talent to join our team and deliver creative technology solutions that help us become an end-to-end, next-generation financial services company. Join us if you want to grow your technical skills, solve real problems and make your mark on our industry. About State Street Across the globe, institutional investors rely on us to help them manage risk, respond to challenges, and drive performance and profitability. We keep our clients at the heart of everything we do, and smart, engaged employees are essential to our continued success. We are committed to fostering an environment where every employee feels valued and empowered to reach their full potential. As an essential partner in our shared success, you’ll benefit from inclusive development opportunities, flexible work-life support, paid volunteer days, and vibrant employee networks that keep you connected to what matters most. Join us in shaping the future. As an Equal Opportunity Employer, we consider all qualified applicants for all positions without regard to race, creed, color, religion, national origin, ancestry, ethnicity, age, disability, genetic information, sex, sexual orientation, gender identity or expression, citizenship, marital status, domestic partnership or civil union status, familial status, military and veteran status, and other characteristics protected by applicable law. Discover more information on jobs at StateStreet.com/careers Read our CEO Statement Across the globe, institutional investors rely on us to help them manage risk, respond to challenges, and drive performance and profitability. We keep our clients at the heart of everything we do, and smart, engaged employees are essential to our continued success. We are committed to fostering an environment where every employee feels valued and empowered to reach their full potential. As an essential partner in our shared success, you’ll benefit from inclusive development opportunities, flexible work-life support, paid volunteer days, and vibrant employee networks that keep you connected to what matters most. Join us in shaping the future. As an Equal Opportunity Employer, we consider all qualified applicants for all positions without regard to race, creed, color, religion, national origin, ancestry, ethnicity, age, disability, genetic information, sex, sexual orientation, gender identity or expression, citizenship, marital status, domestic partnership or civil union status, familial status, military and veteran status, and other characteristics protected by applicable law. Discover more information on jobs at StateStreet.com/careers Read our CEO Statement

How To Apply:

Incase you would like to apply to this job directly from the source, please click here

Responsibilities

The role involves designing, developing, and optimizing end-to-end data pipelines using Databricks, implementing Lakehouse architecture with Delta tables, and developing high-performance PySpark and SQL transformations. Responsibilities also include leading troubleshooting, ensuring data quality, and supporting CI/CD implementation for Databricks jobs.