Data Engineer IV - IN at Rackspace the 1 managed cloud company

, Odisha, India -

Full Time

Start Date

Immediate

Expiry Date

10 Jul, 26

Salary

0.0

Posted On

11 Apr, 26

Experience

10 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Skills

Azure Data Factory, Azure Synapse Analytics, Azure Databricks, Microsoft Fabric, Spark, PySpark, SQL, Structured Streaming, Unity Catalog, Data Engineering, ETL/ELT, CI/CD, Data Governance, Performance Tuning, Leadership, Cloud Architecture

Industry

IT Services and IT Consulting

Description

Key Responsibilities Experience - 9+yrs Data Platforms & Pipeline Engineering Lead end-to-end development of scalable data pipelines and orchestration frameworks using Azure Data Factory (ADF), Azure Synapse Analytics, Azure Databricks, and Microsoft Fabric. Build robust real-time and batch data pipelines, including integration with streaming sources (e.g., Event Hubs, Kafka) and structured streaming engines. Design and implement Structured Streaming applications in Spark for near-real-time processing of streaming data. Develop and maintain ETL/ELT pipelines and transformations leveraging Spark, PySpark, SQL, and fabric orchestration capabilities. Microsoft Fabric & Azure Ecosystem Architect and implement data solutions using Microsoft Fabric, including OneLake, Dataflows, warehouses, and Fabric capacity planning to support enterprise analytics. Collaborate on data governance, cataloging, and asset organization using Unity Catalog within Databricks and Fabric environments. Manage Microsoft Fabric capacity and resource utilization to optimize performance and cost efficiency for analytics workloads. Databricks Engineering & Dashboards Design, deploy, and optimize Databricks dashboards and reporting artifacts for business stakeholders. Apply best practices for data modelling, caching, file sizing, and performance tuning of Spark and Delta Lake jobs (e.g., Z-ORDER, broadcast joins, adaptive query execution). Oversee governance, access controls, metadata management, and lineage using Unity Catalog. Leadership & Collaboration Lead and mentor a team of data engineers, fostering best practices in development, operations, documentation, and quality. Work with cross-functional teams (architecture, BI, data science, DevOps) to translate business requirements into scalable data solutions. Partner with stakeholders to define data strategy, standards, and architectural roadmaps. Quality, Governance & Compliance Establish and enforce standards for data quality, testing, monitoring, operational observability, and governance. Implement secure, compliant data access and lineage frameworks across cloud data platforms. DevOps & CI/CD Implement CI/CD pipelines, infrastructure-as-code for data platform artifacts, and automated testing frameworks for data jobs and workflows. Required Skills & Qualifications 10+ years of hands-on experience in data engineering on Azure with deep expertise in ADF, Synapse, Databricks, and Microsoft Fabric. Proven experience with real-time data processing, streaming architectures, and Spark Structured Streaming. Strong proficiency in Azure Data Factory, Spark (PySpark), SQL, Azure Synapse Analytics, Databricks Runtime, and cloud storage. Solid knowledge of Unity Catalog for data governance, security, and access management. Experience designing and managing Databricks Dashboards, performance optimization, cost controls, and data platform resource tuning. Expertise in building scalable, fault-tolerant, and high-throughput batch & streaming data solutions. Excellent leadership, cross-team collaboration, and communication skills. About Rackspace Technology We are the multicloud solutions experts. We combine our expertise with the world’s leading technologies — across applications, data and security — to deliver end-to-end solutions. We have a proven record of advising customers based on their business challenges, designing solutions that scale, building and managing those solutions, and optimizing returns into the future. Named a best place to work, year after year according to Fortune, Forbes and Glassdoor, we attract and develop world-class talent. Join us on our mission to embrace technology, empower customers and deliver the future. More on Rackspace Technology Though we’re all different, Rackers thrive through our connection to a central goal: to be a valued member of a winning team on an inspiring mission. We bring our whole selves to work every day. And we embrace the notion that unique perspectives fuel innovation and enable us to best serve our customers and communities around the globe. We welcome you to apply today and want you to know that we are committed to offering equal employment opportunity without regard to age, color, disability, gender reassignment or identity or expression, genetic information, marital or civil partner status, pregnancy or maternity status, military or veteran status, nationality, ethnic or national origin, race, religion or belief, sexual orientation, or any legally protected characteristic. If you have a disability or special need that requires accommodation, please let us know. Embrace Technology. Empower Customers. Deliver the Future. Excellence: We’re an accountable, disciplined, high-performing company with proven results. Customer-driven: We’re proactive, collaborative and committed to success for our customers. Expertise: We’re passionate learners, rooted in our customers’ business to provide unbiased solutions. Agility: We’re adopting new technologies and evolving services to meet customers where they are in their journey. Compassion: We’re one team, doing the right thing for our customers, communities and each other. We’re looking for team members who are ready to unleash their creativity, collaborate with talented coworkers and make a lasting impact in the IT field. Could that be you?

How To Apply:

Incase you would like to apply to this job directly from the source, please click here

Responsibilities

Lead the end-to-end development of scalable data pipelines and orchestration frameworks using the Azure and Microsoft Fabric ecosystems. Mentor a team of data engineers while collaborating with cross-functional departments to define data strategy and architectural standards.