Senior Data Engineer - Databricks at RADcube

Indianapolis, Indiana, United States -

Full Time

Start Date

Immediate

Expiry Date

07 Sep, 26

Salary

0.0

Posted On

09 Jun, 26

Experience

5 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Skills

AWS, Databricks, SQL, Python, ETL/ELT, Data Modeling, Delta Lake, CI/CD, Data Governance, Lakehouse Architecture, S3, Glue, Lambda, Redshift, Workflow Orchestration, Data Observability

Industry

IT System Custom Software Development

Description

Job Title: Senior AWS Data Engineer Location: Indianapolis, IN Role Overview We are seeking a highly skilled AWS Data Engineer to support a strategic STRADA Modernization initiative. This role focuses on building and supporting a modern AWS + Databricks Lakehouse platform to enable advanced healthcare analytics (RWD/HEOR). The ideal candidate will have strong hands-on experience with AWS, Databricks, and data pipeline development, along with the ability to work closely with both technical and business stakeholders. Key Responsibilities Design, develop, and maintain data ingestion pipelines for real-world data (RWD) sources Build and optimize data models within a Databricks Lakehouse architecture Ensure data governance, quality, and compliance standards are met Optimize cost, performance, and resource utilization across AWS and Databricks Collaborate with business and technical stakeholders to translate requirements into scalable solutions Provide technical guidance, coding standards, and best practices Support knowledge sharing through documentation and training sessions Deliver status updates and progress reports to senior leadership Requirements Required Qualifications Strong hands-on experience with AWS services (S3, Glue, Lambda, Redshift, etc.) Proven experience with Databricks (Delta Lake, notebooks, workflows) Expertise in SQL and Python Experience building end-to-end ETL/ELT data pipelines Strong understanding of data modeling techniques Experience with data governance, quality, and compliance frameworks Ability to work independently and in a collaborative team environment Databricks Certification Experience building and managing CI/CD pipelines Experience with workflow orchestration tools Exposure to data observability and lineage tools Experience with monitoring, logging, and observability frameworks Highly Preferred Skills Experience in Healthcare / Pharma domain Exposure to RWD (Real World Data) or HEOR analytics Familiarity with Lakehouse architecture / Medallion (Bronze-Silver-Gold) models Experience optimizing cost and performance in cloud environments Strong communication and stakeholder management skills

Responsibilities

Design and maintain data ingestion pipelines and optimize data models within a Databricks Lakehouse architecture for healthcare analytics. Collaborate with stakeholders to translate business requirements into scalable technical solutions while ensuring data governance and quality.