Lead Data Engineer at Sharp part of UDG Healthcare plc
California, California, USA -
Full Time


Start Date

Immediate

Expiry Date

24 Dec, 26

Salary

120000.0

Posted On

14 Nov, 26

Experience

5 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

No

Skills

Industry

Information Technology & Services

Description

Job Details

Skills

  • Computer Science
  • FOCUS
  • Data Processing
  • Storage
  • Mentorship
  • Workflow
  • Orchestration
  • BMC Control-M
  • Apache Kafka
  • Streaming
  • Change Data Capture
  • Apache HTTP Server
  • Snow Flake Schema
  • Data Warehouse
  • Optimization
  • Regulatory Compliance

Show more



Summary

Location: Columbus, OH Salary: $70.00 USD Hourly - $80.00 USD Hourly Description: Lead Data Engineer


  • Bachelor's degree in Computer Science, Engineering, or a related technical field, or equivalent practical experience.
  • 10+ years of experience in software engineering with significant focus on data engineering and distributed systems.
  • Strong programming expertise in Java and Python.
  • Experience designing and building enterprise-scale ETL/ELT platforms.
  • Deep understanding of Apache Spark and distributed data processing concepts.
  • Experience with AWS cloud services and cloud-native architectures.
  • Proven experience with data lakes, lakehouse architectures, and large-scale data platforms.
  • Experience working with Parquet, Avro, and related storage technologies.
  • Experience leading technical initiatives and mentoring engineering teams.
  • Demonstrated experience leveraging AI-assisted development tools within software engineering workflows.

Preferred Qualifications

  • Experience with workflow orchestration platforms such as Airflow, Dagster, or Control-M.
  • Experience with streaming technologies including Kafka and Spark Structured Streaming.
  • Knowledge of Change Data Capture (CDC), upsert strategies, and incremental processing frameworks.
  • Experience with Delta Lake, Apache Iceberg, or Apache Hudi.
  • Experience working with Snowflake or other cloud data warehouse technologies.
  • Familiarity with FinOps and cloud cost optimization practices.
  • Experience operating mission-critical systems in regulated environments.
  • Understanding of compliance, audit, privacy, and PII governance requirements.
  • Experience building or supporting Generative AI and Agentic AI solutions.

Required Technical Skills


Programming Languages

  • Java
  • Python


Cloud & Platform

  • AWS
  • Data Lake / Lakehouse Architecture


Big Data Technologies

  • Apache Spark
  • Parquet
  • Avro


Data Engineering

  • ETL / ELT Development
  • Data Modeling
  • Data Quality
  • Data Governance
  • Data Lineage


Software Engineering

  • REST APIs
  • CI/CD
  • Automated Testing
  • Observability
  • Secure Coding


AI & Automation

  • AI-Assisted Software Development Tools
  • AI Code Review and Test Automation
  • Responsible AI Practices



Medical, dental, and vision insurance are available to qualified candidates who meet eligibility requirements.

By providing your phone number, you consent to: (1) receive automated text messages and calls from the Judge Group, Inc. and its affiliates (collectively "Judge") to such phone number regarding job opportunities, your job application, and for other related purposes. Message & data rates apply and message frequency may vary. Consistent with Judge's Privacy Policy, information obtained from your consent will not be shared with third parties for marketing/promotional purposes. Reply STOP to opt out of receiving telephone calls and text messages from Judge and HELP for help.

Contact:

This job and many more are available through The Judge Group. Please apply with us today!

  • Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to corre
Responsibilities

Loading...