Databricks Data Engineer at Diaconia LLC

Silver Spring, Maryland, United States -

Full Time

Start Date

Immediate

Expiry Date

09 Aug, 26

Salary

140000.0

Posted On

11 May, 26

Experience

5 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Skills

Databricks, Python, PySpark, SQL, ETL, Cloud Platforms, AWS, Azure, Medallion Architecture, Data Quality, Data Pipelines, Delta Lake, Problem-Solving, Data Governance, Data Processing, Scalable Solutions

Industry

IT Services and IT Consulting

Description

Description We are seeking a Databricks Data Engineer with strong hands-on experience in Python and PySpark to support a fast-paced, high-impact delivery environment. This role requires someone who can quickly step in, take ownership, and deliver scalable data solutions with minimal ramp-up. Key Responsibilities · Design, develop, and optimize data pipelines and ETL workflows using Databricks · Build scalable data processing solutions leveraging PySpark and Python · Work with large-scale datasets across cloud platforms (AWS and/or Azure) · Implement and maintain Medallion Architecture (Bronze, Silver, Gold layers) · Ensure data quality, performance optimization, and reliability of data pipelines · Collaborate with cross-functional teams to support data-driven initiatives Required Qualifications · 3 to 5 years of experience in Databricks is required. · Strong hands-on experience with Databricks, Python, PySpark, and SQL · Proven experience building and optimizing ETL pipelines · Experience working with large-scale data environments · Solid understanding of cloud platforms (AWS and/or Azure) · Familiarity with Medallion architecture (Delta Lake) · Ability to work independently in fast-paced, deadline-driven environments What We’re Looking For · Someone who can hit the ground running with minimal onboarding · Strong sense of ownership and accountability · Ability to deliver under tight timelines without compromising quality · Proactive problem-solver with a delivery-first mindset Nice to Have · Experience with Delta Lake · Exposure to data governance and data quality frameworks · Prior experience in federal or regulated environments Preferred Additional Qualifications: · Experience with Delta Lake · Exposure to data governance and data quality frameworks · Prior experience in federal or regulated environments Requirements Required Qualifications: : Education: Bachelor's degree in information systems, computer science, or other related field. Will accept a suitable combination of education, training, or experience Clearance: Clearance: Federal Health Agency within the U.S. Department of Health and Human Services Public Trust clearance Onsite Requirement: Location: Hybrid - locals to DMV area Professional Experience 3 to 5 years of experience in Databricks is required. Strong hands-on experience with Databricks, Python, PySpark, and SQL Proven experience building and optimizing ETL pipelines Experience working with large-scale data environments Solid understanding of cloud platforms (AWS and/or Azure) Familiarity with Medallion architecture (Delta Lake) Ability to work independently in fast-paced, deadline-driven environments

Responsibilities

The Databricks Data Engineer will design, develop, and optimize data pipelines and ETL workflows using Databricks. They will collaborate with cross-functional teams to ensure data quality and performance optimization.