Data Engineer - AWS/Databricks at Acuity INC

, Virginia, United States -

Full Time

Start Date

Immediate

Expiry Date

22 Apr, 26

Salary

0.0

Posted On

22 Jan, 26

Experience

2 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Skills

Data Engineering, AWS, Databricks, Spark, Delta Lake, ETL, ELT, Data Pipelines, Data Warehouse, Data Quality, Agile, PySpark, SQL, Git, CI/CD, Cloud Computing

Industry

IT Services and IT Consulting

Description

Overview Acuity Inc. is seeking a highly skilled Data Engineer to join our Engineering Team, helping drive the design and delivery of AWS cloud-scale data platforms for federal clients. This role requires knowledge and/or experience with Spark, Delta Lake, and distributed data pipelines on Databricks. The ideal candidate brings both engineering and strategic insight into enterprise data modernization. Why Acuity? Are you ready to use your expertise in the areas of IT Modernization, Data Enablement, and Hyperautomation to make a real difference? Join Acuity, Inc., a technology consulting firm that supports federal agencies. We combine industry partnerships and long-term federal experience with innovative technical leadership to support our customers’ critical missions. Responsibilities Build and maintain scalable PySpark-based data pipelines in Databricks notebooks to support ingestion, transformation, and enrichment of structured and semi-structured data. Design and implement Delta Lake tables optimized for ACID compliance, partition pruning, schema enforcement, and query performance across large datasets. Develop ETL and ELT workflows that integrate multiple source systems into a centralized, query-optimized data warehouse architecture. Leverage Spark SQL and DataFrame APIs to implement business rules, dimensional joins, and aggregation logic aligned to warehouse modeling best practices. Collaborate with data architects and engineers to implement cloud-native data solutions on AWS using S3, Glue, RDS, and IAM for secure, scalable storage and access control. Optimize pipeline performance through intelligent partitioning, caching, broadcast joins, and adaptive query tuning. Deploy and version data engineering assets using Git-integrated development workflows and automate deployment with CI/CD tools such as GitLab or Jenkins. Monitor pipeline health, job execution, and cluster utilization using native Databricks tools and AWS CloudWatch, identifying bottlenecks and optimizing cost-performance tradeoffs. Conduct technical discovery and mapping of legacy source systems, identifying required transformations and designing end-to-end data flows. Implement governance practices including metadata tagging, data quality validation, audit logging, and lineage tracking using platform-native features and custom logic. Support ad hoc data access requests, develop reusable data assets, and maintain shared notebooks that meet operational reporting and analytics needs across teams. Qualifications 2+ years of experience in data engineering and Agile analytics 2+ years of experience creating software for retrieving, parsing and processing structured and unstructured data 1 to 2 years of experience building scalable ETL and ELT workflows for reporting and analytics 1 or more years experience building enterprise data engineering solutions in the cloud, with preferred experience with cloud native technologies from AWS and Databricks Experience with data quality, validation frameworks, and storage optimization strategies BA or BS degree Clearance Requirement: Must be US Citizen with an ability to obtain and maintain US Suitability About Acuity: Acuity, Inc. is a leading management and technology consulting firm that specializes in serving the federal government. Our innovative, collaborative and rewarding work environment has earned repeat honors from the Washington Business Journal’s Best Places to Work and SmartCEO Corporate Culture awards. Why Choose Acuity? Innovative Excellence: Recognized by The Washington Post's "Top Workplaces" and a nine-time recipient of the Washington Business Journal's "Best Places to Work," Acuity fosters an environment where innovation thrives and employees flourish. Competitive Compensation: We value our employees and show it through highly competitive compensation and benefits packages. Personal Growth: Your potential isn't just recognized at Acuity, it's actively cultivated. With tailored training, mentorship, and cutting-edge resources, we empower you to thrive personally and professionally. Recognition and Visibility: Stand out in a competitive industry with Acuity's exceptional customer feedback and robust opportunity channels. Collaborative Culture: At Acuity, teamwork isn't just a buzzword – it's the cornerstone of our success. Encouragement and support fuel our collaborative culture, where every voice matters. Diversity and Inclusion: Diversity isn't just a checkbox – it's who we are. At Acuity, we pride ourselves on recruiting and maintaining a workforce that celebrates diversity and treats every employee with dignity and respect. Join Acuity, where your talents are valued, your growth is nurtured, and your impact is amplified. Together, let's shape the future of digital strategy and technology consulting. We are an equal employment opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, national origin, disability status, protected veteran status or any other characteristic protected by law. #LI-PA1 #LI-Remote

How To Apply:

Incase you would like to apply to this job directly from the source, please click here

Responsibilities

The Data Engineer will build and maintain scalable data pipelines in Databricks and design Delta Lake tables for optimized performance. They will collaborate with data architects to implement cloud-native solutions and monitor pipeline health.