Data Engineer - Clearance Required

at  Logistics Management Institute

Overview:
LMI is seeking an experienced Data Engineer to design, develop, test, and optimize data pipelines and database architectures, with additional responsibilities for creating data visualizations in React. This role will support the development of innovative software solutions that drive AI/ML capabilities for the Department of Defense.

Responsibilities:

• Set up segmented databases to control access to various datasets and data products
• Build data pipelines in PySpark using data engineering best practices for testing, validation, automation, and version control
• Coordinate closely with SMEs and front-end developers to generate data tables required for UI execution
• Build code to execute pulls from APIs, allowing access to external data to be pulled into the client environment
• Interact with partners and data providers to understand their data holdings, methods for moving data into the CDAO-Advana platform, and data usage agreements
• Self-starter, and eager to learn and work in a team environment
• Develop intuitive visualizations, dashboards, and reusable User Interface (UI) components using React and the Material UI component library
• Rapidly create working wireframes based on project specifications for client validation in collaboration with human-centered design
• Build CI/CD pipelines using client specifications for security and containerized deployments in client environments
• Manage UI component buildout in conjunction with project management stakeholders using an agile-based project management approach
• Work with data engineers to outline specifications for APIs

Qualifications:

• Bachelor’s degree in Computer Science or related field and/or equivalent work experience
• 3-10 years of experience as a data engineer

• Experience with:

• • Agile-based development
• Python, Spark, notebooks
• Data Bricks or similar environment
• Effective analytical, conceptual, and problem-solving skills
• Active DoD Secret clearance
• Part-time onsite client support in the Washington, DC metro area

Desired Qualifications

• Active DoD Top Secret clearance

The salary range for this position is- $80,000 - $120,000
The salary range displayed represents the typical salary range for this position and is not a guarantee of compensation. Individual salaries are determined by various factors including, but not limited to location, internal equity, business considerations, client contract requirements, and candidate qualifications, such as education, experience, skills, and security clearances

• Set up segmented databases to control access to various datasets and data products
• Build data pipelines in PySpark using data engineering best practices for testing, validation, automation, and version control
• Coordinate closely with SMEs and front-end developers to generate data tables required for UI execution
• Build code to execute pulls from APIs, allowing access to external data to be pulled into the client environment
• Interact with partners and data providers to understand their data holdings, methods for moving data into the CDAO-Advana platform, and data usage agreements
• Self-starter, and eager to learn and work in a team environment
• Develop intuitive visualizations, dashboards, and reusable User Interface (UI) components using React and the Material UI component library
• Rapidly create working wireframes based on project specifications for client validation in collaboration with human-centered design
• Build CI/CD pipelines using client specifications for security and containerized deployments in client environments
• Manage UI component buildout in conjunction with project management stakeholders using an agile-based project management approach
• Work with data engineers to outline specifications for API