Piper Companies is seeking a Lead Data Engineer to join one of the nation’s leading transportation logistics firms. The Lead Data Engineer will focus on data engineering within the logistics and parcel space, emphasizing Databricks and Azure experience, with some legacy experience in SAP data services.

QUALIFICATIONS FOR THE LEAD DATA ENGINEER INCLUDE:

• Extensive experience with Databricks.
• Strong understanding of governance frameworks.
• Experience supporting AI teams and understanding AI components.
• Knowledge of ML Ops processes.
• Proficiency with Azure Data Factory (ADF).
• Legacy experience with SAP data services is preferred.
• Excellent analytical and problem-solving skills.
• Strong communication and collaboration skills.
• Ability to work independently and as part of a team.
• Bachelor’s degree in a technical field or equivalent experience.

• Utilize Databricks for data processing and analytics.
• Implement and maintain a governance framework.
• Support the AI team by understanding and integrating AI components.
• Develop and manage ML Ops processes.
• Use Azure Data Factory (ADF) for data integration and orchestration.
• Collaborate with team members to architect and implement technical solutions.
• Ensure data quality and integrity across various systems.
• Provide technical leadership and mentorship to junior team members.
• Stay updated with the latest industry trends and technologies.