Piper Companies is seeking a Senior Data Engineer, to join a leading shipping and logistics organization. The Senior Data Engineer will be responsible for building robust & scalable code to transform and deliver data for reporting & analytics.

QUALIFICATIONS FOR THE SENIOR DATA ENGINEER INCLUDE:

• 10+ years of experience in data strategies, data analysis, database architecture and management, development, or administration.
• Strong skills in Azure Data Factory, Databricks, SQL, Python (PySpark), and/or Scala.
• Proven experience in building ETL processes and data warehouse transformation processes.
• Hands-on experience designing and delivering solutions using the Azure Data Analytics platform, including Azure Storage, Azure SQL Data Warehouse, Azure Data Lake, Azure Cosmos DB, and Azure Stream Analytics.
• Experience with Apache Kafka and event-based data processing.
• Bachelor’s degree in Computer Science

• Utilize advanced knowledge of Azure Databricks to design, develop, and deploy solutions for reporting and analytics.
• Construct real-time streaming pipelines using tools like Streamsets and Qlik.
• Manage data movement and orchestration through Azure Data Factory.
• Partner with internal customers and stakeholders to gather requirements, build robust models, and deploy solutions.
• Create and maintain data management frameworks to properly tag and manage curated data assets.