Your role as Senior Data Engineer

In the world of commodity trading, knowledge is power. DycoTrade’s BI solution provides clients with valuable insights that help them perform better, grow their revenue, and reduce risks. As a Senior Data Engineer/ BI Consultant, you will be responsible for designing, building, and optimizing enterprise-grade data pipelines and architectures to support DycoTrade’s BI solutions. This role ensures that data from Dynamics 365 and related sources is efficiently ingested, transformed, governed, and delivered across the Bronze, Curated, and Semantic layers for analytics and reporting.

Key Responsibilities 

Data Architecture & Pipeline Development

• Design, maintain, and optimize ETL/ELT pipelines from Dynamics 365 (Finance & CRM) into the data lakehouse (OneLake) and SQL-based curated layers.
• Manage ingestion from the Bronze layer (raw Dataverse data) to Curated and Semantic layers.
• Ensure scalability, performance tuning, and efficient incremental loads.

Data Modeling & Integration

• Develop robust data models for BI consumption (Power BI semantic models, tabular models).
• Implement star/snowflake schemas for analytical performance.
• Ensure consistency of business definitions and KPIs across domains.

Data Governance & Quality

• Establish and enforce data quality checks, validation rules, and error handling in pipelines.
• Collaborate with governance teams to maintain metadata, lineage, and data cataloging.
• Support integration with Microsoft Purview or equivalent.

Collaboration & Stakeholder Management

• Work closely with functional consultants, BI developers, and SMEs to translate business requirements into technical solutions.
• Review and approve BI architecture documents for standard client rollout.
• Provide technical guidance to junior engineers.

Performance Monitoring & Maintenance

• Set up monitoring, logging, and alerting for data pipelines.
• Troubleshoot failures, bottlenecks, and data anomalies.
• Maintain optimal performance of queries, views, and reports.