Expert Consultant in Unity Catalogue on Databricks with Purview (Lisbon)

at  CAPGEMINI ENGINEERING

ABOUT OUR COMPANY

At Capgemini Engineering, the world leader in engineering services, we bring together a global team of engineers, scientists, and architects to help the world’s most innovative companies unleash their potential. From autonomous cars to life-saving robots, our digital and software technology experts think outside the box as they provide unique R&D and engineering services across all industries. Join us for a career full of opportunities. Where you can make a difference. Where no two days are the same.

We are looking for a Databricks Specialist Consultant with a deep focus on Unity Catalog and Microsoft Purview, responsible for migrating files in Parquet format stored in Azure Storage Account containers to Delta Table format, with the implementation of a layered architecture (Bronze, Silver, Gold) in Databricks. The consultant will also be responsible for integrating these Delta Tables into Unity Catalog with centralised governance via Microsoft Purview, ensuring that the data is accessible and well governed while being used for dynamic reporting in Power BI.

Responsibilities:

• Expertise in Unity Catalog;
• Advanced integration with Microsoft Purview;
• Implementation of Layered Data Architecture;
• Notebook Conversion and Delta Table Optimisation;
• Reports and Visualisations with Power BI.