Azure Data Engineer - Databricks

at  Capgemini

WE ARE SEEKING AN EXPERIENCED DATA ENGINEER WITH A STRONG BACKGROUND IN DATABRICKS TO JOIN OUR TEAM. THE IDEAL CANDIDATE WILL HAVE EXTENSIVE EXPERIENCE IN BUILDING DATA ENGINEERING PIPELINES AND WILL BE PROFICIENT IN SPARK SQL AND PYSPARK. FAMILIARITY WITH AZURE AND UNITY IS A PLUS.

• Develop and maintain robust data engineering pipelines using Databricks.
• Utilize Spark SQL and PySpark to perform complex data transformations and analyses.
• Collaborate with cross-functional teams to ensure seamless integration and data flow.
• Optimize and troubleshoot existing data pipelines to improve performance and reliability.
• Leverage Azure and Unity knowledge to enhance data engineering processes (preferred).

QUALIFICATION AND EXPERIENCE:

• Bachelor’s degree in Computer Science, Information Technology, or a related field
• Candidates must possess relevant visas, Australian Permanent Residency, or Australian Citizenship.
• Proven experience in Azure Databricks and Datafactory, including PowerBI security models, cubes, and direct connections.
• Strong proficiency in Spark SQL and PySpark.
• Strong understanding of the Databricks platform and its integration with PowerBI for optimal performance.
• At least one resource with a strong background in visualization and UX design, coupled with excellent communication skills to influence design decisions across stakeholders.

Please refer the Job description for details