DATA ENGINEER - AZURE/DATABRICKS/PYSPARK:

On behalf of our Banking client, Procom is searching for a Data Engineer - Azure/Databricks/Pyspark for a 6-month role. This position is a hybrid position with 4 days onsite at our client’s Toronto office.

DATA ENGINEER - AZURE/DATABRICKS/PYSPARK - JOB DESCRIPTION:

The project involves working on data ingestion, transformation, and integration within the Protect, Fraud Product business unit. The role includes performing complex data transformations and performance tuning using Azure technologies.

DATA ENGINEER - AZURE/DATABRICKS/PYSPARK - MANDATORY SKILLS:

• Azure Data Factory expertise
• Proficiency in Databricks & PySpark
• Experience with Azure DevOps for CI/CD pipelines
• Advanced SQL querying and optimization skills
• Strong problem-solving abilities

DATA ENGINEER - AZURE/DATABRICKS/PYSPARK – NICE-TO-HAVE SKILLS:

• Stakeholder management experience
• Banking experience, particularly in enterprise protection

• Recommending solutions for data-related challenges
• Performing data ingestion, transformation, and integration tasks
• Conducting complex data transformations and performance tuning
• Debugging and troubleshooting data processes