Senior Data Engineer - Advanced SQL, Python, Azure Data bricks, ADF, Pyspar

at  AstraNorth

ESSENTIAL SKILLS:

• Advanced SQL Py Spark, Azure Data bricks, ADF, python
• 12+ Years of experience in data engineering with a focus on ETL pipeline development and at least 2 years working with Azure Cloud.
• Extensive experience in data warehousing concepts and implementation.
• Excellent, executive level, communication skills with the ability to build positive relationships across teams.
• Expertise in ETL and data movement, including relational and big data.
• Experience working in large scale Enterprise Data Lake ingestion and curation projects.
• Strong analytical and problem-solving skills; Experience with Production Support to investigate issues and resolution.
• Ability to analyze, organize and prioritize work while meeting multiple deadlines.
• Ability to work cooperatively and independently as part of a Scaled Agile pod..
• Act as a brand champion for our business area / function and TD, both internally and externally.
• Strong expertise in one or more of the following:o PySpark/Spark.o Python (Pandas, Numpy, Scikit-learn)o Scala/Javao Azure, including: Azure DataBricks, Azure Synapse/SQL Server, Azure Data Factory (ADF) and Orchestration.
• Full working experience in Source-code versioning/promotion tools, e.g. Git/Jenkins. Nexus.
• Experience with Agile concepts and the Atlassian stack (JIRA, Confluence, Stash, GIT) and Jenkins/Nexus.
  Desirable Skills: Agile working experience
  Job Types: Full-time, Fixed term contract

Schedule:

• 8 hour shift
• Monday to Friday

Ability to commute/relocate:

• Toronto, ON: reliably commute or plan to relocate before starting work (preferred)

Work Location: Hybrid remote in Toronto, O

Please refer the Job description for details