Senior Data Engineer - Advanced SQL, Python, Azure Data bricks, ADF, Pyspar at AstraNorth
Toronto, ON, Canada -
Full Time


Start Date

Immediate

Expiry Date

10 Feb, 25

Salary

0.0

Posted On

30 Jan, 25

Experience

0 year(s) or above

Remote Job

No

Telecommute

No

Sponsor Visa

No

Skills

Git, Communication Skills, Etl, Pipeline Development, Orchestration, Stash, Working Experience, Nexus, Numpy, Big Data, Confluence, Teams, Pandas

Industry

Information Technology/IT

Description

ESSENTIAL SKILLS:

  • Advanced SQL Py Spark, Azure Data bricks, ADF, python
  • 12+ Years of experience in data engineering with a focus on ETL pipeline development and at least 2 years working with Azure Cloud.
  • Extensive experience in data warehousing concepts and implementation.
  • Excellent, executive level, communication skills with the ability to build positive relationships across teams.
  • Expertise in ETL and data movement, including relational and big data.
  • Experience working in large scale Enterprise Data Lake ingestion and curation projects.
  • Strong analytical and problem-solving skills; Experience with Production Support to investigate issues and resolution.
  • Ability to analyze, organize and prioritize work while meeting multiple deadlines.
  • Ability to work cooperatively and independently as part of a Scaled Agile pod..
  • Act as a brand champion for our business area / function and TD, both internally and externally.
  • Strong expertise in one or more of the following:o PySpark/Spark.o Python (Pandas, Numpy, Scikit-learn)o Scala/Javao Azure, including: Azure DataBricks, Azure Synapse/SQL Server, Azure Data Factory (ADF) and Orchestration.
  • Full working experience in Source-code versioning/promotion tools, e.g. Git/Jenkins. Nexus.
  • Experience with Agile concepts and the Atlassian stack (JIRA, Confluence, Stash, GIT) and Jenkins/Nexus.
    Desirable Skills: Agile working experience
    Job Types: Full-time, Fixed term contract

Schedule:

  • 8 hour shift
  • Monday to Friday

Ability to commute/relocate:

  • Toronto, ON: reliably commute or plan to relocate before starting work (preferred)

Work Location: Hybrid remote in Toronto, O

Responsibilities

Please refer the Job description for details

Loading...