Spark/Pyspark Developer at CGI
Toronto, ON M5B 2L7, Canada -
Full Time


Start Date

Immediate

Expiry Date

13 Sep, 25

Salary

0.0

Posted On

15 Jun, 25

Experience

0 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

No

Skills

Containerization, Scala, Postgresql, Shell Scripting, Thinking Skills, Kubernetes, Python, Debugging, Orchestration, Apache Spark, Package Management

Industry

Information Technology/IT

Description

We are looking for a hands-on Developer with strong experience in building data-intensive applications using Apache Spark, working within Kubernetes-based environments, and integrating with modern DevOps and database systems. The ideal candidate will be part of a cross-functional team that builds scalable and reliable platform solutions

Responsibilities

YOUR FUTURE DUTIES AND RESPONSIBILITIES

  • Develop and optimize Spark-based data processing pipelines for large-scale data ingestion, transformation, and analytics
  • Build, deploy, and manage containerized applications using Kubernetes, preferably within Rancher
  • Write infrastructure-aware, modular, and maintainable code for platform components
  • Integrate with PostgreSQL databases and optimize SQL queries for performance
  • Collaborate with DevOps and platform teams to build robust CI/CD pipelines
  • Participate in code reviews, technical design discussions, and Agile ceremonies

REQUIRED QUALIFICATIONS TO BE SUCCESSFUL IN THIS ROLE

  • 3+ years of development experience in Apache Spark (Scala or Python)
  • Hands-on experience in containerization and orchestration using Kubernetes
  • Familiarity with Rancher for managing Kubernetes clusters
  • Proficiency in PostgreSQL with strong SQL and database interaction skills
  • Exposure to build/deploy tools (e.g., Jenkins, GitHub Actions, ArgoCD, etc.)
  • Strong understanding of Unix/Linux environment and shell scripting
  • Strong coding, debugging, and analytical thinking skills
  • Comfortable working in Agile teams and fast-paced development cycles
  • Good communication and a collaborative mindset

Nice to Have:

  • Experience developing data flows using Apache NiFi
  • Understanding of Helm Charts for Kubernetes package management
  • Experience working with cloud-native environments (preferably GCP)

LI-BN

Loading...