Senior Data Engineer at EPAM Systems Inc
Remote, British Columbia, Canada -
Full Time


Start Date

Immediate

Expiry Date

21 Apr, 25

Salary

105000.0

Posted On

23 Jan, 25

Experience

6 year(s) or above

Remote Job

No

Telecommute

No

Sponsor Visa

No

Skills

Hubs, Sql, Programming Languages, Database, Data Engineering, Kafka, Unstructured Data, Spark, Python, Sql Server, Platforms

Industry

Information Technology/IT

Description

We are hiring a Data Engineer, who will support a critical digital transformation project for one of EPAM’s top clients.
This is a high-impact role, with the opportunity to advance your skills and grow within a global organization. If you’d like to learn more about this position and project, apply now! Connect with a recruiter today!
Req.#739031841

REQUIREMENTS

  • Bachelor’s degree in a related field (e.g., Computer Science, Engineering)
  • 6-8 years of relevant work experience in data engineering
  • Proven experience working with cloud-based data engineering tools and platforms
  • Strong familiarity with Spark, PySpark, and SQL technologies (Databricks, Azure Synapse, SQL Server)
  • Experience with streaming technologies such as Kafka and Event Hubs
  • Solid understanding of fault-tolerant infrastructure and data availability
  • Expertise in Python and PySpark programming languages
  • Proficient in SQL and database performance optimization
  • Knowledge of data extraction techniques for unstructured data
  • Strong communication, analytical, and problem-solving skills
Responsibilities
  • Design and implement data pipelines to support data-driven decision-making
  • Manage and secure data, ensuring reliable and accurate access for stakeholders
  • Develop and maintain Spark/PySpark and SQL-based data solutions
  • Utilize Azure SQL Server, Synapse, and other cloud-based data platforms for data storage and processing
  • Work collaboratively with cross-functional teams to build scalable, efficient data solutions
  • Ensure fault tolerance and data availability across regions and availability zones
  • Develop and optimize SQL queries, with expertise in clustered column store tables
  • Analyze unstructured data to extract valuable insights and relationships
  • Implement and manage real-time data streams using Kafka, Event Hubs, and Stream Analytics
  • Develop and support serverless computing solutions using Azure Functions or similar technologies
Loading...