Senior Data Engineer

at  EPAM Systems Inc

We are hiring a Data Engineer, who will support a critical digital transformation project for one of EPAM’s top clients.
This is a high-impact role, with the opportunity to advance your skills and grow within a global organization. If you’d like to learn more about this position and project, apply now! Connect with a recruiter today!
Req.#739031841

REQUIREMENTS

• Bachelor’s degree in a related field (e.g., Computer Science, Engineering)
• 6-8 years of relevant work experience in data engineering
• Proven experience working with cloud-based data engineering tools and platforms
• Strong familiarity with Spark, PySpark, and SQL technologies (Databricks, Azure Synapse, SQL Server)
• Experience with streaming technologies such as Kafka and Event Hubs
• Solid understanding of fault-tolerant infrastructure and data availability
• Expertise in Python and PySpark programming languages
• Proficient in SQL and database performance optimization
• Knowledge of data extraction techniques for unstructured data
• Strong communication, analytical, and problem-solving skills

• Design and implement data pipelines to support data-driven decision-making
• Manage and secure data, ensuring reliable and accurate access for stakeholders
• Develop and maintain Spark/PySpark and SQL-based data solutions
• Utilize Azure SQL Server, Synapse, and other cloud-based data platforms for data storage and processing
• Work collaboratively with cross-functional teams to build scalable, efficient data solutions
• Ensure fault tolerance and data availability across regions and availability zones
• Develop and optimize SQL queries, with expertise in clustered column store tables
• Analyze unstructured data to extract valuable insights and relationships
• Implement and manage real-time data streams using Kafka, Event Hubs, and Stream Analytics
• Develop and support serverless computing solutions using Azure Functions or similar technologies