Senior Big Data Engineer

at  Epam Systems

We are seeking a skilled Senior Big Data Engineer to join our dynamic team.
Collaboration with product and engineering teams to understand requirements and drive decisions will be a key aspect of this role. Additionally, you will work closely with architects, technical leads, and other functional groups to deliver high-quality technical solutions.
We accept CVs in English only.

REQUIREMENTS

• 3+ years of experience in software development with Big Data technologies (e.g. administration, configuration management, monitoring, debugging and performance tuning)
• Engineering experience and practice in Data Management, Data Storage, Data Visualization, Operation, Security
• Familiar with concepts of data ingestion pipelines, Data Warehousing, Data Lakes
• Experience with data modeling; development experience with modern Big Data components
• Knowledge and practical experience in development of scalable, available and fault tolerant systems
• Understanding of CI/CD principles and best practices
• Knowledge of Containers and Resource Management systems: Docker, Kubernetes, Yarn
• Experience in direct customer communications

• Implement innovative analytical solution using Spark/PySpark, NoSQL and other Big Data related technologies, applying new features in Cloud solutions
• Work with product and engineering teams to understand requirement and help drive decisions
• Maintain collaboration with architects, technical leads and key individuals within other functional groups
• Perform analysis of business problems and technical environments and use this in implementation of quality technical solutions
• Participate in code review and test solutions to ensure it meets best practice specifications
• Write project documentation