Senior Big Data Engineer

at  Giza Systems EG

JOB DESCRIPTION

• Design and implement large-scale data processing systems and pipelines.
• Develop, test, and deploy robust big data solutions using technologies like Hadoop, Spark, and Kafka.
• Optimize data storage and retrieval strategies for performance and efficiency.
• Collaborate with data scientists, analysts, and stakeholders to understand data requirements.
• Ensure data quality, integrity, and security across big data platforms.
• Lead efforts in data modeling, schema design, and data warehousing.
• Perform data extraction, transformation, and loading (ETL) from various data sources.
• Monitor and troubleshoot data processing jobs to ensure reliability and performance.
• Mentor junior engineers and provide technical guidance to the team.
• Stay current with emerging big data technologies and best practices to drive continuous improvement.

PERSONAL SKILLS

• Strong communication, interpersonal, and presentation skills.
• Ability to multi-task and work under pressure.
• Excellent command of English.
• Excellent verbal and written communication skills; influencing skills and ability to work effectively in a geographically dispersed team.

TECHNICAL SKILLS

• Big Data Technologies: Expertise in Hadoop, Spark, Kafka, and related ecosystems.
• Programming: Proficient in Java, Scala, and Python for data processing and pipeline development.
• Data Modeling: Strong skills in designing data models and schema for big data applications.
• ETL Processes: Advanced knowledge of ETL (Extract, Transform, Load) techniques and tools.
• Database Management: Experience with NoSQL databases like Cassandra, MongoDB, and HBase.
• Cloud Platforms: Proficient in using AWS, Azure, or Google Cloud for big data solutions.
• Performance Tuning: Ability to optimize data processing systems for performance and scalability.
• Data Security: Understanding of data security principles and best practices.
• Collaboration: Strong teamwork and communication skills for cross-functional collaboration.
• Problem-Solving: Excellent analytical and problem-solving abilities to address complex data challenges.

Please refer the Job description for details