Senior Data Engineer

at  NiX

N-iX is looking for a Senior Data Platform Engineer to join the team.

REQUIREMENTS:

• Bachelor’s degree in Computer Science, Information Systems, or a related field.
• Proven experience (5+ years) as a Data Engineer, Data Architect, or similar role.
• Proficiency with ETL tools and frameworks, such as Apache Airflow, dbt, AWS Glue.
• Strong knowledge of Data Warehouse concepts and experience with platforms like Snowflake, AWS Redshift, or similar.
• Experience in designing and managing scalable Data Lakes using cloud platforms (e.g., AWS S3, Azure Data Lake), optimized for large-scale data storage and retrieval.
• Expertise in Avro, Parquet, and ORC formats, ensuring efficient data storage, schema evolution, and high-performance processing in distributed environments.
• Solid experience with SQL and relational databases (e.g., PostgreSQL, MySQL, SQL Server).
• Familiarity with big data technologies (e.g., Hadoop, Spark).
• Strong programming skills in Python or other relevant languages.
• Experience with cloud platforms, particularly AWS.
• Understanding of data governance, data quality, and data security best practices.
• Excellent problem-solving skills and attention to detail.
• Strong communication skills, both verbal and written.

• Design and build scalable data pipelines to ingest, process, and transform large volumes of data from various sources.
• Implement ETL/ELT processes to integrate data into the Data Warehouse.
• Develop and optimize queries for performance and scalability.
• Maintain and support the Data Warehouse, ensuring high availability and reliability.
• Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.
• Monitor and troubleshoot data pipeline issues, ensuring data integrity and quality.
• Implement best practices for data engineering, including code reviews, testing, and version control.
• Work in an Agile, collaborative environment to build, deploy, and maintain data systems.
• Ensure data solutions are compliant with security, privacy, and governance standards.
• Develop and maintain comprehensive documentation for all data engineering processes.