Data Engineer (+3 Years Experience) at Valleysoft

Cairo, Cairo, Egypt -

Full Time

Start Date

Immediate

Expiry Date

12 Sep, 26

Salary

0.0

Posted On

14 Jun, 26

Experience

2 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Skills

SQL, ETL, Data Modeling, Informatica PowerCenter, NoSQL, Big Data, Data Warehousing, Data Pipelines, Performance Tuning, Informatica Developer, Informatica B2B, Hive, Impala, YARN, Kafka, Data Quality

Industry

Software Development

Description

Valleysoft, a reputable IT services company, is seeking a skilled Data Engineer to join our dynamic team. The successful candidate will be responsible for designing, developing, and maintaining scalable data solutions to support business analytics and decision-making processes. Key Responsibilities: Design, build, and optimize data pipelines and ETL processes for collecting, transforming, and storing data across multiple sources. Develop and maintain data warehouses, data marts, and data lakes to enable efficient data access and analysis. Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver relevant solutions. Ensure data quality, consistency, and security throughout the data lifecycle. Monitor and troubleshoot data pipeline performance and implement improvements. Keep up-to-date with emerging data engineering technologies and best practices. Build and maintain data warehouse and data marts, including ODS and internal departmental marts. Gather, process, maintain, and analyze large datasets, ensuring data accuracy and quality. Design, automate, and support ETL pipelines and data flows across multiple applications. Create logical and physical data flow models and mapping designs for ETL processes. Strong SQL skills (performance tuning, index management) and solid understanding of database structures. Strong understanding of data modeling concepts. Familiarity with SQL and NoSQL storage, and Big Data technologies (Hive, Impala, YARN, Kafka, etc.). Informatica-specific requirements: Hands-on experience with Informatica PowerCenter development (mappings, sessions, workflows). Strong knowledge of Informatica transformations (e.g., Lookup, Joiner, Aggregator, Expression, Router, Sorter) and performance tuning. Experience with Informatica Developer. Experience with Informatica B2B is a plus. Ability to design, automate, monitor, and troubleshoot ETL jobs, including scheduling. Banking sector requirements (preferred): Previous experience in the banking sector, preferably business banking, including working with banking datasets. Strong understanding of data quality and reconciliation expectations in banking environments. Experience working under regulated environments and change control practices is a strong plus. Private Health Insurance Training & Development

Responsibilities

Design, develop, and maintain scalable data pipelines and ETL processes to support business analytics. Build and manage data warehouses, data marts, and data lakes while ensuring data quality and security.