Senior Data Engineer at Encora

, Kuala Lumpur, Malaysia -

Full Time

Start Date

Immediate

Expiry Date

26 Apr, 26

Salary

0.0

Posted On

26 Jan, 26

Experience

5 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Skills

SQL Proficiency, ETL Development, Database Engineering, Data Migration, Data Transformation, REST API Integration, Performance Tuning, Data Quality, Data Governance, Metadata Management, Data Cleansing, Data Enrichment, Data Aggregation, Schema Design, Indexing, Stored Procedures

Industry

IT Services and IT Consulting

Description

Role Overview We are seeking a highly skilled Senior Data Engineer with strong expertise in SQL development, ETL processes, database optimization, and enterprise data integration. The ideal candidate has hands-on experience working with large datasets, optimizing performance, and enabling data flows across heterogeneous systems and platforms. Key Responsibilities Design, develop, and optimize robust data pipelines and ETL workflows. Write complex SQL queries, stored procedures, and performance-optimized transformations across large datasets. Develop and maintain data views, schemas, indexing strategies, and database objects for optimal query execution. Lead and execute data migration initiatives across heterogeneous systems (on-prem, cloud, legacy, modern). Implement data transformation logic to support business rules, data enrichment, cleansing, and aggregation. Integrate external data sources through RESTful APIs, including authentication, pagination, error handling, and ingestion orchestration. Collaborate with cross-functional teams to ensure data models, pipelines, and integrations support analytical and operational requirements. Ensure data quality, consistency, reconciliation, and validation across environments. Participate in cut-over planning, testing cycles, and controlled deployment processes. Contribute to data governance, metadata management, and technical documentation. Required Skills & Experience Strong SQL Proficiency (6–7 years) Expert in complex SQL queries (joins, subqueries, window functions, stored procedures). Hands-on experience with performance tuning and handling large datasets. SQL Optimization (3+ years) Demonstrated experience optimizing database queries and improving performance across large-scale data environments. ETL Development (6–7 years) Experience with ETL tools such as Informatica, Datastage, or ODI (any is acceptable). Database Engineering (6–7 years) Must have: PostgreSQL and/or Oracle experience including: schema design views indexing stored procedures database optimization Data Migration (5+ years) Experience migrating data between heterogeneous systems (on-prem to cloud, legacy to modern). Involvement in validation, reconciliation, testing, and cut-over planning. Data Transformation (5+ years) Experience implementing complex transformation rules with focus on data consistency, cleansing, enrichment, and aggregation. REST API Integration (3+ years) Experience consuming REST APIs for data ingestion. Ability to handle authentication (OAuth/API Keys), pagination, rate limits, JSON parsing, and error handling. Bonus: Exposure to building lightweight REST APIs to expose curated datasets.

Responsibilities

The Senior Data Engineer will design, develop, and optimize data pipelines and ETL workflows while ensuring data quality and consistency. They will also lead data migration initiatives and collaborate with cross-functional teams to support analytical and operational requirements.