Senior Data Engineer at New Era Technology

Kuala Lumpur, Kuala Lumpur, Malaysia -

Full Time

Start Date

Immediate

Expiry Date

02 Feb, 26

Salary

0.0

Posted On

04 Nov, 25

Experience

5 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Skills

Data Engineering, ETL Development, Big Data Technologies, Data Warehousing, Data Modeling, Python, Azure, AWS, Spark, Kafka, Data Governance, API Development, Data Analytics, Data Visualization, SQL, Hadoop

Industry

IT Services and IT Consulting

Description

Join New Era Technology, where People First is at the heart of everything we do. With a global team of over 4,500 professionals, we’re committed to creating a workplace where everyone feels valued, empowered, and inspired to grow. Our mission is to securely connect people, places, and information with end-to-end technology solutions at scale. At New Era, you’ll join a team-oriented culture that prioritizes your personal and professional development. Work alongside industry-certified experts, access continuous training, and enjoy competitive benefits. Driven by values like Community, Integrity, Agility, and Commitment, we nurture our people to deliver exceptional customer service. If you want to make an impact in a supportive, growth-oriented environment, New Era is the place for you. Apply today and help us shape the future of work—together. 🌟 Hiring: Senior Data Engineer – Malaysia (Client Location) | New Era Technology 🌟 Client Location: KL, Malaysia Company: New Era Technology – www.neweratech.com Work Type: Permanent 🚀 About the Role: New Era Technology is looking for experienced Senior Data Engineer to be deployed at our prestigious client in Malaysia at their KL office. 🛠️ Key Responsibilities: Design, develop, document and implement end to-end data pipelines and data integration processes, both batch and real-time. This include data analysis, data profiling, data cleansing, data lineage, data mapping, data transformation, developing ETL / ELT jobs and workflows, and deployment of data solutions. Monitor, recommend, develop and implement ways to improve data quality including reliability, efficiency and cleanliness, and to optimize and fine-tune ETL / ELT processes. Recommend, execute and deliver best practices in data management and data lifecycle processes, including modular development of ETL / ELT processes, coding and configuration standards, error handling and notification standards, auditing standards, and data archival standards. Prepare test data, assist to create and execute test plans, test cases and test scripts. Collaborate with Data Architect, Data Modeler, IT team members, SMEs, vendors and internal business stakeholders, to understand data needs, gather requirements and implement data solutions to deliver business goals. BAU support for any data issues and change requests, document all investigations, findings, recommendations and resolutions. KEY PERFORMANCE INDICATORS Maturity level on technical skillsets of management and development on big data platform including data modeling design, data transformation, big data programming and performance tuning Effectiveness of project contribution, including from technical support, project management and team collaboration perspective, to deliver data lake system on assigned local countries Level of understanding on business requirements and capability to transform them into technical solution Variety of new technologies (such as Azure and AWS Big Data Solution, Power BI, Tableau, Python and etc) and techniques being learnt that can be applied to solution delivery 🎓 Qualification & Experience: Bachelor in IT, Computer Science or Engineering. At least 3-5 years of using Big Data technologies like Azure and AWS Big Data Solution, Hadoop, Hive, HBase, Spark, Sqoop, Kafka and Spark Streaming. Minimum 5 years of professional experience in data warehouse, operational data store, and large scale data architecture implementations in Unix or/and Windows environment. At least 3+ years of solid hands-on development experience with ETL development to transform complex data structure in multiple data sources environment. At least 5 years data model (relational and/or data warehouse), data mart design and implementation. Minimum 3-5 years ETL programming in any of these languages including Python, Scala, Java or R Experience on Azure Databricks for ETL/ELT development and big data analytics programming in Python Strong Experience with various of ETL/ELT frameworks, data warehousing concepts, data management framework and data lifecycle processes. Solid understanding on Azure Data Management Solution including Azure Data Factory, Azure Databricks, Azure Blob storage (Gen2) and Azure Synapse KNOWLEDGE & TECHNICAL SKILLS Familiar with ETL/ELT framework, data warehousing concepts, data management framework and data lifecycle processes. Experienced in handling and processing different types of data (structured, semi structured and unstructured). Strong knowledge in various database technologies (RDBMS, NoSQL and columnar). Preferably with a good understanding of data analytics and data visualization, strongly prefer Power BI and Tableau. Strong understanding of programming languages like Python, Scala, Java, R, Shell and PLSQL Good understanding on Master Data Management (MDM) and Data Governance Tools preferring Informatica technologies Experienced working in insurance industry will be an added advantage. Ability to communicate and present technical information in a clear and unambiguous manner. Strong ability to work independently and cooperate with diverse teams in a multiple stakeholder’s environment. Strong sense of work ownership, high affinity with anything data and a desire for constant improvements. Experience in API development and integration. E.g. SOAP, RestAPI Build and modify APIs(Restful) and programs using Phyton and Java 👤 Preferred Candidate: Nationality: Malaysians only Availability: Candidates who can join max in 60 days. 📧 How to Apply: Send your updated resume to Nithiya.murali@neweratech.com with the subject line: “ Senior Data Engineer (Perm)- Malaysia” 🔗 About Us: New Era Technology (www.neweratech.com) is a global IT services provider with a footprint in 80+ countries, delivering cutting-edge digital transformation, consulting, and staffing services across industries New Era Technology, Inc., and its subsidiaries (“New Era” “we”, “us”, or “our”) in its operating regions worldwide are committed to respecting your privacy and recognize the need for appropriate protection and management of any Personal Data that you may provide us. In this, we are also committed to providing you with a positive experience on our websites and while using our products, services and solutions (“Solutions”). View our Privacy Policy here https://www.neweratech.com/us/privacy-policy/

Responsibilities

Design and implement end-to-end data pipelines and integration processes, ensuring data quality and optimization of ETL/ELT processes. Collaborate with various stakeholders to understand data needs and deliver solutions that meet business goals.