Assistant Manager, Data Engineering at New Era Technology

Kuala Lumpur, Kuala Lumpur, Malaysia -

Full Time

Start Date

Immediate

Expiry Date

28 Jan, 26

Salary

0.0

Posted On

30 Oct, 25

Experience

5 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Skills

Data Engineering, ETL, Data Warehousing, Big Data, Python, Azure, AWS, Data Modeling, Data Governance, Data Quality, Data Integration, API Development, Shell Scripting, Data Security, Agile Methodologies, Dimensional Modeling, Data Lakes

Industry

IT Services and IT Consulting

Description

Join New Era Technology, where People First is at the heart of everything we do. With a global team of over 4,500 professionals, we’re committed to creating a workplace where everyone feels valued, empowered, and inspired to grow. Our mission is to securely connect people, places, and information with end-to-end technology solutions at scale. At New Era, you’ll join a team-oriented culture that prioritizes your personal and professional development. Work alongside industry-certified experts, access continuous training, and enjoy competitive benefits. Driven by values like Community, Integrity, Agility, and Commitment, we nurture our people to deliver exceptional customer service. If you want to make an impact in a supportive, growth-oriented environment, New Era is the place for you. Apply today and help us shape the future of work—together. 🌟 Hiring: Assistant Manager, Data Engineer – Malaysia (Client Location) | New Era Technology 🌟 Client Location: Kuala Lumpur Company: New Era Technology – www.neweratech.com Work Type: Full-Time, Permanent 🚀 About the Role: New Era Technology is looking for experienced Assistant Manager, Data Engineer to be deployed at our prestigious client in Malaysia at their Kuala Lumpur office. A role to be responsible for system design, development and implementation of regional frontend systems. Provide maintenance and support on production systems. 🛠️ Key Responsibilities: Design, develop, document and implement end-to-end data pipelines and data integration processes, both batch and real-time. This include data analysis, data profiling, data cleansing, data lineage, data mapping, data transformation, developing ETL / ELT jobs and workflows, and deployment of data solutions. Monitor, recommend, develop and implement ways to improve data quality including reliability, efficiency and cleanliness, and to optimize and fine-tune ETL / ELT processes. Recommend, execute and deliver best practices in data management and data lifecycle processes, including modular development of ETL / ELT processes, coding and configuration standards, error handling and notification standards, auditing standards, and data archival standards. Prepare test data, assist in creating and execute test plans, test cases and test scripts. Collaborate with Data Architect, Data Modeler, IT team members, SMEs, vendors and internal business stakeholders, to understand data needs, gather requirements and implement data solutions to deliver business goals. BAU support for any data issues and change requests, document all investigations, findings, recommendations and resolutions. KEY PERFORMANCE INDICATORS Maturity level on technical skillsets of management and development on big data platform including data modeling design, data transformation, big data programming and performance tuning Effectiveness of project contribution, including from technical support, project management and team collaboration perspective, to deliver data lake system on assigned local countries Level of understanding on business requirements and capability to transform them into technical solution Variety of new technologies (such as Azure and AWS Big Data Solution, Power BI, Tableau, Python and etc) and techniques being learnt that can be applied to solution delivery EXTERNAL & INTERNAL CONTACTS Group Infrastructure Team, Security Teams and Operation Team Group Project Team Local country Project Team (IT and User) IT Vendors and/or Service Providers 🎓 Qualification & Experience: Bachelor's degree in IT, Computer Science or related Engineering. At least 5 years of relevant experience in data engineering or related field In-depth understanding of data structures, algorithms, databases, and software engineering. Experience in data management and data warehousing technologies (data mart, data lake, lake house) Ability to write efficient and scalable code Experience with end-to-end data processing pipelines, ETL/ELT, and data warehousing Knowledge of distributed systems and experience working with distributed data processing technologies. 5+ years of professional experience in implementing operational data stores, data warehouses, data mart and large scale data architectures in Unix and/or Windows environments 5+ years of hands-on ETL development experience, including transforming complex data structures from multiple sources. 5+ years of experience with big data technologies including Azure and AWS, Azure data factory, Databricks, Synapse, Hadoop, Hive, Storm, Presto, and real-time data transformation and processing technologies such as Confluent Kafka, ksqldb, kstream, Apache Flink, and Apache Spark Streaming. 5+ years of experience in implementing data models using dimensional modeling and data vault modeling techniques. Experience with scripting languages such as Shell, Perl or Python Experience with any software development methodologies. KNOWLEDGE & TECHNICAL SKILLS Strong knowledge of various database technologies (RDBMS, NoSQL, and columnar). Ability to handle and process different types of data (structured, semi-structured, and unstructured). Strong proficiency in at least one programming language such as Python, Java or Scala. Knowledge of MDM, Data Governance tools, and Informatica technologies. Prior experience in the insurance industry is an advantage. Knowledge of data security and privacy best practices, such as encryption and data masking DevOps (CI/CD) and data privacy regulations knowledge. Good to Have Experience in API development and integration. E.g. SOAP, RestAPI Build and modify APIs(Restful) and programs using Phyton or Java Please share your updated resume along with the below details. 👤 Preferred Candidate: Nationality: Malaysians preferred Availability: Candidates who can join immediate or 30-60days notice. 📧 How to Apply: Send your updated resume to Sravani.Karri@neweratech.com with the subject line: “Assistant Manager, Data Engineer – Malaysia” 🔗 About Us: New Era Technology (www.neweratech.com) is a global IT services provider with a footprint in 80+ countries, delivering cutting-edge digital transformation, consulting, and staffing services across industries New Era Technology, Inc., and its subsidiaries (“New Era” “we”, “us”, or “our”) in its operating regions worldwide are committed to respecting your privacy and recognize the need for appropriate protection and management of any Personal Data that you may provide us. In this, we are also committed to providing you with a positive experience on our websites and while using our products, services and solutions (“Solutions”). View our Privacy Policy here https://www.neweratech.com/us/privacy-policy/

Responsibilities

The Assistant Manager, Data Engineer will be responsible for system design, development, and implementation of regional frontend systems, as well as providing maintenance and support on production systems. Key tasks include designing and developing end-to-end data pipelines and improving data quality and management practices.