Data Engineer at Thakral One

Manila, Metro Manila, Philippines -

Full Time

Start Date

Immediate

Expiry Date

05 May, 26

Salary

0.0

Posted On

04 Feb, 26

Experience

5 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Skills

Cloud Data Engineering, Microsoft Azure, Data Lakehouse, ETL Processes, Data Transformation, Data Modeling, Data Pipeline Orchestration, Data Governance, Azure Data Factory, Azure Data Lake, Azure Synapse Analytics, Power BI, Python, SQL Server, DevOps, Data Privacy

Industry

IT Services and IT Consulting

Description

Job Title: Cloud Data Engineer Job Description: We are seeking an experienced Cloud Data Engineer to design, build, and maintain data pipelines for a Microsoft Fabric-based data lakehouse for a leading Philippine water utility company. You will work closely with cloud architects, data scientists, data analysts, and business teams to ensure the successful integration and management of large datasets from multiple sources, such as billing systems (SAP IS-U), SCADA, IoT sensors, and customer service platforms. This role requires deep expertise in cloud technologies, particularly in Microsoft Azure, along with experience in building scalable and reliable data pipelines, ensuring data quality, and optimizing data storage and retrieval in the lakehouse architecture. Key Responsibilities: Design, develop, and maintain cloud-based data pipelines using Microsoft Fabric to ingest, transform, and load data from a variety of sources (e.g., SAP IS-U, SCADA, IoT sensors, billing systems, customer service systems) into the data lakehouse. Ensure data quality and consistency across the lakehouse by applying transformation and validation rules in collaboration with business and data governance teams. Work closely with Cloud Data Architects to optimize the structure of data models in the lakehouse to ensure they are efficient and scalable. Develop ETL/ELT processes to integrate data from structured, semi-structured, and unstructured sources, ensuring data is cleaned, transformed, and stored effectively in the Azure Data Lake or Azure Synapse. Manage cloud resources, ensuring that the architecture is cost-effective, secure, and scalable, and monitor pipeline performance to ensure smooth operation. Collaborate with data scientists and data analysts to ensure data is accessible, well-documented, and easily consumable for advanced analytics and reporting (e.g., Power BI). Ensure compliance with data governance policies, including access control, data encryption, and adherence to Philippine data privacy laws (e.g., Data Privacy Act of 2012). Assist in the design and deployment of cloud infrastructure automation using tools like Azure DevOps, ARM Templates, or Terraform. Troubleshoot and resolve any issues related to data pipeline failures, data integrity, or performance bottlenecks. Stay up-to-date with the latest trends and best practices in cloud data engineering, Azure technologies, and data lakehouse architecture. Required Qualifications: Bachelors degree in Computer Science, Information Technology, Engineering, or related field. 5+ years of experience in cloud data engineering, with a focus on Microsoft Azure and data lakehouse architectures. Strong proficiency in Azure Data Factory, Azure Data Lake, Azure Synapse Analytics, Microsoft Fabric, and Power BI. Solid experience in ETL/ELT processes and tools, including Azure Databricks, SQL Server, Python, or Scala. Experience working with SAP IS-U, SCADA, and IoT data sources, or familiarity with operational data sources in the utilities sector. Expertise in data transformation, data modeling, and data pipeline orchestration. Familiarity with data governance, metadata management, and data security best practices, especially within regulated industries like utilities. Solid understanding of cloud cost management and resource optimization in Azure. Experience with DevOps practices and tools (e.g., Azure DevOps, Git, CI/CD pipelines). Preferred Qualifications: Microsoft Certified: Azure Data Engineer Associate or other relevant Azure certifications. Familiarity with data lakehouse patterns (e.g., Delta Lake) and advanced analytics concepts (e.g., machine learning, AI). Experience working in the water utilities sector or other critical infrastructure environments. Familiarity with Python and/or Spark for large-scale data processing. Knowledge of data privacy regulations in the Philippines, such as the Data Privacy Act and sector-specific regulations (e.g., MWSS, LWUA). Experience with serverless architecture and containerization (e.g., Azure Functions, Kubernetes). Soft Skills & Competencies: Strong problem-solving and troubleshooting skills in complex cloud data environments. Ability to work in a collaborative, cross-functional team, with a customer-focused approach to meeting business requirements. Excellent communication skills to interact with both technical and non-technical stakeholders, including business teams, architects, and governance leads. Proactive and self-driven, with the ability to manage competing priorities and deliver high-quality solutions in a fast-paced environment. Strong attention to detail with a commitment to data integrity and quality.

Responsibilities

Design, develop, and maintain cloud-based data pipelines using Microsoft Fabric to ingest, transform, and load data into the data lakehouse. Collaborate with various teams to ensure data quality, optimize data models, and manage cloud resources effectively.