Senior Data Engineer at CLP Group

Hong Kong, Hong Kong Island, Hong Kong S.A.R. -

Full Time

Start Date

Immediate

Expiry Date

24 Sep, 26

Salary

0.0

Posted On

26 Jun, 26

Experience

5 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Skills

SQL, PostgreSQL, Databricks, Spark, Python, Scala, Azure, NoSQL, Data Pipeline Design, Data Modeling, ETL, BI Solutions, API Development, GenAI, LangChain, LlamaIndex

Industry

Utilities

Description

Working location: Kai Tak Employment period: 1-year contract (For internal application, only short-term employment contract’s terms and condition will be offered for this position regardless of job applicant’s current job category) Main Responsibilities * Build end-to-end data pipelines including data collection, transformation, quality and integration solutions to facilitate CLP’s data & analytics solutions. * Collaborate with solution design and business requirements teams to identify data requirements and assemble large, complex data sets that meet the requirements * Design, implement and fine-tune analytics solutions that meet business and technical requirements * Work collaboratively with the CLP data architect to ensure data model integrity * Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources * Create data tools for analytics and data scientists teams that assist them in building and optimising the data models and solutions * Work with the DevOps engineer to support the consistent operation of data & analytics solutions * Work closely with the data analysts & data scientists to design and develop APIs Requirements Academic Qualification: * Bachelor or Masters degree in a related field (e.g. computer science, information technology, etc.) Professional Experience: * At least 5 years experience in SQL/PostgreSQL, data and BI solutions with integration to 3rd party tools * Experience working with application server software (e.g. ERP), Spark, Scala, Python, SQL scripting languages, relational databases (e.g. SQL DB/DW), NoSQL platforms (e.g. HBase, MongoDB, Cassandra), cloud technologies (e.g. Azure) * Hands-on experience designing, building, and delivering data solutions on Databricks (mandatory) * Demonstrated experience delivering data engineering projects using Databricks (Spark, notebooks, pipelines) (mandatory) * Experience with Data Lake, Data Factory, BI Dashboard, and BI implementation projects * Highly experienced with processing large and complex datasets and building end-to-end data pipelines using on-premise or cloud-based data platforms * Experienced in coding in data management, data warehousing or unstructured data environments * Experience in the energy sector or other asset-intensive industries will be highly regarded * Experience in using coding assistants (e.g. GitHub Copilot) for uplifting productivity in development * Familiar with GenAI concepts like RAG, orchestration frameworks like LangChain and LlamaIndex, vector databases etc. to collaborate efficiently with data scientists and ML engineers in AI use cases Competencies Technical (Functional): * Experience in Azure cloud platforms and technology * Ability to define and develop data integration patterns and pipelines * Strong knowledge of data modelling, data warehousing, and BI concepts * Self-motivated, able to work independently, and attention to details * Curious about emerging AI trends and their implications for data engineering

Responsibilities

Build end-to-end data pipelines and analytics solutions to facilitate data collection, transformation, and integration. Collaborate with architects and data scientists to design data models and develop APIs for AI use cases.