Data Engineer ETL 工程师 at Welovesupermom Pte Ltd

Shanghai, Shanghai, China -

Full Time

Start Date

Immediate

Expiry Date

14 Jun, 26

Salary

0.0

Posted On

16 Mar, 26

Experience

2 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Skills

ETL, Data Warehouse Construction, Large AI Models, Model Training, Model Fine-tuning, Dashboards, Java, Apache Flink, PyTorch, TensorFlow, Transformer, BERT, GPT, LoRA, Open-Source Frameworks, GCP

Industry

technology;Information and Internet

Description

1. Responsible for data cleaning (ETL) and data warehouse construction to support large-scale AI models. 2. Responsible for training and fine-tuning large AI models to meet the requirements of specific business scenarios. 3. Responsible for developing supporting tools, such as dashboards and general business logic, to ensure the practicality of AI model applications. 4. Must have hands-on development experience and be able to lead a team or independently complete projects related to data collection and development. 1. 负责数据清洗（ETL）和数仓建设，从而为大模型服务 2. 负责大模型训练和调优，以满足对应业务场景要求 3. 负责开发周边工具，比如dashboad和普通业务逻辑，以实现大模型应用产品实用性。 4. 要有实际开发经验，带队或独立完成数据收集开发相关项目 1. A degree in computer science or a related field is preferred. Must be familiar with professional knowledge in machine learning, deep learning, and natural language processing, with at least 1 year of experience in GPT or Gemini application development, and proficient in deep learning frameworks such as PyTorch or TensorFlow. 2. Familiar with models such as Transformer, BERT, GPT, and fine-tuning algorithms like LoRA, with experience in fine-tuning models. 3. Must have Java programming experience. 4. Experience in backend Java development for data engineering use cases, particularly real-time processing with Apache Flink. 5. Must have experience in data warehouse development and construction, such as using Flink and building ETL data cleaning pipelines. 6. Experience with large model pre-training and practical application in business scenarios is a plus. 7. Must have hands-on experience in setting up large models based on open-source frameworks. 8. Experience in conversational AI, marketing content generation, or machine translation is preferred. 9. Priority will be given to candidates with hands-on experience in Google Cloud Platform (GCP), particularly those with experience in BigQuery. 1. 计算机相关专业优先，熟悉机器学习、深度学习、自然语言处理等领域专业知识，必须有过至少1年的GPT或者Gemini应用开发，熟悉pytorch/tensorflow深度学习框架； 2. 熟悉transformer、bert、gpt等模型，熟悉LoRA等微调算法，有微调模型的经验； 3. 必须有Java编程经验； 4. 在数据工程用例下后端 Java 开发经验，特别是使用 Apache Flink 的实时处理. 5. 必须数仓开发和建设经验，比如flink技术和ETL数据清洗流水线搭建。 6. 有大模型预训练、实际业务场景落地经验者优先； 7. 必须有过基于开源大模型自己搭建的经验； 8. 有对话机器人，营销广告素材生成，机器翻译方向工作经验者优先。 9. 优先考虑具备 Google Cloud Platform（GCP）实战经验，尤其是 BigQuery 相关经验的候选人。 1. Lead community-building for Southeast Asia's largest parenting ecosystem 2. Be at the forefront of connecting brands with real parents in authentic and impactful ways. 3. Work with a passionate team driving innovation in the parenting space. 4. Regional exposure across three of SSEA's most dynamic markets. 1. 引领东南亚最大育儿生态社区的发展与建设 2. 站在前线，以真实且有影响力的方式连接品牌与真实父母 3. 与充满热情的团队合作，共同推动育儿领域的创新 4. 拥有覆盖东南亚三大核心市场的区域曝光与发展机会

Responsibilities

The role involves data cleaning (ETL) and data warehouse construction to support large-scale AI models, alongside training and fine-tuning these models for specific business scenarios. Responsibilities also include developing supporting tools like dashboards to ensure the practicality of AI model applications.