LLM Training - Mobile Engineer (Kotlin) at Gramian Consulting Group

, , Bangladesh -

Full Time

Start Date

Immediate

Expiry Date

13 Mar, 26

Salary

0.0

Posted On

13 Dec, 25

Experience

2 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Skills

Kotlin, Android, Software Engineering, Code Readability, Security, Stability, Supervised Fine-Tuning, Reinforcement Learning, Human Feedback, Data Evaluation, Technical Expertise, Collaboration, Peer Review, Continuous Improvement, Evaluation Strategies, Modular Development

Industry

IT Services and IT Consulting

Description

Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs. Role Overview This position is within a project with one of the foundational LLM companies. The goal is to assist these foundational LLM companies in enhancing their Large Language Models. One way we help these companies improve their models is by providing them with high-quality proprietary data. This data serves two main purposes: first, as a basis for fine-tuning their models, and second, as an evaluation set to benchmark the performance of their models or competitor models. For example, for SFT data generation, you might have to put together or be provided a prompt which contains provided code and questions, you will then provide the model responses, and write corresponding Kotlin code to solve the questions. For RLHF data generation, you may need to create a prompt yourself or use one provided by the customer, ask the model questions, and evaluate the outputs generated by two versions of the LLM. You'll compare these outputs and provide feedback, which is then used to fine-tune the models. Please note that this role does not involve building or fine-tuning LLMs. What You’ll Do Design, develop, and maintain efficient, high-quality code to train and optimize AI models. Conduct evaluations (Evals) to benchmark model performance and analyze results for continuous improvement. Evaluate and rank AI model responses to user queries across diverse domains, ensuring alignment with predefined criteria. Develop comprehensive explanations and rationales for evaluations, showcasing excellent reasoning and technical expertise. Lead efforts in Supervised Fine-Tuning (SFT), including creating and maintaining high-quality, task-specific datasets. Collaborate with researchers and annotators to execute Reinforcement Learning with Human Feedback (RLHF) and refine reward models. Design innovative evaluation strategies and processes to improve the model's alignment with user needs and ethical guidelines. Create and refine optimal responses to improve AI performance, emphasizing clarity, relevance, and technical accuracy. Conduct thorough peer reviews of code and documentation, providing constructive feedback and identifying areas for improvement. Collaborate with cross-functional teams to improve model performance and contribute to product enhancements. Continuously explore and integrate new tools, techniques, and methodologies to enhance AI training processes. Commitments Required: 8 hours per day with an overlap of 4 hours with PST. Employment type: Contractor assignment (no medical/paid leave) Duration of contract: 4 weeks Location: India, Pakistan, Nigeria, Kenya, Egypt, Ghana, Bangladesh, Turkey, Mexico Selection process: 60 min technical interview + 90 minute discussion with the Delivery Team 3+ years of experience with Kotlin and Android Hands-on experience with employing modular development and scalable architectures as well as a strong focus on code readability and security/stability (i.e. testing) Clearly express the reasoning and logic when writing code in https://colab.google/ or other suitable mediums Proficiency with the language's syntax and conventions Familiarity working with QA technologies is desirable Excellent spoken and written English communication skills

Responsibilities

The role involves designing, developing, and maintaining high-quality code to train and optimize AI models, as well as conducting evaluations to benchmark model performance. Additionally, the position requires collaboration with researchers and annotators to refine reward models and improve AI performance.