Machine Learning Engineer Atlas AI

at  Cognite

ABOUT COGNITE

Embark on a transformative journey with Cognite, a global SaaS forerunner in leveraging data to unravel complex business challenges through our cutting-edge Cognite Data Fusion (CDF) platform. We were awarded the 2022 Technology Innovation Leader for Global Digital Industrial Platforms & Cognite was recognized as 2024 Microsoft Energy and Resources Partner of the Year. In the realm of industrial digitalization, we stand at the forefront, reshaping the future of Oil & Gas, Manufacturing and Energy sectors. Join us in this venture where data meets ingenuity, and together, we forge the path to a smarter, more connected industrial future.

WE BELIEVE MOST OF THESE SHOULD MATCH YOUR EXPERIENCE

• 5+ years of experience in software engineering, with a focus of 1+ years on Generative AI, machine learning, or intelligent systems.
• Proven experience in developing and deploying multi-agent systems, preferably using frameworks like LangChain. (Mandatory experience)
• Vector Database Proficiency: Knowledge of vector databases like Pinecone, Milvus, Weaviate, or Faiss, including their architecture and use cases
• Vector Embedding Creation: Experience in generating vector embeddings from textual, visual, or other data using common industry models.
• Skills in creating, managing, and optimizing indexes for efficient similarity search within vector databases, including knowledge of ANN search algorithms.
• Data Ingestion and Querying: Proficiency in ingesting large datasets into vector databases and writing optimized queries for complex similarity searches.
• Scaling and Performance Tuning: Ability to scale vector databases to handle large datasets and optimize search performance through resource management and index tuning.
• Document Retrieval and Prompt Engineering: Skills in designing effective document retrieval strategies and crafting prompts that leverage retrieved documents in the generation process.
• Data Pipeline and Deployment: Expertise in managing data pipelines for RAG systems, from ingestion to retrieval and generation, and deploying RAG systems at scale.
• Experience with knowledge graphs, graph databases, or related technologies.
• RAG Architecture Understanding: In-depth knowledge of Retrieval-Augmented Generation (RAG) systems, integrating retrieval with generative models to produce informed responses.
• Model Integration and Fine-Tuning: Experience in integrating and fine-tuning pre-trained models with retrieval systems in RAG pipelines for enhanced performance
• Proficiency in Python, JavaScript, or other relevant programming languages.
• Deep understanding of multi-agent frameworks, including agent communication, decision-making, and learning strategies.
• Familiarity with cloud platforms (e.g., AWS, Azure) and containerization technologies (e.g., Docker, Kubernetes).
• Experience with API development and integration.
• Knowledge of big data technologies (e.g., Hadoop, Spark) and real-time processing frameworks.
• Data Handling and Storage: Proficiency in reading and writing data in various formats (CSV, JSON, SQL) and using storage tools like SQLite and SQL databases.

• As a Senior Full Stack Developer Atlas AI, you will work on building cutting edge Industrial agents and GenAI powered solution for selected strategic customers
• You will work closely with a team of a dedicated M/L engineer and a Technical project manager as well as Strategic business development Atlas AI resource
• Use AI and ML related models, and services as part of the Cognite Data Fusion SaaS platform
• Ensure that integrations are well thought out and robust Important quality criteria for the solution are met (E.g. CI/CD, logging, security)
• Develop technology components in alignment with the overall technical solution and ensure technical fit within the customer ecosystem and target architecture
• Design integration and data model using Cognite data connectors, Cognite platform components, SQL, Python/Java and Rest APIs
• Design, develop, and implement generative AI solutions with a strong focus on AI agents, multi-agent systems, and the latest generative AI technologies to drive business innovation and enhance customer experiences
• Collaborate with cross-functional teams to understand business requirements and translate them into technical specifications for generative AI solutions
• In collaboration with Solutions architects, develop scalable AI solutions, including AI agents, that integrate seamlessly with existing systems and leverage cutting-edge technologies
• Develop and deploy AI agents capable of autonomous task execution, environment adaptation, and effective interaction with users and systems, utilizing the latest generative AI frameworks and models