Two Fellow researcher positions on: Learning by demonstration and foundatio

at  Istituto Italiano di Tecnologia

TWO FELLOW RESEARCHER POSITIONS ON: LEARNING BY DEMONSTRATION AND FOUNDATION MODELS FOR ROBOT PROGRAMMING AND CONTROL IN IN DYNAMIC AND UNPREDICTABLE ENVIRONMENTS

• (2400007H)
  Project: Horizon Europe - HORIZON-RIA - Acronym: TORNADO - Project number: 101189557
  Commitment & contract: collaborator, 1-year, temporary contract, extendable
  Location: IIT - Center for Robotics and Intelligent Systems, Via S. Quirico, 19d, 16163 Genova

JOB DESCRIPTION

The advent of foundation models, particularly large language models (LLMs) and vision-language models (VLMs), has revolutionized the field of artificial intelligence, enabling unprecedented levels of understanding and interaction. This research theme explores the integration of these cutting-edge technologies into the control systems of collaborative robots (cobots), focusing on achieving full autonomy and enhancing human-robot collaboration.
By leveraging foundation models, this research aims to develop innovative frameworks that allow cobots to understand and respond to human commands in natural language, interpret visual cues, and make autonomous decisions based on real-time data.
The selected candidates will investigate the application of LLMs to enable natural language understanding, allowing cobots to interact seamlessly with human operators. This includes designing systems that can interpret context, engage in multi-turn dialogues, and provide actionable feedback. In parallel, the use of VLMs will be explored to enhance the robots’ visual perception capabilities, enabling them to comprehend and react to visual stimuli in their surroundings.
The proposed research will involve developing hybrid control architectures that combine the strengths of LLMs and VLMs with advanced control strategies, such as model predictive control (MPC) and reinforcement learning (RL). The selected candidates will have the opportunity to create adaptive algorithms that empower cobots to learn from their interactions, improving their performance and safety in real-world applications.
This theme not only promises to advance the theoretical understanding of AI in robotics but also emphasizes practical implementation, targeting industries such as healthcare, logistics, and manufacturing. By participating in this research, the fellows will contribute to pioneering work that bridges the gap between AI and robotics, ultimately leading to the next generation of intelligent, collaborative systems.
We are seeking motivated and innovative candidates who are passionate about robotics and AI. Join us in shaping the future of human-robot interaction, where cobots will work alongside humans, enhancing productivity and safety in various environments. With guidance from leading experts in the field, you will gain hands-on experience and contribute to cutting-edge research that has the potential to transform industries.

WHO WE ARE

At IIT we work enthusiastically to develop human-centered Science and Technology to tackle some of the most pressing societal challenges of our times and transfer these technologies to the production system and society. Our Genoa headquarter is strictly inter-connected with our 11 centers around Italy and two outer-stations based in the US for a truly interdisciplinary experience.

Please refer the Job description for details