PhD in "Large non-verbal Language Models (LnvLM) for human-agent interaction and cooperation"

PhD in "Large non-verbal Language Models (LnvLM) for human-agent interaction and cooperation"

Published Deadline Location
22 May 18 Jul Tilburg

You cannot apply for this job anymore (deadline was 18 Jul 2023).

Browse the current job offers or choose an item in the top navigation above.

Tilburg University | Departement Cognitive Science and Artificial Intelligence is looking for a PhD position in “Large non-verbal Language Models (LnvLM) for human-agent interaction and cooperation.” (1 FTE) for the Department of Cognitive Science and Artificial Intelligence, location Tilburg. Duration of employment contract: 12 and 36 months.

Job description

The Cognitive Science & Artificial Intelligence department at Tilburg University invites applications for one fully-funded PhD position in the areas of robotics and deep learning, embedded within the AI for Robotics Lab (AIR-Lab,
The AI for Robotics Lab (AIR-Lab) is a newly established research lab at Tilburg University, co-directed by Murat Kirtay and Giacomo Spigler. AIR-Lab research activities focus on recent advances in AI for robotics to endow robots with advanced cognitive capabilities and state-of-the-art performance. The lab is organized along two main areas:

  1. Cognitive Developmental Robotics (CoDeRs) approach integrates insights from various fields –including machine learning, interaction design, computational neuroscience, cognitive/developmental psychology, etc.– to conduct interdisciplinary research in robotics and artificial intelligence. Our goal is to develop computational models for embodied robots, both physical and virtual, that can interact with humans and other robots.
  2. The DL4Robotics line focuses on incorporating the latest advances in deep learning into robotics. We are particularly interested in the development of fully end-to-end robot learning methods based on deep reinforcement learning, imitation learning, and self-supervised learning. Our applications span a variety of domains, including human-robot interaction, together with CoDeRs, and dexterous manipulation, for which we use the in-lab developed dexterous Tilburg robot hand.

AIR-Lab members have access to a wide range of state-of-the-art robot platforms, including a Franka Robot Arm, Humanoid Robots (Pepper and Nao), Unitree Robot dogs, and in-house built robots.

The PhD candidate will work on a project to build the first Large non-verbal Language Model (LnvLM). The project will combine ideas and methods from robotics, human-robot interaction, and deep learning, and in particular deep reinforcement learning, imitation learning, and reinforcement learning from human feedback.

Project description
When we think of communication, our first thought is language. Following this intuition, a vast amount of research in robotics (in particular, human-robot interaction (HRI)) has been dedicated to modeling spoken language. Nonetheless, a significant portion of information exchanged in human-human communication is non-verbal. Despite its importance, current non-verbal behavior by robots in HRI settings is either manually pre-programmed, or controlled by humans via teleoperation.
The objective of the project is to build on recent advances in  language modeling and artificial intelligence to create large language models for non-verbal communication, including gestures, eye gaze, facial expressions, proxemics, etc. The developed models will be deployed on various robot platforms to test ecological validity of the proposed approach. Part of the validation will involve experiments with Reinforcement Learning from Human Feedback (RLHF), relying on the trained embeddings of non-verbal communication to both specify tasks and to extract reward signals.


Tilburg University


  • Master’s degree in computer science, robotics, artificial intelligence, or related fields.
  • Strong algorithmic and programming skills (Python).
  • Excellent knowledge of English and good academic writing skills.
  • Interest (and ideally, research and coding  experience) in deep learning techniques and frameworks (Pytorch, TensorFlow), Human-Robot Interaction, and Robotics.

Conditions of employment

This is a position for 1.0 FTE (40 hours per week) of the full-time working week. 
The selected candidate will start with a contract for one year. Upon a positive outcome of the first-year evaluation, the candidate will be offered an employment contract for the remaining three years.
The salary amounts to a minimum of €2.541 and a maximum of €3.247 gross per month for full-time employment contract, based on UFO profile PhD student and salary scale number PhD’s of the Collective Labour Agreement for Dutch Universities. Tilburg University uses a neutral salary system for scaling that is based on relevant education and work experience. You are entitled to a vacation allowance of 8% and a year-end bonus of 8.3% of your gross annual income. If you work 40 hours per week, you will receive 41 paid days of leave per year.
Researchers from outside the Netherlands may qualify for a tax-free allowance equal to 30% of their taxable salary (the 30% tax regulation). The University will apply for such an allowance on their behalf. We offer assistance in finding accommodation (for foreign employees).
TIU has fine benefits such as an options model for terms and conditions of employment and reimbursement of moving expenses, also including excellent technical infrastructure, savings schemes and excellent sports facilities. 
The collective labor agreement of the Dutch Universities applies.

Tilburg University offers excellent employment conditions. We think flexibility, professional and personal development, and good employee benefits are important. We make clear agreements about career paths and offer all kinds of facilities and schemes to maintain an optimal balance between work and private life. You can also follow numerous training courses, for example, in the areas of leadership skills, personal effectiveness, and career development.  

Tilburg University values an open and inclusive culture. We embrace diversity and encourage the mutual integration of groups of employees and students. We focus on creating equal opportunities for all our employees and students, so that everyone feels at home in our university community.

Tilburg University has a lively campus in beautiful green surroundings that is easily accessible by public transport. We are committed to a sustainable society and challenge you to make an active contribution.

Please visit working at Tilburg University for more information on our terms of employment. 


Tilburg School of Humanities and Digital Sciences

The Cognitive Science and Artificial Intelligence department (  at Tilburg University is part of the Tilburg School of Humanities and Digital Sciences. 
The department emphasizes innovative research spanning a wide array of fields including computational linguistics and language technology, data-science, human-robot interaction, virtual reality and serious games. CSAI is a member of the Benelux Association for Artificial Intelligence, participates in the Special Interest Group for AI (SIG AI), and also participates in the Confederation of Laboratories for Artificial Intelligence Research in Europe (CLAIRE).
Tilburg University and the CSAI department offer a vibrant international environment, with current CSAI staff originating from more than 10 countries.
Tilburg School of Humanities and Digital Sciences


  • PhD
  • Language and culture; Behaviour and society
  • max. 40 hours per week
  • €2541—€3245 per month
  • University graduate
  • 21598



Warandelaan 2, 5037 AB, Tilburg

View on Google Maps

Interesting for you