PhD Position: Multimodal Modeling of Trust Development for Trust Calibration in AI
Explore how to enable AI systems to understand human trust development during human-AI collaboration using multi-modal modeling, leading to better trust calibration.
Job description
Hybrid Intelligence (HI) is the combination of human and artificial intelligence (AI), aiming to augment human capabilities rather than replace them. It’s aim is to develop AI that works with and for humans.
For effective collaboration, AI systems need to actively calibrate the trust they receive from human users. This means recognizing situations of over- or under-trust and adjusting their behavior accordingly. To do this, systems must understand how people perceive and build trust over time.
Currently, trust is often measured using questionnaires at fixed points in time. However, such measures lack efficiency in providing feedback for trust calibration in human-AI interactions. In addition, they lack the nuance needed to capture how trust evolves dynamically during interaction, decreasing the effectiveness.
In this project, you will address these limitations by developing approaches that use multimodal sensor data for the implicit assessment of human trust perceptions. Your main focus will be the following research question: How can we enable artificial intelligence systems to efficiently and effectively assess the dynamic development of humans’ trust evaluations during collaboration, in order to improve trust calibration?
Given the recent advances in multimodal language modeling (MLLMs), the project will explore how unstructured language data, such as participants’ spoken thoughts during a “Think Aloud” protocol, can help reveal trust perceptions and underlying reasoning. You will collect and analyze multimodal data to identify effective ways of modeling and calibrating trust. The project involves studying the full trust cycle: understanding trust, adapting agent behavior, and observing how trust is influenced in return.
You will be supervised by dr. Bernd Dudzik and dr. Myrthe Tielman, within the Pattern Recognition and Interactive Intelligence research groups, both part of the Intelligent Systems section at the Faculty of Electrical Engineering, Mathematics and Computer Science (EEMCS). Co-supervisors include Prof. Dr. Mark Neerincx (TU Delft & TNO) and Prof. Dr. Dan Balliet (VU Amsterdam).
This project is part of a larger research effort within the Hybrid Intelligence Center, giving you the opportunity to collaborate with researchers across multiple universities and disciplines.
Job requirements
We are looking for a candidate who meets the following essential criteria:
- A Master’s degree or equivalent (or about to graduate with one) in a relevant field (Artificial Intelligence, Computer Science, Data Science, Cognitive Science, etc.)
- A good command of spoken & written English
- A curiosity-driven mindset and a willingness to learn
- Some experience with machine learning (ML) or natural language processing (NLP)
- Some experience in collecting multimodal datasets or running experiments with human subjects
- Experience with interdisciplinary research projects is appreciated.
- Strong analytical and conceptual modelling competencies
- Programming skills (preferably Python), including ML methods and libraries are a plus.
We encourage you to apply even if you do not meet all the criteria above as long as you are willing to acquire the relevant skills. In addition to the qualifications listed above, we are looking for someone who is eager to take on the intellectual challenge of working with abstract concepts such as trust and translating them into concrete research approaches or models. This position is ideal for someone who brings together an interest in human and cognitive perspectives with a practical, hands-on mindset typical of engineering and data science.
You will collaborate closely with multiple supervisors who each bring their own expertise and viewpoint to the project. This creates a rich and supportive environment, but it also means that you may sometimes receive input from different angles. We value someone who can navigate this constructively by asking questions when something is unclear, sharing when you feel uncertain, and communicating openly when feedback seems to conflict. Having the courage to say “I just lost you there” is not a weakness, but a strength we appreciate.
TU Delft (Delft University of Technology)
Delft University of Technology is built on strong foundations. As creators of the world-famous Dutch waterworks and pioneers in biotech, TU Delft is a top international university combining science, engineering and design. It delivers world class results in education, research and innovation to address challenges in the areas of energy, climate, mobility, health and digital society. For generations, our engineers have proven to be entrepreneurial problem-solvers, both in business and in a social context.
At TU Delft we embrace diversity as one of our core values and we actively engage to be a university where you feel at home and can flourish. We value different perspectives and qualities. We believe this makes our work more innovative, the TU Delft community more vibrant and the world more just. Together, we imagine, invent and create solutions using technology to have a positive impact on a global scale. That is why we invite you to apply. Your application will receive fair consideration.
Challenge. Change. Impact!
Faculty Electrical Engineering, Mathematics and Computer Science
The Faculty of Electrical Engineering, Mathematics and Computer Science (EEMCS) brings together three scientific disciplines. Combined, they reinforce each other and are the driving force behind the technology we all use in our daily lives. Technology such as the electricity grid, which our faculty is helping to make completely sustainable and future-proof. At the same time, we are developing the chips and sensors of the future, whilst also setting the foundations for the software technologies to run on this new generation of equipment – which of course includes AI. Meanwhile we are pushing the limits of applied mathematics, for example mapping out disease processes using single cell data, and using mathematics to simulate gigantic ash plumes after a volcanic eruption. In other words: there is plenty of room at the faculty for ground-breaking research. We educate innovative engineers and have excellent labs and facilities that underline our strong international position. In total, more than 1000 employees and 4,000 students work and study in this innovative environment.
Click here to go to the website of the Faculty of Electrical Engineering, Mathematics and Computer Science.
Conditions of employment
Doctoral candidates will be offered a 4-year period of employment in principle, but in the form of 2 employment contracts. An initial 1,5 year contract with an official go/no go progress assessment within 15 months. Followed by an additional contract for the remaining 2,5 years assuming everything goes well and performance requirements are met.
Salary and benefits are in accordance with the Collective Labour Agreement for Dutch Universities, increasing from € 2901 per month in the first year to € 3707 in the fourth year. As a PhD candidate you will be enrolled in the TU Delft Graduate School. The TU Delft Graduate School provides an inspiring research environment with an excellent team of supervisors, academic staff and a mentor. The Doctoral Education Programme is aimed at developing your transferable, discipline-related and research skills.
The TU Delft offers a customisable compensation package, discounts on health insurance, and a monthly work costs contribution. Flexible work schedules can be arranged.
Will you need to relocate to the Netherlands for this job? TU Delft is committed to make your move as smooth as possible! The HR unit, Coming to Delft Service, offers information on their website to help you prepare your relocation. In addition, Coming to Delft Service organises events to help you settle in the Netherlands, and expand your (social) network in Delft. A Dual Career Programme is available, to support your accompanying partner with their job search in the Netherlands.
Additional information
If you would like more information about this vacancy or the selection procedure, please contact m.l.tielman@tudelft.nl or b.j.w.dudzik@tudelft.nl.
Application procedure
Apply via the application button and upload:
- your CV,
- a motivation letter describing both your personal motivation for applying for this particular PhD position, and why you believe you will be a good candidate,
- degree transcripts including information about courses you've followed if relevant to the project,
- the names and contact information (email & phone nr) of two referees. If completed and relevant, please also include
- your Msc. Thesis.
The screening of candidates will occur as applications arrive. If shortlisted, you will be contacted before the closing date of the vacancy. Interested candidates are encouraged to apply as soon as possible and before June 30 2025.
Note that this job opening is one of several job openings on the [HI page with job openings](https://www.hybrid-intelligence-centre.nl/recruitment/). You can apply to more than just this one. If you do so, please inform the Hybrid Intelligence Centre’s [Project Manager via email](sendto:projectmanager.at.HI@gmail.com) of the projects you are applying to.
We aim to create hybrid intelligence for everyone, see also our Diversity Statement. To do this, we need an inclusive and diverse team of researchers. We especially encourage people from underrepresented groups to apply for this job.
Doing a PhD at TU Delft requires English proficiency at a certain level to ensure that the candidate is able to communicate and interact well, participate in English-taught Doctoral Education courses, and write scientific articles and a final thesis. For more details please check the Graduate Schools Admission Requirements.
Please note:
- You can apply online. We will not process applications sent by email and/or post.
- A pre-employment screening can be part of the selection procedure.
- For the final candidates, a knowledge security check will be part of the application procedure. For more information on this check, please consult Chapter 8 of the National Knowledge Security Guidelines. We carry out this check on the basis of legitimate interest.
- Please do not contact us for unsolicited services