PhD Position Foundation Models for Autonomous Vehicle Perception

Job description

Autonomous vehicles have been shown to underperform when deployed on conditions that differ substantially from the training conditions, so-called domain gaps. These domain gaps can include deployment in different regions, weather or using different sensors. Numerous domain adaptation methods have been proposed to bridge these domain gaps and let the model operate well on the target data. In this project we seek to find an intermediate representation for data coming from varied sources. By bringing new data into this representation, we overcome domain gaps and are able to train models that are robust to different conditions, also referred to as foundation models. While foundation models have achieved widespread success on images and text, currently few exist for lidar and radar data, making this a promising research direction. These foundation models will bring superior performance and allow us to utilize data from varied sources, thus reducing the data collection and labeling costs.

The Intelligent Vehicles group at TU Delft, the Netherlands, invites applications for a fully funded 4-year PhD position in the area of foundation models for autonomous vehicles. This position is partially funded by the EU Horizon project Cynergie4MIE, as well as by internal funding sources. Due to this combination, the topic for the last 1.5 years is somewhat flexible. Large Language Models and/or Gen AI are two potential topics, as long as they fit into the overall thesis direction.

Your results will be published in top tier conferences like CVPR, ICCV, ECCV, ICRA and NeurIPS. For your work you will have access to the compute resources of TU Delft, ranging from personal machines, to shared GPU servers, the Delft AI Cluster that is shared across departments, as well as DelftBlue, which is one of the top 250 supercomputers in the world. Your main supervisor will be Dr. Holger Caesar, creator of the nuScenes dataset and co-author of the PointPillars method for lidar-based object detection. You will receive hands-on mentoring for your career development.

Job requirements 

• We are seeking PhD applicants with an interest in performing cutting edge research in an active and exciting research area.
• Prospective applicants should have a strong academic record with a solid background in sensor processing (vision/radar/lidar, sensor fusion) and Machine Learning (Deep Learning, domain adaptation, foundation models).
• Good programming skills (Python/Matlab) and knowledge of deep-learning frameworks (PyTorch/TensorFlow) are expected.
• A certain affinity towards turning complex concepts into real-world practice (i.e. vehicle demonstrator) is desired.
• The successful candidate is expected to be able to act independently as well as to collaborate effectively with members of a larger team and supervise Master students.
• Good English skills are required.
• The work takes place in Delft, The Netherlands, but allows for working two days per week from home.

TU Delft (Delft University of Technology)

Delft University of Technology is built on strong foundations. As creators of the world-famous Dutch waterworks and pioneers in biotech, TU Delft is a top international university combining science, engineering and design. It delivers world class results in education, research and innovation to address challenges in the areas of energy, climate, mobility, health and digital society. For generations, our engineers have proven to be entrepreneurial problem-solvers, both in business and in a social context.

At TU Delft we embrace diversity as one of our core values and we actively engage to be a university where you feel at home and can flourish. We value different perspectives and qualities. We believe this makes our work more innovative, the TU Delft community more vibrant and the world more just. Together, we imagine, invent and create solutions using technology to have a positive impact on a global scale. That is why we invite you to apply. Your application will receive fair consideration.

Challenge. Change. Impact!

Faculty Mechanical Engineering

From chip to ship. From machine to human being. From idea to solution. Driven by a deep-rooted desire to understand our environment and discover its underlying mechanisms, research and education at the ME faculty focusses on fundamental understanding, design, production including application and product improvement, materials, processes and (mechanical) systems.

ME is a dynamic and innovative faculty with high-tech lab facilities and international reach. It’s a large faculty but also versatile, so we can often make unique connections by combining different disciplines. This is reflected in ME’s outstanding, state-of-the-art education, which trains students to become responsible and socially engaged engineers and scientists. We translate our knowledge and insights into solutions to societal issues, contributing to a sustainable society and to the development of prosperity and well-being. That is what unites us in pioneering research, inspiring education and (inter)national cooperation.

Click here to go to the website of the Faculty of Mechanical Engineering. Do you want to experience working at our faculty? These videos will introduce you to some of our researchers and their work.

Conditions of employment 

Doctoral candidates will be offered a 4-year period of employment in principle, but in the form of 2 employment contracts. An initial 1,5 year contract with an official go/no go progress assessment within 15 months. Followed by an additional contract for the remaining 2,5 years assuming everything goes well and performance requirements are met. 

Salary and benefits are in accordance with the Collective Labour Agreement for Dutch Universities, increasing from € 2872 per month in the first year to € 3670 in the fourth year. As a PhD candidate you will be enrolled in the TU Delft Graduate School. The TU Delft Graduate School provides an inspiring research environment with an excellent team of supervisors, academic staff and a mentor. The Doctoral Education Programme is aimed at developing your transferable, discipline-related and research skills. 

The TU Delft offers a customisable compensation package, discounts on health insurance, and a monthly work costs contribution. Flexible work schedules can be arranged.  

For international applicants, TU Delft has the Coming to Delft Service. This service provides information for new international employees to help you prepare the relocation and to settle in the Netherlands. The Coming to Delft Service offers a Dual Career Programme for partners and they organise events to expand your (social) network.

Additional information

For information, please contact Dr. Holger Caesar (h.caesar@tudelft.nl).   

Application procedure

Are you interested in this vacancy? Please apply no later than 22 Dec 2024 via the application button and upload the following documents:

• CV
• Motivational letter

You can address your application to Holger Caesar.

Doing a PhD at TU Delft requires English proficiency at a certain level to ensure that the candidate is able to communicate and interact well, participate in English-taught Doctoral Education courses, and write scientific articles and a final thesis. For more details please check the Graduate Schools Admission Requirements. 

Please note:

• You can apply online. We will not process applications sent by email and/or post. 
• A pre-employment screening can be part of the selection procedure.
• For the final candidates, a knowledge security check will be part of the application procedure. For more information on this check, please consult Chapter 8 of the National Knowledge Security Guidelines. We carry out this check on the basis of legitimate interest.
• Please do not contact us for unsolicited services.