PhD Position Code Language Model Adaption

PhD Position Code Language Model Adaption

Published Deadline Location
12 Oct 30 Nov Delft

You cannot apply for this job anymore (deadline was 30 Nov 2023).

Browse the current job offers or choose an item in the top navigation above.

A fresh approach to adapting massive language models for optimized, safe, and personalized results, tailored to individual needs and beyond generic limitations.

Job description

Context: Given the competitive landscape surrounding the use of AI today, mere development and deployment of Large Language Models (LLM) in the IDE does not suffice. On one hand, the current approach of shipping/querying the same generic model for every task, project, and user will not provide optimal results. On the other hand, researchers have continuously trained ever-larger models which require large amounts of training data. This data is usually a massive unsanitized corpus extracted from public domains. Research has shown the resulting LLMs can memorize their training data and emit verbatim leading to legal issues. Finally, the large size of these models has become a bottleneck for their deployment in low-resource environments.

Goal: This project proposes to adapt and optimize the large generic code language models to different scenarios in order to yield tangible, timely, safe, and personalized outputs for the end-users.

Note: This PhD position is part of the AI for Software Engineering lab (AI4SE), a collaboration between JetBrains and Delft University of Technology. Hence, the prospective PhD student will also work closely with researchers and developers of JetBrains. More information is available at https://lp.jetbrains.com/research/ai-for-se/.

Specifications

Delft University of Technology (TU Delft)

Requirements

We are looking for candidates with the following criteria:

  • A Masters degree in a relevant discipline (such as computer science, software engineering, mathematics, or electrical engineering);
  • Have sufficient experience in both domains and a strong background in at least one of the following domains:
  1. Python, NLP, and Machine Learning: good understating of modern architectures including Transformers, and experience with HuggingFace, PyTorch and/or TensorFlow
  2. Kotlin and/or Java and Tool development
  • Excellent written and spoken English skills;
  • Ability to work independently and interdisciplinary and also have a team-based and supportive working attitude;
  • Prior experience with publishing research is not mandatory but a plus.

Doing a PhD at TU Delft requires English proficiency at a certain level to ensure that the candidate is able to communicate and interact well, participate in English-taught Doctoral Education courses, and write scientific articles and a final thesis. For more details please check the Graduate Schools Admission Requirements.

Conditions of employment

Fixed-term contract: 4 years.

Doctoral candidates will be offered a 4-year period of employment in principle, but in the form of 2 employment contracts. An initial 1,5 year contract with an official go/no go progress assessment within 15 months. Followed by an additional contract for the remaining 2,5 years assuming everything goes well and performance requirements are met.

Salary and benefits are in accordance with the Collective Labour Agreement for Dutch Universities, increasing from € 2770 per month in the first year to € 3539 in the fourth year. As a PhD candidate you will be enrolled in the TU Delft Graduate School. The TU Delft Graduate School provides an inspiring research environment with an excellent team of supervisors, academic staff and a mentor. The Doctoral Education Programme is aimed at developing your transferable, discipline-related and research skills.

The TU Delft offers a customisable compensation package, discounts on health insurance, and a monthly work costs contribution. Flexible work schedules can be arranged. 

For international applicants, TU Delft has the Coming to Delft Service. This service provides information for new international employees to help you prepare the relocation and to settle in the Netherlands. The Coming to Delft Service offers a Dual Career Programme for partners and they organise events to expand your (social) network.

Employer

Delft University of Technology

Delft University of Technology is built on strong foundations. As creators of the world-famous Dutch waterworks and pioneers in biotech, TU Delft is a top international university combining science, engineering and design. It delivers world class results in education, research and innovation to address challenges in the areas of energy, climate, mobility, health and digital society. For generations, our engineers have proven to be entrepreneurial problem-solvers, both in business and in a social context.

At TU Delft we embrace diversity as one of our core values and we actively engage to be a university where you feel at home and can flourish. We value different perspectives and qualities. We believe this makes our work more innovative, the TU Delft community more vibrant and the world more just. Together, we imagine, invent and create solutions using technology to have a positive impact on a global scale. That is why we invite you to apply. Your application will receive fair consideration.

Challenge. Change. Impact!

Department

Faculty Electrical Engineering, Mathematics and Computer Science

The Faculty of Electrical Engineering, Mathematics and Computer Science (EEMCS) brings together three scientific disciplines. Combined, they reinforce each other and are the driving force behind the technology we all use in our daily lives. Technology such as the electricity grid, which our faculty is helping to make completely sustainable and future-proof. At the same time, we are developing the chips and sensors of the future, whilst also setting the foundations for the software technologies to run on this new generation of equipment – which of course includes AI. Meanwhile we are pushing the limits of applied mathematics, for example mapping out disease processes using single cell data, and using mathematics to simulate gigantic ash plumes after a volcanic eruption. In other words: there is plenty of room at the faculty for ground-breaking research. We educate innovative engineers and have excellent labs and facilities that underline our strong international position. In total, more than 1000 employees and 4,000 students work and study in this innovative environment.

Click here to go to the website of the Faculty of Electrical Engineering, Mathematics and Computer Science.

Specifications

  • PhD
  • Engineering
  • 36—40 hours per week
  • €2770—€3539 per month
  • University graduate
  • TUD04516

Employer

Delft University of Technology (TU Delft)

Learn more about this employer

Location

Mekelweg 2, 2628 CD, Delft

View on Google Maps

Interesting for you