News

  • Feb 26, 2024 We posted all 24 accepted papers. Congrats to all authors!!
  • Oct 11, 2023 Our HotCRP site is ready for your submissions! (Submission deadline: Dec 7th, 2023)
  • Oct 11, 2023 Follow us on Twitter/X (@llm4code) to hear timely updates!

About

Large Language Models (LLMs), which are large-scale models being trained on massive textual corpora, have achieved significant advances in various domains, including Software Engineering (SE). Recently, there is a growing interest in applying LLMs to assist software development and maintenance, such as code generation and comprehension, test generation, as well as program repair. Although the application of LLMs on code-relevant tasks has shown very promising performance, there is a huge potential to further explore this growing domain.

The motivation of this workshop is to provide a platform for academics and practitioners to discuss and share their ideas on applying and developing LLMs to solve code-relevant problems in SE activities. This workshop is concerned with the research on

  • how to better apply LLMs to solve code-relevant tasks;
  • how to design better LLMs for code-relevant tasks;
  • how to better benchmark LLMs on code-relevant tasks.

This workshop aims to achieve multiple goals as follows. Firstly, this workshop aims to provide an opportunity for participants to discuss novel ideas and preliminary results on LLMs for solving code-relevant SE problems, so as to exchange the latest progress in this domain. Secondly, this workshop aims to encourage participants to discuss the open challenges and problems of LLM4code, so as to identify important future directions in this domain. Finally, this workshop aims to encourage participants to share infrastructures and benchmarks that are foundational and beneficial for the future research in this domain. This workshop is expected to foster

  • open research problems to pursue;
  • new techniques or new tools on LLM4Code;
  • benchmarks and datasets for LLM4Code;
  • empirical studies on LLM4Code.

To achieve these goals, this workshop will be scheduled with diverse event formats, including keynote talks, research paper presentations, and panel discussion. We believe that this workshop will provide abundant opportunities for both academic and industrial participants to discuss not only in the specific works but also in the high-level directions of this area.