REGISTRATION OPEN
NordDesign 2024
The NordDesign 2024 conference, 12-14 August 2024 - Co-hosted by the University of Iceland and Reykjavík University. (Registration is now OPEN)
Knowledge Base Repository
In addition to research papers, the Design Society is developing several valuable resources for those interested in the study of design. These include a repository of PhD theses, a library of case studies and transcripts of design activities, and an archive of our newsletters. Please note that these resources are accessible exclusively to Design Society members.
Evaluation of Different Large Language Model Agent Frameworks for Design Engineering Tasks
Pradas Gomez, Alejandro; Panarotto, Massimo; Isaksson, Ola
Type:
Year:
2024
Editor:
Malmqvist, J.; Candi, M.; Saemundsson, R. J.; Bystrom, F. and Isaksson, O.
Author:
Series:
NordDESIGN
Institution:
Chalmers University of Technology, Sweden
Page(s):
693-702
DOI number:
ISBN:
978-1-912254-21-7
Abstract:
This paper evaluates Large Language Models (LLMs) ability to support engineering tasks. Reasoning frameworks such as agents and multi-agents are described and compared. The frameworks are implemented with the LangChain python package for an engineering task. The results show that a supportive reasoning framework can increase the quality of responses compared to a standalone LLM. Their applicability to other engineering tasks is discussed. Finally, a perspective of task ownership is presented between the designer, the traditional software, and the Generative AI.
Keywords:
