Join Us Sign In

Knowledge Base Repository

In addition to research papers, the Design Society is developing several valuable resources for those interested in the study of design. These include a repository of PhD theses, a library of case studies and transcripts of design activities, and an archive of our newsletters. Please note that these resources are accessible exclusively to Design Society members.

Multi-agent generative AI for concept evaluation: consistency, knowledge integration and human alignment

Mas'udah, Mas'udah (1); Livotov, Pavel (1); Kokoschko, Björn R. (2,3); Xu, Wanyu (4); Hendra, Immanuel (5); Hartmann, Niklas (1)

Type:
Papers
DS 145: Proceedings of the DESIGN2026 19th International Design Conference
Year:
2026
Editor:
Štorga, M.; Škec, S.; Martinec, T.; Marjanović, D.; Pavković, N.
Author:
Mas'udah, Mas'udah (1); Livotov, Pavel (1); Kokoschko, Björn R. (2,3); Xu, Wanyu (4); Hendra, Immanuel (5); Hartmann, Niklas (1)
Series:
DESIGN
Institution:
1: Offenburg University of Applied Sciences, Germany; 2: Otto von Guericke University Magdeburg, Germany; 3: Anhalt University of Applied Sciences, Germany; 4: Texas A&M University, United States of America; 5: Singapore University of Technology and Design, Singapore
Page(s):
2453-2462
DOI number:
10.1017/pds.2026.10603
ISSN:
2732-527X (Online)
Abstract:
Early-stage concept evaluation is critical for selecting viable designs. This study introduces a multi-agent generative AI framework for assessing concepts across four configurations: AI with retrieval-augmented knowledge, AI without external knowledge, human experts, and a hybrid approach. The findings show that AI panels tend to produce uniform evaluation patterns, while retrieval-augmented knowledge alters rating behaviour without leading to closer alignment with human judgement. Hybrid setting achieved closest alignment, indicating AI is effective when combined with expert interpretation.
Keywords:
multi-agent system, artificial intelligence (AI), retrieval-augmented knowledge, concept evaluation, sustainable design
DESIGN2026 - The 19th International Design Conference
Conferences

This site uses cookies and other tracking technologies to assist with navigation and your ability to provide feedback, analyse your use of our products and services, assist with our promotional and marketing efforts, and provide content from third parties. Privacy Policy.

Cookie Settings Accept Cookies