Join Us Sign In

Knowledge Base Repository

In addition to research papers, the Design Society is developing several valuable resources for those interested in the study of design. These include a repository of PhD theses, a library of case studies and transcripts of design activities, and an archive of our newsletters. Please note that these resources are accessible exclusively to Design Society members.

LLM-based voice chatbot surveys as an alternative to post-experience questionnaires: probe-controlled, ultra-short field interviews

Ding, Fujian; Taoka, Yuki; Nakatani, Momoko

Type:
Papers
DS 145: Proceedings of the DESIGN2026 19th International Design Conference
Year:
2026
Editor:
Štorga, M.; Škec, S.; Martinec, T.; Marjanović, D.; Pavković, N.
Author:
Ding, Fujian; Taoka, Yuki; Nakatani, Momoko
Series:
DESIGN
Institution:
Institute of Science Tokyo, Japan
Page(s):
2253-2262
DOI number:
10.1017/pds.2026.10583
ISSN:
2732-527X (Online)
Abstract:
Chatbot-based surveys offer low-burden, in-situ data collection, yet unconstrained LLMs often drift from research aims. We conducted 359 ultra-short, post-experience voice interviews in a public venue to compare a framework-guided LLM, an unconstrained LLM, and fixed questions. The guided approach produced significantly longer responses than fixed questions and yielded the richest diversity of process-specific accounts. These findings show that probe control is essential for eliciting actionable, experience-grounded feedback in real-world, time-limited settings.
Keywords:
design methods, human-centred design, interviews, artificial intelligence (AI), probing
DESIGN2026 - The 19th International Design Conference
Conferences

This site uses cookies and other tracking technologies to assist with navigation and your ability to provide feedback, analyse your use of our products and services, assist with our promotional and marketing efforts, and provide content from third parties. Privacy Policy.

Cookie Settings Accept Cookies