Knowledge Base Repository

In addition to research papers, the Design Society is developing several valuable resources for those interested in the study of design. These include a repository of PhD theses, a library of case studies and transcripts of design activities, and an archive of our newsletters. Please note that these resources are accessible exclusively to Design Society members.

Interactive visualisation of collaborative dynamics: a VLM-based approach for behavior and affect analysis

Liu, Shuyun (1); McTeague, Chris (1); Wolfram Klöckner, Hermann (1,2); Dreyer, Susanne (1); Thoring, Katja (1)


Type:
Year:
2026
Editor:
Štorga, M.; Škec, S.; Martinec, T.; Marjanović, D.; Pavković, N.
Author:
Series:
DESIGN
Institution:
1: Technical University of Munich, Germany; 2: Anhalt University of Applied Sciences, Germany
Page(s):
2413-2422
DOI number:
ISSN:
2732-527X (Online)
Abstract:
Collaboration is crucial in design and management, fostering innovation, problem-solving, and decision-making. We explore the use of vision-language models (VLMs) for analyzing collaboration, focusing on detecting social behavior and group affect. By fusing multimodal cues, VLMs enable more context-aware reasoning beyond surface-level perception. We develop a pipeline, a structured prompt and an interactive visualization for integrating VLMs into the analysis workflow. Comparing VLM and human analysis results, we discuss how VLMs can advance collaboration analysis and the remaining challenges.
Keywords:

This site uses cookies and other tracking technologies to assist with navigation and your ability to provide feedback, analyse your use of our products and services, assist with our promotional and marketing efforts, and provide content from third parties. Privacy Policy.