Knowledge Base Repository
In addition to research papers, the Design Society is developing several valuable resources for those interested in the study of design. These include a repository of PhD theses, a library of case studies and transcripts of design activities, and an archive of our newsletters. Please note that these resources are accessible exclusively to Design Society members.
Addressing LLM Creativity and Customization Paradox in Data Science: A DSM-based Exploration of underlying DevOps Process
Joglekar, Nitin (1); Mayande, Nitin (2); Daruwalla, Sharookh (2); Verma Kathuria, Shreeya (2)
Type:
Year:
2026
Editor:
Langner, Christopher; Kreimeyer, Matthias; Panarotto, Massimo; Cascini, Gaetano; Browning, Tyson R.; Eppinger, Steven D.; Yassine, Ali A.
Author:
Series:
DSM
Institution:
1: Villanova School of Business, United States of America;
2: Tellagence Inc., United States of America
Page(s):
151-160
DOI number:
ISBN:
NA
ISSN:
NA
Abstract:
Usage of LLM technology for data science applications faces a Creativity Paradox, because LLMs are generative and probabilistic engines. A context extraction solution, based on semantic and syntactic context assessment summarization (SSAS) has been developed to address this paradox. SSAS approach creates an opportunity that is particularly relevant for large scale text processing that creates customized context summaries and data categorizations. This SSAS solution requires iterative steps, termed as data consistency and context summarization, which create novel dependencies in the DevOps process. Based on dependency structure matrix (DSM) analysis of an implemented DevOps process, we examine task dependencies and long feedback loops. Results show that management of DevOps dependencies are integral for securing high quality technical and business process outcomes. While some of the tasks could be further automated, other tasks – involving judgement, decisions, and interactions between end-customers and data scientists – cannot be automated within this solution context.
Keywords:
