Using an AI Chatbot to Refine Gherkin Specifications Based on Stakeholder Comments

Download statistics - Document (COUNTER):

Shi, Jianwei; Dryaev, Alan; Schneider, Kurt: Using an AI Chatbot to Refine Gherkin Specifications from Stakeholder Comments. Hannover : Institutionelles Repositorium der Leibniz Universität, Working Paper, 2024. DOI: https://doi.org/10.15488/17361

Selected time period:

year: 
month: 

Sum total of downloads: 68




Thumbnail
Abstract: 
A software project begins with capturing visions and requirements in an understandable format, e.g., vision videos, which represent complex software-based processes. This video invites comments from stakeholders for validating the vision. However, the easy-to-watch videos must be translated to easy-to-validate requirements, which can be written in the semi-formal Gherkin specification. Requirements engineers use a video and obtained comments to refine Gherkin specifications. However, this is a demanding task. AI chatbots such as ChatGPT can be used in the refinement. We investigated the effectiveness of using ChatGPT. Two requirements engineers used textual description of a vision video and comments of 12 stakeholders to refine Gherkin specifications with and without ChatGPT 3.5. We asked for stakeholders' opinions on the refined specifications with and without ChatGPT. Results show that (1) the understandability, and (2) the stakeholders' satisfaction on refined specifications with and without ChatGPT do not differentiate significantly; (3) ChatGPT generated detailed specifications but made formulation errors. We suggest using an AI Chatbot and learning from its answers to achieve stakeholders' satisfaction.
License of this version: CC BY 3.0 DE
Document Type: WorkingPaper
Publishing status: updatedVersion
Issue Date: 2024-05-16
Appears in Collections:Fakultät für Elektrotechnik und Informatik

distribution of downloads over the selected time period:

downloads by country:

pos. country downloads
total perc.
1 image of flag of Germany Germany 29 42.65%
2 image of flag of Canada Canada 20 29.41%
3 image of flag of United States United States 4 5.88%
4 image of flag of No geo information available No geo information available 2 2.94%
5 image of flag of Netherlands Netherlands 2 2.94%
6 image of flag of France France 2 2.94%
7 image of flag of South Africa South Africa 1 1.47%
8 image of flag of Tanzania, United Republic of Tanzania, United Republic of 1 1.47%
9 image of flag of Taiwan Taiwan 1 1.47%
10 image of flag of Sweden Sweden 1 1.47%
    other countries 5 7.35%

Further download figures and rankings:


Hinweis

Zur Erhebung der Downloadstatistiken kommen entsprechend dem „COUNTER Code of Practice for e-Resources“ international anerkannte Regeln und Normen zur Anwendung. COUNTER ist eine internationale Non-Profit-Organisation, in der Bibliotheksverbände, Datenbankanbieter und Verlage gemeinsam an Standards zur Erhebung, Speicherung und Verarbeitung von Nutzungsdaten elektronischer Ressourcen arbeiten, welche so Objektivität und Vergleichbarkeit gewährleisten sollen. Es werden hierbei ausschließlich Zugriffe auf die entsprechenden Volltexte ausgewertet, keine Aufrufe der Website an sich.

Search the repository


Browse