A Study of the Reliability and Validity of the Use of Open AI Chatbots to Assess EFL Learners Speech Acts Performance: A Focus on Apology Speech Act
Loading...
Date
2024-06
Authors
Journal Title
Journal ISSN
Volume Title
Publisher
UNIVERSITÉ MOHAMED BOUDIAF - M’SILA
Abstract
This study aims to study the potential use of open AI Chatbots to fulfill assessment actions. Pragmatic competence and specifically speech acts pose a significant challenge to EFL language teachers, thus this study examines the use of AI chatbots in assessing the speech acts performance. Through the descriptive method and the use three questionnaires, AI-based and traditional assessment tools, this study research designed aimed to examine the reliability and validity of using the AI-based assessment tool developed in this study and labeled “ActSpeak”. The findings of the study revealed lack of moderate perceptions about the effectiveness of the use of AI-based assessment tools and limited use of these tools for assessment purposes. ActSpeak was found to be highly valid and reliable as an AI-based assessment tool to test, evaluate and enhance apology speech act performance. This study is the first initiative in the Algerian EFL context and in the field of the use of an open AI ChatBot programmed to assess speech acts. This study calls for further interest among EFL teachers in the effective use of automated assessment tools to asses EFL learners’ communicative competence.
Description
Keywords
Chatbot, Automated Assessment, EFL Classroom, Speech Acts, Apology Speech act, Communicative Competence.