| A. Krouska, C. Troussas, Ph. Mylonas, I.Vogiatzis, C. Sgouropoulou |
| Evaluation Metrics and Ethical Concerns in the Design of Adaptive AI Chatbots |
| 10th South-East Europe Design Automation, Computer Engineering, Computer Networks and Social Media Conference (SEEDA-CECNSM 2025), Patras, Greece, September 19-21, 2025 |
|
ABSTRACT
|
| The proliferation of large language models in recent years has led to the widespread development of AI chatbots. AI chatbots are smart systems that enable conversations with users using natural language. Chatbots are used to automate tasks, offer real-time assistance, and enhance user experiences. Their increasing use in many domains, such as customer service, education and healthcare support, makes their reliable evaluation essential. To this direction, this paper presents a literature review on evaluation frameworks for adaptive AI chatbots, highlighting the trends, gaps, and future research directions. It focuses on four critical dimensions of chatbot assessment: personalization and adaptability, information accuracy, response adequacy and speed, as well as bias and ethical concerns. The comparative analysis of related studies shows the importance of applying multidimensional evaluation approaches that integrate both technical features and user-centered metrics. Furthermore, it identifies major challenges, such as the lack of standardized evaluation criteria and the need for transparency and ethical accountability in chatbot deployment.
|
| 19 September, 2025 |
| A. Krouska, C. Troussas, Ph. Mylonas, I.Vogiatzis, C. Sgouropoulou, "Evaluation Metrics and Ethical Concerns in the Design of Adaptive AI Chatbots", 10th South-East Europe Design Automation, Computer Engineering, Computer Networks and Social Media Conference (SEEDA-CECNSM 2025), Patras, Greece, September 19-21, 2025 |
[  PDF] [
BibTex] [
Print] [
 Back] |
