Abstract
As virtual assistants (VAs) become essential to contemporary interactions, it is imperative to understand how to evaluate their functionalities. This study offers a comparison framework for assessing the design and execution of Amazon Alexa and Microsoft Copilot Studio, emphasizing their capabilities in question-answering activities. Through the examination of their deterministic and probabilistic approaches, we evaluate response times, precision, flexibility, and linguistic support. We have developed a systematic framework to assess the strengths and shortcomings of each VA, utilizing educational queries as a realistic test case that elucidates the influence of design decisions on performance. Our study lays the groundwork for choosing an appropriate VA according to particular needs, assisting developers and organizations in traversing the varied realm of VA technologies. Regardless of whether precision or adaptability is prioritized, our approach facilitates an educated decision, simplifying the process of aligning the appropriate VA with the corresponding circumstance.
Citare
@Inproceedings{Todericiu2025AlexaAC,
author = {Ioana-Alexandra Todericiu and L. Dioşan and Camelia Serban},
booktitle = {International Conference on Agents and Artificial Intelligence},
title = {Alexa and Copilot: A Tale of Two Assistants},
year = {2025}
}