INSPIRE: Evaluation of a Smart-Home System for Infotainment Management and Device Control
Sebastian Moeller, Jan Krebber, Alexander Raake, Paula Smeele, Martin Rajman, Mirek Melichar, Vincenzo Pallotta, Gianna Tsakou, Basilis Kladis, Anestis Vovos, Jettie Hoonhout, Dietmar Schuchardt, Nikos Fakotakis, Todor Ganchev, Ilyas Potamitis
Abstract
This paper gives an overview of the assessment and evaluation methods which have been used to determine the quality of the INSPIRE smart home system. The system allows different home appliances to be controlled via speech, and consists of speech and speaker recognition, speech understanding, dialogue management, and speech output components. The performance of these components is first assessed individually, and then the entire system is evaluated in an interaction experiment with test users. Initial results of the assessment and evaluation are given, in particular with respect to the transmission channel impact on speech and speaker recognition, and the assessment of speech output for different system metaphors.
Create a lesson
Related papers
The Data Hospital: A Workflow-Based Concept for Explainable Research Data Quality Assistance
Lennard Scheurer, Robert Porzel, Vinicius Carrillo Beber et al.
Semantic Action Graph: A Shared Representation for Agent Grounding and Human Interpretation of Sports Highlights
Tica Lin, Deepak Chandran, Gauri Jagatap et al.
What Parents Can See: Divergent Accounts of Youth AI Companion Use in Parenting and Teenager Subreddits
Thomas Berkane, Anne Bischops, Anika Mellacheruvu et al.
Ageing, Digital Literacy, and Interaction Modality in Immer-sive Virtual Reality: Psychomotor Performance, Cognitive Flexibility, and Their Processing-Speed Association
Panagiotis Kourtesis, Katerina Denaxa, Lydia Asimakopoulo et al.
Stereotypically Yours: Portrayal and Perception of Race-Coded AI Companions
Wang Claire, Jiayue Melissa Shi, Agam Goyal et al.
TeamCAMS: An Open-Source Research Platform for Studying Human Behaviour in Human-AI Teams
Amos Brocco, Alain Chavaillaz, Andreas Sonderegger et al.