Número completo
Full number
Proposed Emotional Questionnaire to Evaluate the User Experience of Virtual Learning Environments: Expert Validation
Laura N. Aballay. Instituto de Informática, Universidad Nacional de San Juan, San Juan, Argentina.
Silvana V. Aciar. Instituto de Informática, Universidad Nacional de San Juan, San Juan, Argentina.
César A. Collazos. Universidad del Cauca, Popayán, Colombia.
Alex A. Torres. Corporación Universitaria Comfacauca – UNICOMFACAUCA, Popayán, Colombia.
Resumen/Abstract
-
Resumen / Abstract
This paper presents a proposed questionnaire for the evaluation of user experience (UX) with emotions. Although there are several questionnaires, such as AttrakDiff and the User Experience Questionnaire (UEQ), that measure product-centered perceptions and acceptance, few consider emotions suitable for evaluating virtual learning environments. In response to this limitation, a new questionnaire, "EMO-UX", designed to assess UX in virtual learning environments (VLE) from an affective approach, is proposed. This instrument, currently validated by experts, seeks to provide a more accurate and less confusing alternative to existing tools, integrating elements that allow a more complete capture of the user's emotional state during their interaction with the product. In addition, the characteristics of the main existing emotional questionnaires are compared and analyzed, highlighting their strengths and limitations. This work provides an innovative tool to improve the understanding of UX, especially in virtual educational contexts.
Palabras Clave/Keywords
-
Palabras Clave / Keywords
Human computer interaction, Affective Computing, User Experience, Emotional Evaluation, Virtual Learning Environments, Surveys, Questionaries.
Referencias/References
-
Referencias / References
1. K. Capota, M. van Hout, and T. van der Geest, “Measuring the emotional impact of websites,” in Proceedings of the 2007 conference on Designing pleasurable products and interfaces - DPPI ’07, 2007, p. 135.
2. L. Masip Ardévol, “User experience methodology for the design and evaluation of interactive systems,” University of Lleida, 2013.
3. D. Quiñones, C. Rusu, and V. Rusu, “A methodology to develop usability/user experience heuristics,” Comput. Stand. Interfaces, vol. 59, pp. 109–129, Aug. 2018.
4. M. Hassenzahl, S. Diefenbach, and A. Göritz, “Needs, affect, and interactive products – Facets of user experience,” Interact. Comput., vol. 22, no. 5, pp. 353–362, Sep. 2010.
5. A. F. Aguirre, V. F. Ángela, C. A. Collazos, and R. Gil, “Proposal to evaluate the satisfaction of use in Virtual Learning Environments,” in Proceedings of the XV International Conference on Human Computer Interaction - Interacción ’14, 2014, pp. 1–4.
6. E. Crisol-Moya, L. Herrera-Nieves, and R. Montes-Soldado, “Educación virtual para todos: una revisión sistemática,” Educ. Knowl. Soc., vol. 21, no. 0, p. 13, Jun. 2020.
7. F. J. García-Peñalvo, A. Miguel, and S. Pardo, “Una revisión actualizada del concepto de eLearning. Décimo Aniversario,” vol. 16, no. 1, 2015.
8. E. Ivanova and G. Borzunov, “Optimization of machine learning algorithm of emotion recognition in terms of human facial expressions,” Procedia Comput. Sci., vol. 169, pp. 244–248, Jan. 2020.
9. M. R. Mahmood et al., “Classification techniques’ performance evaluation for facial expression recognition,” Artic. Indones. J. Electr. Eng. Comput. Sci., vol. 21, no. 2, pp. 1176–1184, 2021.
10. S. Patil, A. Joshi, G. Deore, A. Taley, and S. Sawant, “Emotion Detection Using Facial Recognition,” SSRN Electron. J., 2020.
11. A. Vartanov, V. Ivanov, and I. Vartanova, “Facial expressions and subjective assessments of emotions,” Cogn. Syst. Res., vol. 59, no. 2020, pp. 319–328, 2020.
12. E. S. Salama, R. A. El-Khoribi, M. E. Shoman, and M. A. Wahby Shalaby, “A 3D-convolutional neural network framework with ensemble learning techniques for multimodal emotion recognition,” Egypt. Informatics J., vol. 22, no. 2, pp. 167–176, Jul. 2021.
13. L. Schoneveld, A. Othmani, and H. Abdelkawy, “Leveraging recent advances in deep learning for audio-Visual emotion recognition,” Pattern Recognit. Lett., vol. 146, pp. 1–7, Jun. 2021.
14. S. Cano, L. García, C. A. Collazos, and S. Albiol, “Towards the Design of a System to Measure Emotions using Physiological Signals as Biofeedback. Case Study in Higher Education Students,” REHAB 2019, 2019.
15. J. A. Domínguez-Jiménez, K. C. Campo-Landines, J. C. Martínez-Santos, E. J. Delahoz, and S. H. Contreras-Ortiz, “A machine learning model for emotion recognition from physiological signals,” Biomed. Signal Process. Control, vol. 55, p. 101646, Jan. 2020.
16. L. Aballay, C. Collazos, S. Aciar, and A. Torres, “Analysis of Emotion Recognition Methods: A Systematic Mapping of the Literature,” in WITCOM 2024 - Telematics & Computing (En proceso de aprobación), 2024.
17. P. M. Desmet, “Measuring emotions: Development of an instrument to measure emotional responses to products,” Funology from usability to enjoyment. Kluwer Acad. Publ. Dordrecht, Boston, Londres, no. Blythe, M. A.; Overbeeke, K.; Monk, A. F.; Wright, P. C. (ed.), 2003.
18. L. N. Aballay, S. V. Aciar, and C. A. Collazos, “Students Emotions Evaluation on Virtual Learning Environments (Atena Editora),” Students Emot. Eval. Virtual Learn. Environ. (Atena Ed., vol. 2, no. 16, pp. 2–11, Jan. 2022.
19. M. Hassenzahl, M. Burmester, and F. Koller, “Der USer Experience (UX) auf der Spur: Zum einsatz von www.attrakdiff.de.” 2008.
20. M. M. Bradley and P. J. Lang, “Measuring emotion: The self-assessment manikin and the semantic differential,” J. Behav. Ther. Exp. Psychiatry, vol. 25, no. 1, pp. 49–59, 1994.
21. G. Huisman, M. Van Hout, B. Van Dijk, T. Van Der Geest, and D. Heylen, “LEMtool - Measuring emotions in visual interfaces,” Conf. Hum. Factors Comput. Syst. - Proc., no. August 2014, pp. 351–360, 2013.
22. P. Desmet, “Measuring Emotion: Development and Application of an Instrument to Measure Emotional Responses to Products,” Funology From Usability to Enjoyment. Kluwer Acad. Publ. Print. Netherlands., pp. 111–123, 2003.
23. Y. A. Méndez-Alegría, C. A. Collazos, T. Granollers, and R. Gil, “Rueda de emociones de Ginebra+: instrumento para la valoración emocional de los usuarios mientras participan en una evaluación de sistemas interactivos,” Dyna, vol. 91, no. 2, pp. 151–155, 2016.
24. K. R. Sacharin, V., Schlegel, K., & Scherer, “Geneva Emotion Wheel Rating Study,” Geneva, Switz. Univ. Geneva, Swiss Cent. Affect. Sci., 2012.
25. L. N. Aballay, S. V. Aciar, and C. A. Collazos, “Emotions for Virtual Learning Environments,” IEEE-RITA, vol. 9, no. 3, 2021.
26. J. I. Cocunubo-Suárez, J. A. Parra-Valencia, and J. E. Otálora-Luna, “Propuesta para la evaluación de Entornos Virtuales de Enseñanza Aprendizaje con base en estándares de Usabilidad Evaluation of Virtual Teaching- Learning Environments based on usability standards Cómo citar / How to cite Propuesta para la evaluación de En,” vol. 21, no. 41, pp. 123–7799, 2018.
27. L. Aballay, C. Collazos, and S. Aciar, “Emotions evaluation on Virtual Learning Environments: Students perceptions,” in VII Jornadas Iberoamericanas de Interação Humano-Computador - HCI 2021, 2021.
28. L. N. Aballay, S. V. Aciar, and C. A. Collazos, “Students Emotions Evaluation on Virtual Learning Environments,” J. Eng. Res., vol. 2, no. 16, pp. 2–11, Jul. 2022.
29. R.- Likert, “A technique for the measurement of attitudes.,” psycnet.apa.org, 1932.
30. M. I. Bernal-García, D. R. Salamanca Jiménez, N. Perez Gutiérrez, and M. P. Quemba Mesa, “Content validity by expert judgment of an instrument to measure physico-emotional perceptions in anatomical dissection practice,” Educ. Medica, Oct. 2018.
31. L. A. Galicia Alarcón, J. A. Balderrama Trápaga, R. Edel Navarro, L. A. Galicia Alarcón, J. A. Balderrama Trápaga, and R. Edel Navarro, “Validez de contenido por juicio de expertos: propuesta de una herramienta virtual,” Apert. (Guadalajara, Jal.), vol. 9, no. 2, pp. 42–53, 2017.
Cómo citar/How to cite
-
Cómo citar / How to cite
Aballay, L. N., Aciar, S. V., Collazos, C. A., y Torres, A. A. (2024). Proposed Emotional Questionnaire to Evaluate the User Experience of Virtual Learning Environments: Expert Validation. En C. Rusu et al., (1ª ed.), Transformación digital en la educación: innovaciones y desafíos en la tecnología educativa (pp. 73-78). Huelva (España): United Academic Journals (UA Journals). https://doi.org/10.54988/uaj.000028.012
