Skip to main content

Resultados relacionados

Resultados totales (Incluyendo duplicados): 31
Encontrada(s) 1 página(s)

Digibug. Repositorio Institucional de la Universidad de Granada
Publication Artículo científico (JournalArticle)

First Workshop on Multimodal e-Coaches

  • Angelini, Leonardo
  • El Kamali, Mira
  • Mugellini, Elena
  • Khaled, Omar Abou
  • Dimitrov, Yordan
  • Veleva, Vera
  • Gospodinova, Zlatka
  • Miteva, Nadejda
  • Wheeler, Richard
  • Callejas Carrión, Zoraida|||0000-0001-8891-5237
  • Griol Barres, David
  • Benghazi Akhlaki, Kawtar|||0000-0002-6677-7301
  • Noguera García, Manuel|||0000-0003-0503-6451
  • Bamidis, Panagiotis
  • Konstantinidis, Evdokimos
  • Petsani, Despoina
  • Beristain Iraola, Andoni
  • Fotiadis, Dimitrios I.
  • Chollet, Gérard
  • Torres, Inés
  • Esposito, Anna
  • Schlieter, Hannes
This preprint follows ACM policy: “Authors who publish with ACM have the freedom to post peer-reviewed pre-print versions of their papers to personal websites and institutional repositories. They can add a single-click link to their final published papers, and re-use any portion of their published work with the inclusion of a citation and DOI link. Authors can also post on any repository legally mandated by the agency funding the research on which the work is based, and on any non-commercial repository or aggregation that does not duplicate ACM tables of contents/substantially duplicate an ACM-copyrighted volume or issue” (https://authors.acm.org/author-resources/author-rights.) 2, e-Coaches are promising intelligent systems that aims at supporting human everyday life, dispatching advice through different interfaces, such as apps, conversational interfaces and augmented reality interfaces. This workshop aims at exploring how e-coaches might benefit from spatially and timemultiplexed interfaces and from different communication modalities (e.g., text, visual, audio, etc.) according to the context of the interaction., The NESTORE, SAAM, CAPTAIN, HOLOBALANCE, EMPATHIC, MENHIR, vCare projects are supported by the European Commission under the Horizon 2020 programmes SC1-PM-15-2017 H2020-MSCA-RISE-2018, and H2020-1.3.3, respectively through the project grants N.769643, 769661, 769830, 769574, 769872, 823907, 769807. The authors want to thank their respective Consortia. The opinions expressed in this paper are those of the authors and are not necessarily those of the project partners or the European Commission.
Digibug. Repositorio Institucional de la Universidad de Granada
Publication Capítulo o parte de un libro (BookPart)

Conversational agents for mental health and wellbeing

  • Callejas Carrión, Zoraida|||0000-0001-8891-5237
  • Griol Barres, David
This is a pre-print version of the chapter: Zoraida Callejas, David Griol. 2021. Conversational agents for mental healthand wellbeing. Accepted for the book: Lopez-Soto, T. (Ed.). (2021). Dialog Systems: A Perspective from Language,Logic and Computation. Springer International Publishing.https://doi.org/10.1007/978-3-030-61438-6(https://www.springer.com/gp/book/9783030614379)This preprint follows Springer Self-archiving policy for non-open access books and chapters (https://www.springer.com/gp/open-access/publication-policies/self-archiving-policy): “authors may deposit a portion ofthe pre-submission version of their manuscript (preprint) in a recognised preprint server (...). This portion of thepre-submission manuscript (preprint) may be deposited and made publicly available at a, Recent advances in spoken language technology, artificial intelligence, and conversational interface design, coupled with the emergence of smart devices, have increased the possibilities of using conversational interfaces for a growing range of application domains. These interfaces are currently applied in the healthcare domain in a range of innovative tasks that allow to provide a more natural an user-friendly human-machine communication, promote patient participation in their own care, and help and support medical professionals. This chapter provides a detailed description of the great potential for the use of conversational interfaces for the specific area of mental health by means of the description of their most valuable applications in this domain and the open challenges for future research., This research has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 823907 (MENHIR project https://menhir-project.eu).
Digibug. Repositorio Institucional de la Universidad de Granada
Publication Contribución de congreso (ConferenceOutput)

Conversational Systems Research in Spain: A Scientometric Approach

  • Griol Barres, David
  • Callejas Carrión, Zoraida|||0000-0001-8891-5237
We would like to thank the support of the Spanish Plan for the Advancement of Language Technology (https://www.plantl.gob.es/) and the Secretaría de Estado para la Digitalización e Inteligencia Artificial (SEDIA). This research has also received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 823907 (MENHIR project: https://menhir-project.eu)., The aim of this paper is to present a preliminary scientometric study of the area of conversational systems in Spain. In order to do so, we have used the Web of Science database to retrieve the papers in the area using a comprehensive list of keywords and considering those papers with at least one author with Spanish affiliation. Our results present an overview of the main topics, authors and institutions involved in conversational system research and show the good status of Spanish research in this discipline., We would like to thank the support of the Spanish Plan for the Advancement of Language Technology (https://www.plantl.gob.es/) and the Secretaría de Estado para la Digitalización e Inteligencia Artificial (SEDIA). This research has also received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 823907 (MENHIR project: https://menhir-project.eu).
Digibug. Repositorio Institucional de la Universidad de Granada
Publication Estudio, informe, memoria (Report)

Cancer Survivorship and AI for Well-being White Paper: A European research projects collaborative perspective

  • Callejas Carrión, Zoraida|||0000-0001-8891-5237
  • Flynn, Tom
The Cancer Survivorship - AI for Well-being cluster (#CS_AIW) has brought together 11 EU-funded projects working in artificial intelligence (AI) for healthcare and well-being with the aim of transcending the individual project experiences and stop working in silos. The White Paper presents the #CS_AIW initiative and our collective shared vision, providing an overview of the participating projects and it reports on the achievements and lessons learned from our collaboration, including both the benefits obtained and the difficulties addressed. The experience with #CS_AIW to date has proven that collaboration within the cluster has been extremely beneficial and useful to foster an ethos of cross-fertilization engagement, share best practices, boost cross-sector collaboration, increase the participation of end user communities, and reach a wider audience. The activities organized, which encompass meetings, roundtable discussions, podcasts, a better practices guide, a common data space and the white paper itself, have proven to be an inherited valued initiative to generate, activate and communicate knowledge and innovation in the areas of mental health, well-being, cancer recovery, patient support and participatory research., The projects in #CS_AIW have received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement no.: ASCAPE - Ref 875351 BD4QoL - Ref 875192 CAPABLE - Ref 875052 CLARIFY - Ref 860627 FAITH - Ref 875358 LIFECHAMPS - Ref 875329 MENHIR - Ref 823907 ONCORELIEF - Ref 875392 PERSIST - Ref 875406 QUALITOP - Ref 875171 REBECCA - Ref 65231
Digibug. Repositorio Institucional de la Universidad de Granada
Publication Capítulo o parte de un libro (BookPart)

A proposal for Developing and Deploying Statistical Dialog Management in Commercial Conversational Platforms

  • Cañas, Pablo
  • Griol Barres, David
  • Callejas Carrión, Zoraida|||0000-0001-8891-5237
Conversational interfaces have recently become ubiquitous in the personal sphere by improving an individual’s quality of life and industrial environments by automating services and their corre- sponding cost savings. However, designing the dialog model used by these interfaces to decide the following response is a hard-to-accomplish task for complex conversational interactions. This paper proposes a statistical-based dialog manager architecture, which provides flexibility to develop and maintain this module. Our proposal has been integrated using DialogFlow, a natural language understanding platform provided by Google to design conversational user interfaces. The proposed hybrid architecture has been assessed with a real use case for a train scheduling domain, proving that the user experience is highly valued and can be integrated into commercial setups
Digibug. Repositorio Institucional de la Universidad de Granada
Publication Artículo científico (JournalArticle)

The Role of Trust in Proactive Conversational Assistants

  • Kraus, Matthias
  • Callejas Carrión, Zoraida|||0000-0001-8891-5237
This work was supported in part by the German Federal Ministry of Education and Research through the Project ``RobotKoop: Cooperative Interaction Strategies and Goal Negotiations with Learning Autonomous Robots,'' and in part by the European Union's Horizon 2020 Research and Innovation Program through MENHIR: Mental health monitoring through interactive conversations (https://menhir-project.eu) under Agreement No 823907., Humans and machines harmoniously collaborating and benefiting from each other is a long lasting dream for researchers in robotics and artificial intelligence. An important feature of efficient and rewarding cooperation is the ability to assume possible problematic situations and act in advance to prevent negative outcomes. This concept of assistance is known under the term proactivity. In this article, we investigate the development and implementation of proactive dialogues for fostering a trustworthy human-computer relationship and providing adequate and timely assistance. Here, we make several contributions. A formalisation of proactive dialogue in conversational assistants is provided. The formalisation forms a framework for integrating proactive dialogue in conversational applications. Additionally, we present a study showing the relations between proactive dialogue actions and several aspects of the perceived trustworthiness of a system as well as effects on the user experience. The results of the experiments provide significant contributions to the line of proactive dialogue research. Particularly, we provide insights on the effects of proactive dialogue on the human-computer trust relationship and dependencies between proactive dialogue and user specific and situational characteristics., Federal Ministry of Education & Research (BMBF), European Commission 823907
Digibug. Repositorio Institucional de la Universidad de Granada
Publication Artículo científico (JournalArticle)

Discriminative Power of Handwriting and Drawing Features in Depression

  • Greco, Claudia
  • Raimo, Gennaro
  • Amorese, Terry
  • Cuciniello, Marialucia
  • McConvey, Gavin
  • Cordasco, Gennaro
  • Faundez Zanuy, Marcos
  • Vinciarelli, Alessandro
  • Callejas Carrión, Zoraida|||0000-0001-8891-5237
  • Esposito, Anna
This study contributes knowledge on the detection of depression through handwriting/drawing features, to identify quantitative and noninvasive indicators of the disorder for implementing algorithms for its automatic detection. For this purpose, an original online approach was adopted to provide a dynamic evaluation of handwriting/drawing performance of healthy participants with no history of any psychiatric disorders (n=28), and patients with a clinical diagnosis of depression (n=27). Both groups were asked to complete seven tasks requiring either the writing or drawing on a paper while five handwriting/drawing features’ categories (i.e. pressure on the paper, time, ductus, space among characters, and pen inclination) were recorded by using a digitalized tablet. The collected records were statistically analyzed. Results showed that, except for pressure, all the considered features, successfully discriminate between depressed and nondepressed subjects. In addition, it was observed that depression affects different writing/drawing functionalities. These findings suggest the adoption of writing/drawing tasks in the clinical practice as tools to support the current depression detection methods. This would have important repercussions on reducing the diagnostic times and treatment formulation., European Union Horizon 2020 research and innovation program under grant agreement No. 769872 (EMPATHIC), European Union Horizon 2020 research and innovation program under grant agreement No. 823907 (MENHIR), Project SIROBOTICS that received funding from Ministero dell'Istruzione, dell'Università, e della Ricerca (MIUR), PNR 2015- 2020, D.D. 1735/2017, Project ANDROIDS that received funding from Università della Campania \Luigi Vanvitelli" inside the program V:ALERE 2019, funded with D.R. 906/2019, Project SALICE that received funding from Università della Campania \Luigi Vanvitelli" inside the program Giovani Ricercatori (DR 509/2022), funded with DR 834/2022
Digibug. Repositorio Institucional de la Universidad de Granada
Publication Capítulo o parte de un libro (BookPart)

Feature Set Ensembles for Sentiment Analysis of Tweets

  • Griol Barres, David
  • Kanagal-Balakrishna, C.
  • Callejas Carrión, Zoraida|||0000-0001-8891-5237
In recent years, sentiment analysis has attracted a lot of research attention due to the explosive growth of online social media usage and the abundant user data they generate. Twitter is one of the most popular online social networks and a microblogging platform where users share their thoughts and opinions on various topics. Twitter enforces a character limit on tweets, which makes users find creative ways to express themselves using acronyms, abbreviations, emoticons, etc. Additionally, communication on Twitter does not always follow standard grammar or spelling rules. These peculiarities can be used as features for performing sentiment classification of tweets. In this chapter, we propose a Maximum Entropy classifier that uses an ensemble of feature sets that encompass opinion lexicons, n-grams and word clusters to boost the performance of the sentiment classifier. We also demonstrate that using several opinion lexicons as feature sets provides a better performance than using just one, at the same time as adding word cluster information enriches the feature space.
Digibug. Repositorio Institucional de la Universidad de Granada
Publication Contribución de congreso (ConferenceOutput)

Implementation of a Statistical Dialogue Manager for Commercial Conversational Systems

  • Cañas, Pablo
  • Griol Barres, David
Conversational interfaces have recently become an ubiquitous element in both the personal sphere by improving individual’s quality of life, and industrial environments by the automation of services and its corresponding costs savings. However, designing the dialogue model used by these interfaces to decide the next response is a hard-to-accomplish task for complex conversational interactions. In this paper, we propose a statistical-based dialogue manager architecture, which provides flexibility to develop and maintain this module. Our proposal has been integrated with DialogFlow, a natural language understanding platform provided by Google to design conversational user interfaces. The proposed architecture has been assessed with a real use case for a train scheduling domain, proving that the user experience is of a high value and it can be integrated for commercial setups., European Union’s Horizon 2020 research and innovation programme under grant agreement No 823907
Digibug. Repositorio Institucional de la Universidad de Granada
Publication Contribución de congreso (ConferenceOutput)

Managing Multi-task Dialogs by Means of a Statistical Dialog Management Technique

  • Griol Barres, David
  • Callejas Carrión, Zoraida|||0000-0001-8891-5237
  • Quesada, José F.
One of the most demanding tasks when developing a dialog system consists of deciding the next system response considering the user’s actions and the dialog history, which is the fundamental responsibility related to dialog management. A statistical dialog management technique is proposed in this work to reduce the effort and time required to design the dialog manager. This technique allows not only an easy adaptation to new domains, but also to deal with the different subtasks for which the dialog system has been designed. The practical application of the proposed technique to develop a dialog system for a travel-planning domain shows that the use of task-specific dialog models increases the quality and number of successful interactions with the system in comparison with developing a single dialog model for the complete domain., info:eu-repo/grantAgreement/EC/H2020/823907 CAVIAR project (MINECO, TEC2017-84593-C2-1-R, AEI/FEDER, UE)
Digibug. Repositorio Institucional de la Universidad de Granada
Publication Contribución de congreso (ConferenceOutput)

An application of conversational systems to promote healthy lifestyle habits

  • Griol Barres, David
  • Callejas Carrión, Zoraida|||0000-0001-8891-5237
  • Fernández-Martínez, Fernando
  • Esposito, Anna
Recent reports indicate the multiple benefits of adopting conversational systems for healthcare, providing automation of management tasks in overburdened healthcare systems, improved patient experiences, and better efficiency and productivity rates. In this paper, we describe a conversational system aimed at promoting healthy lifestyle habits related to nutrition and physical exercise. The system has been developed using Google’s Dialogflow platform and the combination of different APIs and data repositories in the cloud. It has been integrated in the Facebook Messenger instant messaging platform. The results of the preliminary assessment of the system through a subjective questionnaire show the high degree of satisfaction of the users with the functionalities provided and the help offered to allow fulfilling the predefined objectives.
Digibug. Repositorio Institucional de la Universidad de Granada
Publication Artículo científico (JournalArticle)

Architecting dietary intake monitoring as a service combining NLP and IoT

  • Benítez-Guijarro, Antonio
  • Callejas Carrión, Zoraida|||0000-0001-8891-5237
  • Noguera García, Manuel|||0000-0003-0503-6451
  • Benghazi, Kawtar
Currently there exist many tools that support monitoring and encouragement of healthy nutrition habits in the context of wellness promotion. In this domain, interfaces based on natural language provide more flexibility for nutritional self-reporting than traditional form-based applications, allowing the users to provide richer and spontaneous descriptions. Nonetheless, in certain circumstances, natural language records may miss some important aspects, such as the quantity of food eaten, which results in incomplete recordings. In the Internet-of-Things (IoT) paradigm, smart home appliances can support and complement the recording process so as to make it more accurate. However, in order to build systems that support the semantic analysis of nutritional self-reports, it is necessary to integrate multiple inter-related components, possibly within complex e-health platforms. For this reason, these components should be designed and encapsulated avoiding monolithic approaches that derive in rigidity and dependency of particular technologies. Currently, there are no models or architectures that serve as a reference for developers towards this objective. In this paper, we present a service-based architecture that helps to contrast and complement the descriptions of food intakes by means of connected smart home devices, coordinating all the stages during the process of recognizing food records provided in natural language. Additionally, we aim to identify and design the essential services that are required to automate the recording and subsequent processing of natural language descriptions of nutritional intakes in association with smart home devices. The functionalities provided by each of these services are ready to work in isolation, just out of the box, or in downstream pipeline processes, bypassing the inconveniences of monolithic architectures., DEP2015-70980-R of the Spanish Ministry of Economy and Competitiveness (MINECO) and European Regional Development Fund (ERDF), European Union’s Horizon 2020 research and innovation programme under grant agreement No 823907, COST Action IC1303 AAPELE
Digibug. Repositorio Institucional de la Universidad de Granada
Publication Contribución de congreso (ConferenceOutput)

Co-creating Requirements and Assessing End-User Acceptability of a Voice-Based Chatbot to Support Mental Health: A Thematic Analysis of a Living Lab Workshop

  • Benítez-Guijarro, Antonio
  • Bond, Raymond
  • Booth, Frederick
  • Callejas Carrión, Zoraida|||0000-0001-8891-5237
  • Ennis, Edel
  • Esposito, Anna
  • Kraus, Mathias
  • McConvey, Gavin
  • McTear, Michael
  • Mulvenna, Maurice
  • Potts, Courtney
  • Pragst, Louisa
  • Turkington, Robin
  • Wagner, Nicolas
  • Zheng, Huiru
This is a preprint of the paper: Benítez-Guijarro A. et al. (2021) Co-creating Requirements and Assessing End-User Acceptability of a Voice-Based Chatbot to Support Mental Health: A Thematic Analysis of a Living Lab Workshop. In: D’Haro L.F., Callejas Z., Nakamura S. (eds) Conversational Dialogue Systems for the Next Decade. Lecture Notes in Electrical Engineering, vol 704. Springer, Singapore. https://doi.org/10.1007/978-981-15-8395-7_15 This preprint follows Springer Self-archiving policy for non-open access books and chapters (https://www.springer. com/gp/open-access/publication-policies/self-archiving-policy): “authors may deposit a portion of the pre-submission version of their manuscript (preprint) in a recognised preprint server (...). Thi, Mental health and mental wellbeing have become an important factor to many citizens navigating their way through their environment and in the work place. New technology solutions such as chatbots are potential channels for supporting and coaching users to maintain a good state of mental wellbeing. Chatbots have the added value of providing social conversations and coaching 24/7 outside from conventional mental health services. However, little is known about the acceptability and user led requirements of this technology. This paper uses a living lab approach to elicit requirements, opinions and attitudes towards the use of chatbots for supporting mental health. The data collected was acquired from people living with anxiety or mild depression in a workshop setting. The audio of the workshop was recorded and a thematic analysis was carried out. The results are the co-created functional requirements and a number of use case scenarios that can be of interest to guide future development of chatbots in the mental health domain., This research has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 823907 (MENHIR: Mental health monitoring through interactive conversations https://menhir-project.eu).
Digibug. Repositorio Institucional de la Universidad de Granada
Publication Tesis doctoral (DoctoralThesis)

De lo trágico en las canciones populares infantiles españolas: un análisis del lenguaje textual con métodos mixtos, Tragedy in spanish children's folk songs: a textual analysis with mixed methods

  • Albacete Maza, Juan
La presente tesis, con mención de doctor internacional, se compone de ocho capítulos, a saber: Marco Teórico, Introduction, Método, Resultados, Diseño de Intervención, Conclusions, Referencias Bibliográficas y Anexos. Tras una extensa revisión bibliográfica de la literatura académica disponible, esta investigación aborda un estudio en profundidad del componente trágico presente en las canciones populares infantiles españolas; en concreto, un total de 2558 composiciones han sido analizadas. Para ello, con un enfoque metodológico mixto, se lleva a cabo un multianálisis de dicho contenido trágico: análisis de contenido manual, análisis de contenido informático, análisis formal de las letras, análisis musical y análisis hermenéutico. Los análisis de contenido manual e informático muestran una alta concordancia y fiabilidad. Finalizado el análisis anterior, se pasa a reflexionar sobre el potencial pedagógico de las canciones populares infantiles españolas. Dicha reflexión cristaliza en la aportación de un programa de intervención en educación para la muerte, lo trágico y la resiliencia, a través de las canciones populares infantiles españolas identificadas como trágicas por el análisis previo. Como conclusión, se confirma la presencia significativa de elementos textuales trágicos en las letras de las canciones populares infantiles españolas, la fertilidad de los métodos de investigación utilizados y la potencialidad de las canciones populares infantiles españolas como recurso educativo., The present dissertation, with an international doctoral mention, is comprised of eight chapters, namely: Theoretical Framework, Introduction, Method, Results, Intervention Design, Conclusions, Bibliographical References and Annexes. After an extensive bibliographic review of the academic literature, this PhD thesis addresses an in-depth study of the tragic component present in Spanish children's folk songs. A mixed methodological approach has been followed to analyze 2558 compositions that comprised manual content analysis, computer content analysis, formal analysis of the lyrics, musical analysis, and hermeneutic analysis. The manual and computerized content analyses show a high agreement rate and reliability. Based on the results obtained, we reflect on the pedagogical potential of Spanish children's folk songs. This reflection crystallizes in the design of an educational intervention program for death, tragedy, and resilience, using the Spanish children's folk songs previously identified as tragic. In conclusion, it is possible to confirm a significant presence of tragic textual elements in Spanish children's folk songs, the fertility of the research methods employed, and the potential of these traditional compositions as an educational resource., Tesis Univ. Granada., Fundation for Islamic Culture & Religious Tolerance, Proyecto de Investigación Europeo Mental Health Monitoring through Interactive Conversations, financiado por la Comisión Europea, dentro del Programa H2020 MSCA-RISE (ref. 823907)
Digibug. Repositorio Institucional de la Universidad de Granada
Publication Artículo científico (JournalArticle)

Mobile Conversational Agents for Stroke Rehabilitation Therapy

  • Griol Barres, David
  • Callejas Carrión, Zoraida|||0000-0001-8891-5237
This “accepted article” follows IEEE post-publication policy: https://journals.ieeeauthorcenter. ieee.org/become-an-ieee-journal-author/publishing-ethics/guidelines-and-policies/ post-publication-policies/ ©2019 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works., Mobile health (m-Health) has emerged as a rapidly developing area that is transforming clinical research and health care on a global scale. In this paper, we describe a conversational app for the therapy of stroke rehabilitation. The main objective of the conversational app is to help recovering cognitive abilities of patients by means of a set of proposed exercises, which are divided into 8 categories focused on specific abilities. These categories have been defined after a detailed review of the guidelines for rehabilitation and training therapies. In addition, the application integrates a multimodal conversational interface to facilitate human-computer interaction, which has been specially designed for the elderly and patients with motor or visual or disabilities. The exercises provided by the application can be easily adapted to the specific users’ requirements and preferences by means of the incorporation, deletion or modification of routines stored into a specific database isolated from the logic of the application., This research has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No. 823907 (MENHIR project) and from the Spanish Ministry of Economy, Industry and Competitiveness through the CAVIAR (MINECO, TEC2017-84593-C2-1-R) project.
Digibug. Repositorio Institucional de la Universidad de Granada
Publication Artículo científico (JournalArticle)

Fine-Tuning BERT Models for Intent Recognition Using a Frequency Cut-Off Strategy for Domain-Specific Vocabulary Extension

  • Fernández Martínez, Fernando
  • Griol Barres, David
  • Callejas Carrión, Zoraida|||0000-0001-8891-5237
The work leading to these results was supported by the Spanish Ministry of Science and Innovation through the R& D&i projects GOMINOLA (PID2020-118112RB-C21 and PID2020118112RB-C22, funded by MCIN/AEI/10.13039/501100011033), CAVIAR (TEC2017-84593-C2-1-R, funded by MCIN/ AEI/10.13039/501100011033/FEDER "Una manera de hacer Europa"), and AMICPoC (PDC2021-120846-C42, funded by MCIN/AEI/10.13039/501100011033 and by "the European Union "NextGenerationEU/PRTR"). This research also received funding from the European Union's Horizon2020 research and innovation program under grant agreement No 823907 (http://menhirproject.eu, accessed on 2 February 2022). Furthermore, R.K.'s research was supported by the Spanish Ministry of Education (FPI grant PRE2018-083225)., Intent recognition is a key component of any task-oriented conversational system. The intent recognizer can be used first to classify the user’s utterance into one of several predefined classes (intents) that help to understand the user’s current goal. Then, the most adequate response can be provided accordingly. Intent recognizers also often appear as a form of joint models for performing the natural language understanding and dialog management tasks together as a single process, thus simplifying the set of problems that a conversational system must solve. This happens to be especially true for frequently asked question (FAQ) conversational systems. In this work, we first present an exploratory analysis in which different deep learning (DL) models for intent detection and classification were evaluated. In particular, we experimentally compare and analyze conventional recurrent neural networks (RNN) and state-of-the-art transformer models. Our experiments confirmed that best performance is achieved by using transformers. Specifically, best performance was achieved by fine-tuning the so-called BETO model (a Spanish pretrained bidirectional encoder representations from transformers (BERT) model from the Universidad de Chile) in our intent detection task. Then, as the main contribution of the paper, we analyze the effect of inserting unseen domain words to extend the vocabulary of the model as part of the fine-tuning or domain-adaptation process. Particularly, a very simple word frequency cut-off strategy is experimentally shown to be a suitable method for driving the vocabulary learning decisions over unseen words. The results of our analysis show that the proposed method helps to effectively extend the original vocabulary of the pretrained models. We validated our approach with a selection of the corpus acquired with the Hispabot-Covid19 system obtaining satisfactory results., Spanish Ministry of Science and Innovation (MCIN/AEI) PID2020-118112RB-C21 PID2020118112RB-C22 PDC2021-120846-C42, Spanish Ministry of Science and Innovation (MCIN/AEI/FEDER "Una manera de hacer Europa") TEC2017-84593-C2-1-R, Spanish Ministry of Science and Innovation (European Union "NextGenerationEU/PRTR") PDC2021-120846-C42, European Commission 823907, German Research Foundation (DFG) PRE2018-083225
Digibug. Repositorio Institucional de la Universidad de Granada
Publication Artículo científico (JournalArticle)

Measuring and fostering engagement with mental health e-coaches

  • Chollet, Gérard
  • Torres, María Inés
  • Esposito, Anna
  • Callejas Carrión, Zoraida|||0000-0001-8891-5237
  • Griol Barres, David
  • Benghazi Akhlaki, Kawtar|||0000-0002-6677-7301
  • Noguera García, Manuel|||0000-0003-0503-6451
This preprint follows ACM policy: “Authors who publish with ACM have the freedom to post peer-reviewed pre-print versions of their papers to personal websites and institutional repositories. They can add a single-click link to their final published papers, and re-use any portion of their published work with the inclusion of a citation and DOI link. Authors can also post on any repository legally mandated by the agency funding the research on which the work is based, and on any non-commercial repository or aggregation that does not duplicate ACM tables of contents/substantially duplicate an ACM-copyrighted volume or issue” (https://authors.acm.org/author-resources/author-rights.), Mental health e-coaches and technology-delivered services are showing considerable benefits to foster mental health literacy, monitor symptoms, favour self-management of different mental health conditions and scaffold positive behaviours. However, adherence to these systems is usually low and generally declines over time. There exists a recent body of work addressing engagement with mental health technology with the aim to understand the factors that influence sustained use and inform the design of systems that are able to generate sufficient engagement to attain their expected results. This paper explores the different facets of engagement in mental health e-coaches, including aspects related to the estimation of system use from log data, effective engagement, user experience, motivation, incentives, user expectations, peer support and the specific challenges of technologies addressed to mental health., This research has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 823907 (MENHIR project https://menhir-project.eu) and grant agreement No 769872 (EMPATHIC project http://www.empathic-project.eu).
Digibug. Repositorio Institucional de la Universidad de Granada
Publication Artículo científico (JournalArticle)

Incorporating evidence into mental health Q&A: a novel method to use generative language models for validated clinical content extraction

  • Kharitonova, Ksenia
  • Pérez Fernández, David
  • Gutiérrez Hernando, Javier
  • Gutiérrez Fandiño, Asier
  • Callejas Carrión, Zoraida|||0000-0001-8891-5237
  • Griol Barres, David
Generative language models have changed the way we interact with computers using natural language. With the release of increasingly advanced GPT models, systems are able to correctly respond to questions in various domains. However, they still have important limitations, such as hallucinations, lack of substance in answers, inability to justify responses, or showing high confidence with fabricated content. In digital mental health, every decision must be traceable and based on scientific evidence and these shortcomings are hindering the integration of LLMs into clinical practice. In this paper, we provide a novel automated method to develop evidencebased question answering systems. Powerful state-of-the-art generalist language models are used and forced to employ only contents in validated clinical guidelines, tracking the source of the evidence for each generated response. This way, the system is able to protect users from hallucinatory responses. As a proof of concept, we present the results obtained building question-answering systems circumscribed to the clinical practice guidelines of the Spanish National Health System about the management of depression and attention deficit hyperactivity disorder. The coherence, veracity, and evidence supporting the responses have been evaluated by human experts obtaining high reliability, clarity, completeness, and traceability of evidence results., ‘CONVERSA: Effective and efficient resources and models for transformative conversational AI in Spanish and co-official languages’ project with reference (Agencia Estatal de Investigación) TED2021- 132470B-I00, funded by MCIN/AEI/10.13039/501100011033 and by the European Union ‘NextGenerationEU/PRTR’, European Union’s Horizon 2020 research and innovation programme under grant agreement No 823907 (MENHIR, https://menhir-project.eu)
Digibug. Repositorio Institucional de la Universidad de Granada
Publication Artículo científico (JournalArticle)

Adaptive dialogue management using intent clustering and fuzzy rules

  • Griol Barres, David
  • Callejas Carrión, Zoraida|||0000-0001-8891-5237
  • Molina, José Manuel
  • Sanchis, Araceli
This is the peer reviewed version of the following article: Griol, D, Callejas, Z, Molina, JM, Sanchis, A. Adaptive dialogue management using intent clustering and fuzzy rules. Expert Systems. 2020; e12630. , which has been published in final form at https://doi.org/10.1111/exsy.12630. This article may be used for non-commercial purposes in accordance with Wiley Terms and Conditions for Use of Self-Archived Versions., Conversational systems have become an element of everyday life for billions of users who use speech-based interfaces to services, engage with personal digital assistants on smartphones, social media chatbots, or smart speakers. One of the most complex tasks in the development of these systems is to design the dialogue model, the logic that provided a user input selects the next answer. The dialogue model must also consider mechanisms to adapt the response of the system and the interaction style according to different groups and user profiles. Rule-based systems are difficult to adapt to phenomena that were not taken into consideration at design-time. However, many of the systems that are commercially available are based on rules, and so are the most widespread tools for the development of chatbots and speech interfaces. In this paper, we present a proposal to: i) automatically generate the dialogue rules from a dialogue corpus through the use of evolving algorithms, ii) adapt the rules according to the detected user intention. We have evaluated our proposal with several conversational systems of different application domains, from which our approach provided an efficient way for adapting a set of dialogue rules considering user utterance clusters., The research leading to these results has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 823907 (MENHIR project: https://menhir-project.eu), and the Spanish project TEC2017-88048-C2-2-R.
Digibug. Repositorio Institucional de la Universidad de Granada
Publication Contribución de congreso (ConferenceOutput)

Comparison of Learning Approaches to Dialogue Management in Conversational Systems

  • Griol Barres, David
  • Callejas Carrión, Zoraida|||0000-0001-8891-5237
Dialogue systems have an increasingly higher number of applications and so their development is raising interest both in academic and industrial setting. Dialogue management is a key aspect for the development of these systems, as it is in charge of the decision making processes and the identification of the most appropriate responses to the user inputs. In this paper we compare different statistical techniques to train dialogue managers using generally available corpora at the disposal for the scientific community. Our results show that the use of generative models and in particular an intent classifier with Neural Networks and Seq2Seq using GRU cells attain the best accuracy for dialogue management.
Digibug. Repositorio Institucional de la Universidad de Granada
Publication Capítulo o parte de un libro (BookPart)

A Proposal for Data Collection and Process Automatization for Ubiquitous Engagement with Mental Health Organizations

  • Pablos-Sarabia, Rafael
  • Griol Barres, David
  • Callejas Carrión, Zoraida|||0000-0001-8891-5237
Mental health is one of the most significant public health challenges. In recent years, several motivational applications have been proposed to help users maintain good mental health. However, many times these applications focus on uplifting messages or general resources that are not tailored to the specific needs of their users. In contrast, non-profit organizations implement effective methods to support people based on their real needs and set concrete attainable objectives. Unfortunately, these organizations tend to be saturated by the number of clients and the lack of automatization in their processes. In this paper, we present a proposal to improve mental health organizations’ data collection and decision processes through a web application, allowing workers to store, access, and modify client data more efficiently. The computerized model is exploited by an intelligent conversational assistant to provide around-the-clock personalized and ubiquitous interaction with clients to encourage engagement with the organization., The research leading to these results has received funding from the European Union’s Horizon 2020 research and innovation program under grant agreement no. 823907 (MENHIR project: https://menhir-project.eu) and the GOMINOLA project supported by the Spanish Ministry of Science and Innovation (PID2020-118112RB-C21 and PID2020-118112RB-C22, funded by MCIN/AEI/10.13039/501100011033).
Digibug. Repositorio Institucional de la Universidad de Granada
Publication Artículo científico (JournalArticle)

A Proposal for Multimodal Emotion Recognition Using Aural Transformers and Action Units on RAVDESS Dataset

  • Luna Jiménez, Cristina
  • Griol Barres, David
  • Callejas Carrión, Zoraida|||0000-0001-8891-5237
The work leading to these results was supported by the Spanish Ministry of Science and Innovation through the projects GOMINOLA (PID2020-118112RB-C21 and PID2020-118112RB-C22, funded by MCIN/AEI/10.13039/501100011033), CAVIAR (TEC2017-84593-C2-1-R, funded by MCIN/AEI/10.13039/501100011033/FEDER "Una manera de hacer Europa"), and AMIC-PoC (PDC2021-120846-C42, funded by MCIN/AEI/10.13039/501100011033 and by "the European Union "NextGenerationEU/PRTR"). This research also received funding from the European Union's Horizon2020 research and innovation program under grant agreement No 823907 (http://menhir-project.eu, accessed on 17 November 2021). Furthermore, R.K.'s research was supported by the Spanish Ministry of Education (FPI grant PRE2018-083225)., Emotion recognition is attracting the attention of the research community due to its multiple applications in different fields, such as medicine or autonomous driving. In this paper, we proposed an automatic emotion recognizer system that consisted of a speech emotion recognizer (SER) and a facial emotion recognizer (FER). For the SER, we evaluated a pre-trained xlsr-Wav2Vec2.0 transformer using two transfer-learning techniques: embedding extraction and fine-tuning. The best accuracy results were achieved when we fine-tuned the whole model by appending a multilayer perceptron on top of it, confirming that the training was more robust when it did not start from scratch and the previous knowledge of the network was similar to the task to adapt. Regarding the facial emotion recognizer, we extracted the Action Units of the videos and compared the performance between employing static models against sequential models. Results showed that sequential models beat static models by a narrow difference. Error analysis reported that the visual systems could improve with a detector of high-emotional load frames, which opened a new line of research to discover new ways to learn from videos. Finally, combining these two modalities with a late fusion strategy, we achieved 86.70% accuracy on the RAVDESS dataset on a subject-wise 5-CV evaluation, classifying eight emotions. Results demonstrated that these modalities carried relevant information to detect users’ emotional state and their combination allowed to improve the final system performance., Spanish Government PID2020-118112RB-C21 PID2020-118112RB-C22 MCIN/AEI/10.13039/501100011033 TEC2017-84593-C2-1-R MCIN/AEI/10.13039/501100011033/FEDER PDC2021-120846-C42, European Union "NextGenerationEU/PRTR"), European Union's Horizon2020 research and innovation program 823907, German Research Foundation (DFG) PRE2018-083225
Digibug. Repositorio Institucional de la Universidad de Granada
Publication Artículo científico (JournalArticle)

A Synthetic Voice for an Assistive Conversational Agent: A Survey to Discover Italian Preferences regarding Synthetic Voice’s Gender and Quality Level

  • Cuciniello, Marialucia
  • Amorese, Terry
  • Greco, Claudia
  • Callejas Carrión, Zoraida|||0000-0001-8891-5237
  • Vogel, Carl
  • Cordasco, Gennaro
  • Esposito, Anna
Based on a previous investigation, a quantitative study aimed to identify user’ preferences towards four synthetic voices of two different quality levels (classified through the sophistication of the synthesizer: low vs. high) is proposed. The voices administered to participants were developed considering two main aspects: the voice quality (high/low) and their gender (male/female). 182 unpaid participants were recruited for the study, divided in four groups according to their age, and therefore classified as adolescents, young adults, middle-aged, and seniors. To collect data regarding each voice, randomly audited by participants, the shortened version of the Virtual Agent Voice Acceptance Questionnaire (VAVAQ) was exploited. Outcomes of the previous study revealed that the voices of high quality, regardless of their gender, received a higher acclaim by all participants examined rather than the corresponding two voices assessed as lower quality. Conversely, findings of the current study suggest that the four new groups of participants involved agreed in showing their strong preference towards the high-quality voice gendered as female compared to all the other considered voices. Regarding the two voices gendered as male, the high-quality one was considered as more original and capable to arouse positive emotional states than the low-quality one. Moreover, the high-quality male voice was judged as more natural than the female low-quality one. Results provide some insights for future directions in the user experience and design field., European Union Horizon 2020 research and innovation programme under grant agreement N.769872 (EMPATHIC) and N. 823907 (MENHIR), Project SIROBOTICS that received funding from Ministero dell’Istruzione, dell ‘Università, e della Ricerca (MIUR), PNR 2015-2020, D.D. 1735/2017, Project ANDROIDS that received funding from Università della Campania “Luigi Vanvitelli” inside the programme V:ALERE 2019, funded with D.R. 906/2019, Project SALICE that received funding from Università della Campania “Luigi Vanvitelli” inside the programme Giovani Ricercatori (DR 509/2022), funded with DR 834/2022
Addi. Archivo Digital para la Docencia y la Investigación
Publication Contribución de congreso (ConferenceOutput)

Multimodal feature evaluation and fusion for emotional well-being monitorization

  • Zubiaga Amar, Irune
  • Justo Blanco, Raquel
Mental health is a global issue that plays an important roll in the overall well-being of a person. Because of this, it is important to preserve it, and conversational systems have proven to be helpful in this task. This research is framed in the MENHIR project, which aims at developing a conversational system for emotional well-being monitorization. As a first step for achieving this purpose, the goal of this paper is to select the features that can be helpful for training a model that aims to detect if a patient suffers from a mental illness. For that, we will use transcriptions extracted from conversational information gathered from people with different mental health conditions to create a data set. After the feature selection, the constructed data set will be fed to supervised learning algorithms and their performance will be evaluated. Concretely we will work with random forests, neural networks and BERT., This work was partially funded by the European Commission, grant number 823907 and the Spanish Ministry of Science under grant TIN2017-85854-C4-3- R.
Addi. Archivo Digital para la Docencia y la Investigación
Publication Contribución de congreso (ConferenceOutput)

Mental Health Monitoring from Speech and Language

  • Zubiaga Amar, Irune
  • Justo Blanco, Raquel
  • Menchaca, Ignacio
  • De Velasco Vázquez, Mikel
Concern for mental health has increased in the last years due to its impact in people life quality and its consequential effect on healthcare systems. Automatic systems that can help in the diagnosis, symptom monitoring, alarm generation etc. are an emerging technology that has provided several challenges to the scientific community. The goal of this work is to design a system capable of distinguishing between healthy and depressed and/or anxious subjects, in a realistic environment, using their speech. The system is based on efficient representations of acoustic signals and text representations extracted within the self-supervised paradigm. Considering the good results achieved by using acoustic signals, another set of experiments was carried out in order to detect the specific illness. An analysis of the emotional information and its impact in the presented task is also tackled as an additional contribution., This work was partially funded by the European Commission, grant number 823907 and the Spanish Ministry of Science under grant TIN2017-85854-C4-3-R.
Addi. Archivo Digital para la Docencia y la Investigación
Publication Artículo científico (JournalArticle)

Analysis of Deep Learning-Based Decision-Making in an Emotional Spontaneous Speech Task

  • De Velasco Vázquez, Mikel
  • Justo Blanco, Raquel
  • López Zorrilla, Asier
  • Torres Barañano, María Inés
In this work, we present an approach to understand the computational methods and decision-making involved in the identification of emotions in spontaneous speech. The selected task consists of Spanish TV debates, which entail a high level of complexity as well as additional subjectivity in the human perception-based annotation procedure. A simple convolutional neural model is proposed, and its behaviour is analysed to explain its decision-making. The proposed model slightly outperforms commonly used CNN architectures such as VGG16, while being much lighter. Internal layer-by-layer transformations of the input spectrogram are visualised and analysed. Finally, a class model visualisation is proposed as a simple interpretation approach whose usefulness is assessed in the work., The research presented in this paper was conducted as part of the AMIC, AMIC-PdC, BEWORD and MENHIR projects, which received funding from the Spanish Minister of Science under grants TIN2017-85854-C4-3-R, PDC2021-120846-C43 and PID2021-126061OB-C42 and from the European Union’s H2020-MSCA-RISE-2018 Research and Innovation Staff Exchange, under Grant No. 823907. The first author also received a PhD scholarship from the University of the Basque Country UPV/EHU, PIF17/310.
Addi. Archivo Digital para la Docencia y la Investigación
Publication Contribución de congreso (ConferenceOutput)

Speech emotion recognition in Spanish TV Debates

  • Zubiaga Amar, Irune
  • Justo Blanco, Raquel
  • De Velasco Vázquez, Mikel
  • Torres Barañano, María Inés
Emotion recognition from speech is an active field of study that can help build more natural human-machine interaction systems. Even though the advancement of deep learning technology has brought improvements in this task, it is still a very challenging field. For instance, when considering real life scenarios, things such as tendency toward neutrality or the ambiguous definition of emotion can make labeling a difficult task causing the data-set to be severally imbalanced and not very representative. In this work we considered a real life scenario to carry out a series of emotion classification experiments. Specifically, we worked with a labeled corpus consisting of a set of audios from Spanish TV debates and their respective transcriptions. First, an analysis of the emotional information within the corpus was conducted. Then different data representations were analyzed as to choose the best one for our task; Spectrograms and UniSpeech-SAT were used for audio representation and DistilBERT for text representation. As a final step, Multimodal Machine Learning was used with the aim of improving the obtained classification results by combining acoustic and textual information., The research presented in this paper was conducted as part of the AMIC PdC project, which received funding from the Spanish Ministry of Science under grants TIN2017-85854-C4- 3-R, PID2021-126061OB-C42 and PDC2021-120846-C43 and it was also partially funded by the European Union’s Horizon 2020 research and innovation program under grant agreement No. 823907 (MENHIR).
Addi. Archivo Digital para la Docencia y la Investigación
Publication Artículo científico (JournalArticle)

Perceptual borderline for balancing multi-class spontaneous emotional data

  • Ben Letaifa Zouari, Leila
  • Torres Barañano, María Inés
Speech is a behavioural biometric signal that can provide important information to understand the human intends as well as their emotional status. The paper is centered on the speech-based identification of the seniors’s emotional status during their interaction with a virtual agent playing the role of a health professional coach. Under real conditions, we can just identify a small set of task-dependent spontaneous emotions. The number of identified samples is largely different for each emotion, which results in an imbalanced dataset problem. This research proposes the dimensional model of emotions as a perceptual representation space alternative to the generally used acoustic one. The main contribution of the paper is the definition of a perceptual borderline for the oversampling of minority emotion classes in this space. This limit, based on arousal and valence criteria, leads to two methods of balancing the data: the Perceptual Borderline oversampling and the Perceptual Borderline SMOTE (Synthetic Minority Oversampling Technique). Both methods are implemented and compared to state-of-the-art approaches of Random oversampling and SMOTE. The experimental evaluation was carried out on three imbalanced datasets of spontaneous emotions acquired in human-machine scenarios in three different cultures: Spain, France and Norway. The emotion recognition results obtained by neural networks classifiers show that the proposed perceptual oversampling methods led to significant improvements when compared with the state-of-the art, for all scenarios and languages., The research presented in this paper is conducted as partof the project EMPATHIC and of the MENHIR MSCAaction that have received funding from the European Union’s Horizon 2020 research and innovation program under grant agreements No 769872 an No 823907 respectivel
RUA. Repositorio Institucional de la Universidad de Alicante
Publication Otros (Other)

MENHIR: Mental health monitoring through interactive conversations, MENHIR: Monitorización de la salud mental mediante conversaciones interactivas

  • Callejas Carrión, Zoraida
  • Benghazi, Kawtar
  • Noguera, Manuel
  • Torres Barañano, María Inés
  • Justo Blanco, Raquel
Mental health is an essential component of health; however depression and anxiety are common disorders across the European Union. Many people may be described as “living with” a mental illness, and managing their own symptoms. However, they are often unsure of the thresholds for treatment, how to control their mental health, what are the best coping strategies or which resources are available to them. Conversational systems may facilitate watchful waiting and symptom monitoring, by initiating contact and symptom checking at various times of the day and night. The MENHIR project aims to research and develop conversational technologies to promote mental health and assist people with mental ill health (depression and anxiety) to manage their conditions. The participants will exchange and share their expertise toward this common objective, building a network for exchanging ideas and knowledge between Spain, Germany, Italy and United Kingdom, including academic, non-profit organisations and companies.
Archivo Digital UPM
Publication Artículo científico (JournalArticle)

Multimodal Emotion Recognition on RAVDESS Dataset Using Transfer Learning

  • Luna Jiménez, Cristina|||0000-0001-5369-856X
  • Griol, David|||0000-0001-6266-5321
  • Callejas Carrión, Zoraida|||0000-0001-8891-5237
  • Kleinlein, Ricardo|||0000-0002-7313-7601
  • Montero Martínez, Juan Manuel|||0000-0002-7908-5400
  • Fernández Martí­nez, Fernando|||0000-0003-3877-0089
Archivo Digital UPM
Publication Artículo científico (JournalArticle)

A Proposal for Multimodal Emotion Recognition Using Aural Transformers and Action Units on RAVDESS Dataset

  • Luna Jiménez, Cristina|||0000-0001-5369-856X
  • Kleinlein, Ricardo|||0000-0002-7313-7601
  • Griol, David|||0000-0001-6266-5321
  • Callejas Carrión, Zoraida|||0000-0001-8891-5237
  • Montero Martínez, Juan Manuel|||0000-0002-7908-5400
  • Fernández Martínez, Fernando|||0000-0003-3877-0089