| Title: |
Modeling and real-time feedback of collaboration in virtual reality using multimodal signals |
| Authors: |
Léchappé, Aurélien; Fleury, Cédric; Chollet, Mathieu; Dumas, Cédric |
| Contributors: |
Département Automatique, Productique et Informatique (IMT Atlantique - DAPI); IMT Atlantique (IMT Atlantique); Institut Mines-Télécom Paris (IMT)-Institut Mines-Télécom Paris (IMT); Perception, Action, Cognition pour la Conception et l’Ergonomie (LS2N - équipe PACCE); Laboratoire des Sciences du Numérique de Nantes (LS2N); Institut National de Recherche en Informatique et en Automatique (Inria)-Centre National de la Recherche Scientifique (CNRS)-IMT Atlantique (IMT Atlantique); Institut Mines-Télécom Paris (IMT)-Institut Mines-Télécom Paris (IMT)-NANTES UNIVERSITÉ - École Centrale de Nantes (Nantes Univ - ECN); Nantes Université (Nantes Univ)-Nantes Université (Nantes Univ)-Nantes université - UFR des Sciences et des Techniques (Nantes univ - UFR ST); Nantes Université - pôle Sciences et technologie; Nantes Université (Nantes Univ)-Nantes Université (Nantes Univ)-Nantes Université - pôle Sciences et technologie; Nantes Université (Nantes Univ)-Institut National de Recherche en Informatique et en Automatique (Inria)-Centre National de la Recherche Scientifique (CNRS)-IMT Atlantique (IMT Atlantique); Nantes Université (Nantes Univ); Equipe Immersive Natural User Interaction team (Lab-STICC_INUIT); Laboratoire des sciences et techniques de l'information, de la communication et de la connaissance (Lab-STICC); École Nationale d'Ingénieurs de Brest (ENIB); Université de Brest (UBO EPE)-Institut National Polytechnique de Bretagne (Bretagne INP)-Université de Brest (UBO EPE)-Institut National Polytechnique de Bretagne (Bretagne INP)-Université de Bretagne Sud (UBS)-École Nationale Supérieure de Techniques Avancées Bretagne (ENSTA Bretagne)-Institut Mines-Télécom Paris (IMT)-Centre National de la Recherche Scientifique (CNRS)-Université Bretagne Loire (UBL)-IMT Atlantique (IMT Atlantique); Institut Mines-Télécom Paris (IMT)-École Nationale d'Ingénieurs de Brest (ENIB); Institut Mines-Télécom Paris (IMT); Département Informatique (IMT Atlantique - INFO); University of Glasgow; Swansea University |
| Source: |
Workshop Cognitive Ergonomics meets data analytics (ECCE 2023) ; https://hal.science/hal-04494775 ; Workshop Cognitive Ergonomics meets data analytics (ECCE 2023), Swansea University, Sep 2023, Swansea, United Kingdom |
| Publisher Information: |
CCSD |
| Publication Year: |
2023 |
| Collection: |
Université de Nantes: HAL-UNIV-NANTES |
| Subject Terms: |
Multimodal signals; Collaboration cues; Virtual reality; Collaboration; [INFO]Computer Science [cs]; [SCCO.PSYC]Cognitive science/Psychology |
| Subject Geographic: |
Swansea; United Kingdom |
| Description: |
Position paper presented at the Workshop "Analysing the quality of collaboration: cognitive ergonomics meets data analytics" at ECCE 2023 ; International audience ; Issues in surgery can be related to collaboration problems such as miscommunication and misunderstanding. Analysis of these collaborative situations can be done by experts, but it is a long and complex process. Moreover, this approach does not allow for real-time analysis and feedback on the collaboration. Some recent approaches aim to assess and model the quality of collaboration using measures that can be computed in real-time (e.g., non-verbal, gaze, physiological data). Considering some of the challenges related to the evaluation and modeling of collaboration, we are working on a tool that aims to compute metrics in real-time to report on the quality of collaboration within a group. This would allow us to act before a critical situation emerges. We first apply this tool to a collaboration situation in a virtual environment to test their effectiveness and their effects on the situation before applying them in a real situation as surgery. |
| Document Type: |
conference object |
| Language: |
English |
| Availability: |
https://hal.science/hal-04494775; https://hal.science/hal-04494775v1/document; https://hal.science/hal-04494775v1/file/Lechappe2023.pdf |
| Rights: |
http://creativecommons.org/licenses/by/ ; info:eu-repo/semantics/OpenAccess |
| Accession Number: |
edsbas.8F239CDE |
| Database: |
BASE |