Mind the Heart: Designing a Stress Dashboard based on Physiological Data for training Highly Stressful Situations in Virtual Reality

Olivia Zechner; Helmut Georg Schrom-Feiertag; Jakob Carl Uhl; Huu Quynh Huong Nguyen; Lisanne Kleygrewe; Manfred Tscheligi

doi:10.1007/978-3-031-42293-5_16

Mind the Heart: Designing a Stress Dashboard based on Physiological Data for training Highly Stressful Situations in Virtual Reality

Olivia Zechner, Helmut Georg Schrom-Feiertag, Jakob Carl Uhl, Huu Quynh Huong Nguyen, Lisanne Kleygrewe, Manfred Tscheligi

Publikation: Beitrag in Buch oder Tagungsband › Vortrag mit Beitrag in Tagungsband › Begutachtung

Abstract

Virtual Reality is becoming increasingly popular to serve as training ground for challenging environments, which often involve making decisions in cognitive demanding and stressful situations. It has become common practice to analyze bio-signals to determine our current physiological status and fitness. However, we continue to rely on subjective feedback obtained through self-rated questionnaires, when it comes to assessing cognitive states. In this paper we describe the user-centered design process of building a stress dashboard prototype and testing it in a field trial to fully understand its potential.We report on mixed-method studies exploring the interplay between the trainer and the VR system. Our findings demonstrate that integrating a stress dashboard, based on
objective bio-signal data, can enhance the VR training process, providing
trainers with actionable insights that have the potential to shape trainee behavior and learning outcomes.

Originalsprache	Englisch
Titel	Human-Computer Interaction - INTERACT 2023
Untertitel	19th IFIP TC13 International Conference, York, UK, August 28 – September 1, 2023, Proceedings, Part IV
Seiten	209-230
Band	14145
ISBN (elektronisch)	978-3-031-42293-5
DOIs	https://doi.org/10.1007/978-3-031-42293-5_16
Publikationsstatus	Veröffentlicht - 26 Aug. 2023
Veranstaltung	19th International Conference of Technical Committee 13 (Human- Computer Interaction) - Ron Cooke Hub University of York, York, Großbritannien/Vereinigtes Königreich Dauer: 28 Aug. 2023 → 1 Sept. 2023 https://interact2023.org/

Publikationsreihe

Name	Lecture Notes in Computer Science
Herausgeber (Verlag)	Springer

Konferenz

Konferenz	19th International Conference of Technical Committee 13 (Human- Computer Interaction)
Kurztitel	INTERACT 2023
Land/Gebiet	Großbritannien/Vereinigtes Königreich
Stadt	York
Zeitraum	28/08/23 → 1/09/23
Internetadresse	https://interact2023.org/

Research Field

Experience Business Transformation

Zugriff auf Dokument

10.1007/978-3-031-42293-5_16

Diese Publikation zitieren

Zechner, O., Schrom-Feiertag, H. G., Uhl, J. C., Nguyen, H. Q. H., Kleygrewe, L., & Tscheligi, M. (2023). Mind the Heart: Designing a Stress Dashboard based on Physiological Data for training Highly Stressful Situations in Virtual Reality. in Human-Computer Interaction - INTERACT 2023: 19th IFIP TC13 International Conference, York, UK, August 28 – September 1, 2023, Proceedings, Part IV (Band 14145, S. 209-230). (Lecture Notes in Computer Science). https://doi.org/10.1007/978-3-031-42293-5_16

Zechner, Olivia ; Schrom-Feiertag, Helmut Georg ; Uhl, Jakob Carl et al. / Mind the Heart: Designing a Stress Dashboard based on Physiological Data for training Highly Stressful Situations in Virtual Reality. Human-Computer Interaction - INTERACT 2023: 19th IFIP TC13 International Conference, York, UK, August 28 – September 1, 2023, Proceedings, Part IV. Band 14145 2023. S. 209-230 (Lecture Notes in Computer Science).

@inproceedings{63a82639d2ed46efb6667657fd27bb5c,

title = "Mind the Heart: Designing a Stress Dashboard based on Physiological Data for training Highly Stressful Situations in Virtual Reality",

abstract = "Virtual Reality is becoming increasingly popular to serve as training ground for challenging environments, which often involve making decisions in cognitive demanding and stressful situations. It has become common practice to analyze bio-signals to determine our current physiological status and fitness. However, we continue to rely on subjective feedback obtained through self-rated questionnaires, when it comes to assessing cognitive states. In this paper we describe the user-centered design process of building a stress dashboard prototype and testing it in a field trial to fully understand its potential.We report on mixed-method studies exploring the interplay between the trainer and the VR system. Our findings demonstrate that integrating a stress dashboard, based onobjective bio-signal data, can enhance the VR training process, providingtrainers with actionable insights that have the potential to shape trainee behavior and learning outcomes.",

keywords = "Virtual Reality (VR), Immersive technologies, Contextual experience, training experience, Biofeedback, stress, police training, Challenging Environments",

author = "Olivia Zechner and Schrom-Feiertag, {Helmut Georg} and Uhl, {Jakob Carl} and Nguyen, {Huu Quynh Huong} and Lisanne Kleygrewe and Manfred Tscheligi",

note = "Q3/2023; 19th International Conference of Technical Committee 13 (Human- Computer Interaction) (INTERACT 2023), INTERACT 2023 ; Conference date: 28-08-2023 Through 01-09-2023",

year = "2023",

month = aug,

day = "26",

doi = "10.1007/978-3-031-42293-5_16",

language = "English",

isbn = "978-3-031-42292-8",

volume = "14145",

series = "Lecture Notes in Computer Science",

publisher = "Springer",

pages = "209--230",

booktitle = "Human-Computer Interaction - INTERACT 2023",

url = "https://interact2023.org/",

}

Zechner, O, Schrom-Feiertag, HG , Uhl, JC , Nguyen, HQH, Kleygrewe, L & Tscheligi, M 2023, Mind the Heart: Designing a Stress Dashboard based on Physiological Data for training Highly Stressful Situations in Virtual Reality. in Human-Computer Interaction - INTERACT 2023: 19th IFIP TC13 International Conference, York, UK, August 28 – September 1, 2023, Proceedings, Part IV. Bd. 14145, Lecture Notes in Computer Science, S. 209-230, 19th International Conference of Technical Committee 13 (Human- Computer Interaction), York, Großbritannien/Vereinigtes Königreich, 28/08/23. https://doi.org/10.1007/978-3-031-42293-5_16

Mind the Heart: Designing a Stress Dashboard based on Physiological Data for training Highly Stressful Situations in Virtual Reality. / Zechner, Olivia; Schrom-Feiertag, Helmut Georg ; Uhl, Jakob Carl et al.
Human-Computer Interaction - INTERACT 2023: 19th IFIP TC13 International Conference, York, UK, August 28 – September 1, 2023, Proceedings, Part IV. Band 14145 2023. S. 209-230 (Lecture Notes in Computer Science).

Publikation: Beitrag in Buch oder Tagungsband › Vortrag mit Beitrag in Tagungsband › Begutachtung

TY - GEN

T1 - Mind the Heart: Designing a Stress Dashboard based on Physiological Data for training Highly Stressful Situations in Virtual Reality

AU - Zechner, Olivia

AU - Schrom-Feiertag, Helmut Georg

AU - Uhl, Jakob Carl

AU - Nguyen, Huu Quynh Huong

AU - Kleygrewe, Lisanne

AU - Tscheligi, Manfred

N1 - Q3/2023

PY - 2023/8/26

Y1 - 2023/8/26

N2 - Virtual Reality is becoming increasingly popular to serve as training ground for challenging environments, which often involve making decisions in cognitive demanding and stressful situations. It has become common practice to analyze bio-signals to determine our current physiological status and fitness. However, we continue to rely on subjective feedback obtained through self-rated questionnaires, when it comes to assessing cognitive states. In this paper we describe the user-centered design process of building a stress dashboard prototype and testing it in a field trial to fully understand its potential.We report on mixed-method studies exploring the interplay between the trainer and the VR system. Our findings demonstrate that integrating a stress dashboard, based onobjective bio-signal data, can enhance the VR training process, providingtrainers with actionable insights that have the potential to shape trainee behavior and learning outcomes.

AB - Virtual Reality is becoming increasingly popular to serve as training ground for challenging environments, which often involve making decisions in cognitive demanding and stressful situations. It has become common practice to analyze bio-signals to determine our current physiological status and fitness. However, we continue to rely on subjective feedback obtained through self-rated questionnaires, when it comes to assessing cognitive states. In this paper we describe the user-centered design process of building a stress dashboard prototype and testing it in a field trial to fully understand its potential.We report on mixed-method studies exploring the interplay between the trainer and the VR system. Our findings demonstrate that integrating a stress dashboard, based onobjective bio-signal data, can enhance the VR training process, providingtrainers with actionable insights that have the potential to shape trainee behavior and learning outcomes.

KW - Virtual Reality (VR)

KW - Immersive technologies

KW - Contextual experience

KW - training experience

KW - Biofeedback

KW - stress

KW - police training

KW - Challenging Environments

U2 - 10.1007/978-3-031-42293-5_16

DO - 10.1007/978-3-031-42293-5_16

M3 - Conference Proceedings with Oral Presentation

SN - 978-3-031-42292-8

VL - 14145

T3 - Lecture Notes in Computer Science

SP - 209

EP - 230

BT - Human-Computer Interaction - INTERACT 2023

T2 - 19th International Conference of Technical Committee 13 (Human- Computer Interaction) (INTERACT 2023)

Y2 - 28 August 2023 through 1 September 2023

ER -

Zechner O, Schrom-Feiertag HG , Uhl JC , Nguyen HQH, Kleygrewe L, Tscheligi M. Mind the Heart: Designing a Stress Dashboard based on Physiological Data for training Highly Stressful Situations in Virtual Reality. in Human-Computer Interaction - INTERACT 2023: 19th IFIP TC13 International Conference, York, UK, August 28 – September 1, 2023, Proceedings, Part IV. Band 14145. 2023. S. 209-230. (Lecture Notes in Computer Science). doi: 10.1007/978-3-031-42293-5_16

Mind the Heart: Designing a Stress Dashboard based on Physiological Data for training Highly Stressful Situations in Virtual Reality

Abstract

Publikationsreihe

Konferenz

Research Field

Zugriff auf Dokument

Fingerprint

Diese Publikation zitieren