Can You Feel What I Feel? Leveraging aesthetics in visual and spatial audio VR experience

scite shows how a scientific paper has been cited by providing the context of the citation, a classification describing whether it supports, mentions, or contrasts the cited claim, and a label indicating in which section the citation was made.

Header Abstract Content Author and article information REFERENCES Comments

Record: found
Abstract: found
Conference Proceedings: found

Is Open Access

Can You Feel What I Feel? Leveraging aesthetics in visual and spatial audio VR experience

Published

proceedings-article

Author(s): Rochele Gloor , Greg Corness , Rose Marshack , Aaron Paolucci

Publication date (Print): July 2023

Conference name: Proceedings of EVA London 2023 (EVA 2023)

Conference theme: Since 1990, the EVA London Conference has established itself as one of the United Kingdom’s most innovative and interdisciplinary conferences in the field of digital visualisation. The papers and abstracts in this volume cover areas such as the arts, culture, heritage, museums, music, performance, visual art, and visualisation, as well as related interdisciplinary areas, in combination with technology. The latest research and work by early career researchers, established scholars, practitioners, research students, and visual artists, can be found in this volume, published in full colour.

Conference date: 10–14 July 2023

Keywords: Aesthetics experience, Virtual reality, Empathy, Spatialised audio

Bookmark

Abstract

Content

Author and article information

Contributors

Rochele Gloor

Greg Corness

Rose Marshack

Aaron Paolucci

Conference

Publication date: July 2023

Publication date (Print): July 2023

Pages: 126-133

Affiliations

[0001]Illinois State University

919 N Lee St, Bloomington, IL 61701

USA

[0002]Illinois State University

100 N University St, Normal, IL 61761 USA

Article

DOI: 10.14236/ewic/EVA2023.21

SO-VID: 1a0d4f9a-d111-4da0-9443-78fd0b20a845

License:

This work is licensed under a Creative Commons Attribution 4.0 Unported License. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/

Conference name: Proceedings of EVA London 2023

Conference acronym: EVA 2023

Conference number:

Conference location: London

Conference date: 10–14 July 2023

Conference sponsor: Electronic Workshops in Computing (eWiC)

History

Product

1477-9358 BCS Learning & Development

Self URI (article page): https://www.scienceopen.com/hosted-document?doi=10.14236/ewic/EVA2023.21

Self URI (journal page): https://ewic.bcs.org/

REFERENCES

Ala, T. S. et al. (2018) “Cumulative effects of theta binaural beats on brain power and functional connectivity.” Biomedical Signal Process and Control. volume 42, pp 242-252.
Baakek, Y. N. E. H., & Debbal, S. M. E. A. (2021). Digital drugs (binaural beats): how can it affect the brain/their impact on the brain. Journal of Medical Engineering & Technology, 45(7), 546–551. https://doi.org/10.1080/03091902.2021.1936236
Barratt, M. J., Maddox, A., Smith, N., Davis, J. L., Goold, L., Winstock, A. R., & Ferris, J. A. (2022). Who uses digital drugs? An international survey of ‘binaural beat’ consumers. Drug and Alcohol Review, 41(5), 1126–1130. https://doi.org/10.1111/dar.13464
Best, P. (2021). Freely Available Virtual Reality Experiences as Tools to Support Mental Health Therapy: A Systematic Scoping Review and Consensus Based Interdisciplinary Analysis. https://link.springer.com/article/10.1007/s41347-021-00214-6#article-info
Davies, Char and John Harrison (1996) “Osmose: towards broadening the aesthetics of virtual reality.” ACM SIGGRAPH, Computer Graphics. vol. 30, Issue 4, Nov. 1996, pp 25–28.
Depraz, Nathalie, et al. On Becoming Aware: A Pragmatics of Experiencing. John Benjamins Publishing Company, 2003, https://doi.org/10.1075/aicr.43.
Desnoyers-Stewart, J., Stepanova, E. R., Pasquier, P., & Riecke, B. E. (2019). JeL: Connecting Through Breath in Virtual Reality. Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems, 1–6. https://doi.org/10.1145/3290607.3312845
Diodato, R. (2022). Virtual Reality and Aesthetic Experience. Philosophies, 7(2), 29. https://doi.org/10.3390/philosophies7020029
Edensor, T. (2015). Light Art, Perception, and Sensation. The Senses and Society, 10(2), 138–157. https://doi.org/10.1080/17458927.2015.1042228
Fielke, G. (2016). Subliminal Massage – James Turrell: A Retrospective. Electronic Melbourne Art Journal, 9. https://doi.org/10.38030/emaj.2016.9.6
Fleischmann, Monika and Wolfgang Strauss (1989- 1991). “Home of the Brain”. 14-10-2019, in: Archive of Digital Art. https://digitalartarchive.at/database/general/work/home-of-the-brain.html
Fodor, L. A., Coteț, C. D., Cuijpers, P., Szamoskozi, Ștefan, David, D., & Cristea, I. A. (2018). The effectiveness of virtual reality-based interventions for symptoms of anxiety and depression: A meta-analysis. Scientific Reports, 8(1), 10323. https://doi.org/10.1038/s41598-018-28113-6
Glowacki, David R., et al. “Isness: Using Multi-Person VR to Design Peak Mystical Type Experiences Comparable to Psychedelics.” Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, ACM, 2020, pp.1–14, https://doi.org/10.1145/3313831.3376649
Gromala, Diane, Xin Tong, et al. “Mobius Floe: An Immersive Virtual Reality Game for Pain Distraction.” Electronic Imaging, vol. 28, no. 4, Feb. 2016, pp. 1–5
Gromala, D., Song, M., Yim, J.-D., Fox, T., Barnes, S. J., Nazemi, M., Shaw, C., & Squire, P. (2011). Immersive VR: a non-pharmacological analgesic for chronic pain? CHI ’11 Extended Abstracts on Human Factors in Computing Systems, 1171–1176. https://doi.org/10.1145/1979742.1979704
Harrison, N. R., & Clark, D. P. A. (2016). The Observing Facet of Trait Mindfulness Predicts Frequency of Aesthetic Experiences Evoked by the Arts. Mindfulness, 7(4), 971–978. https://doi.org/10.1007/s12671-016-0536-6
Hong, J. Y., Lam, B., Ong, Z.-T., Ooi, K., Gan, W.-S., Kang, J., Feng, J., & Tan, S.-T. (2019). Quality assessment of acoustic environment reproduction methods for cinematic virtual reality in soundscape applications. Building and Environment, 149, 1–14. https://doi.org/10.1016/j.buildenv.2018.12.004
Hyodo, Y., Sugai, C., Suzuki, J., Takahashi, M., Koizumi, M., Tomura, A., Mitsufuji, Y., & Komoriya, Y. (2021). Psychophysiological Effect of Immersive Spatial Audio Experience Enhanced Using Sound Field Synthesis. 2021 9th International Conference on Affective Computing and Intelligent Interaction (ACII), 1–8. https://doi.org/10.1109/ACII52823.2021.9597435
Jirakittayakorn, N., & Wongsawat, Y. (2017) Brain Responses to a 6-Hz Binaural Beat: Effects on General Theta Rhythm and Frontal Midline Theta Activity. Frontiers in Neuroscience, 11, 365. https://doi.org/10.3389/fnins.2017.00365
Jung, Sungchul, and Robert. W. Lindeman (2021) “Perspective: Does Realism Improve Presence in VR? Suggesting a Model and Metric for VR Experience Evaluation.” Frontiers in Virtual Reality, vol. 2, p. 693327, https://doi.org/10.3389/frvir.2021.693327.
Lanier, J. (2017). Dawn of the new everything: encounters with reality and virtual reality (First edition). Henry Holt and Company.
Lindner, P. (2021). Better, Virtually: the Past, Present, and Future of Virtual Reality Cognitive
Behavior Therapy. International Journal of Cognitive Therapy, 14(1), 23–46. https://doi.org/10.1007/s41811-020-00090-7
Lindquist, M., Maxim, B., Proctor, J., & Dolins, F. (2020). The effect of audio fidelity and virtual reality on the perception of virtual greenspace. Landscape and Urban Planning, 202, 103884. https://doi.org/10.1016/j.landurbplan.2020.103884
Mastandrea, Stefano, et al. (2019) “Art and Psychological Well-Being: Linking the Brain to the Aesthetic Emotion.” Frontiers in Psychology, vol. 10, p. 739
Metzinger, Thomas K. (2018) “Why Is Virtual Reality Interesting for Philosophers?” Frontiers in Robotics and AI, vol. 5, Sept. 2018.
Merleau-Ponty, M., Smith, C., & Merleau-Ponty, M. (1996). Phenomenology of perception (1. Indian ed). Motilal Banarsidass Publ.
Naz, A., Kopper, R., McMahan, R. P., & Nadin, M. (2017). Emotional qualities of VR space. 2017 IEEE Virtual Reality (VR), 3–11. https://doi.org/10.1109/VR.2017.7892225
Nyamtiga, Baraka William, et al. “Edge-Computing- Assisted Virtual Reality Computation Offloading: An Empirical Study.” IEEE Access, vol. 10, 2022, pp. 95892–907
Oing, T., & Prescott, J. (2018). Implementations of Virtual Reality for Anxiety-Related Disorders: Systematic Review. JMIR Serious Games, 6(4), e10965. https://doi.org/10.2196/10965
Olivares, F. A., Vargas, E., Fuentes, C., MartÃnez-PernÃa, D., & Canales-Johnson, A. (2015). Neurophenomenology revisited: second-person methods for the study of human consciousness. Frontiers in Psychology, 6. https://doi.org/10.3389/fpsyg.2015.00673
Ouzounian, G. (2006). Embodied sound: Aural architectures and the body. Contemporary Music Review, 25(1–2), 69–79. https://doi.org/10.1080/07494460600647469
Peacocke, Antonia, "Aesthetic Experience", The Stanford Encyclopedia of Philosophy (Spring 2023 Edition), Edward N. Zalta & Uri Nodelman (eds.), forthcoming URL: https://plato.stanford.edu/archives/spr2023/entries/aesthetic-experience/.
Rajguru, C., Obrist, M., & Memoli, G. (2020). Spatial Soundscapes and Virtual Worlds: Challenges and Opportunities. Frontiers in Psychology, 11, 569056. https://doi.org/10.3389/fpsyg.2020.569056
Riva, Giuseppe, et al. “Transforming Experience: The Potential of Augmented Reality and Virtual Reality for Enhancing Personal and Clinical Change.” Frontiers in Psychiatry, vol. 7, Sept. 2016, https://doi.org/10.3389/fpsyt.2016.00164.
Sayyad, Ehsan, et al. “Walking and Teleportation in Wide-Area Virtual Reality Experiences.” 2020 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), IEEE, 2020, pp. 608–17, https://doi.org/10.1109/ISMAR50242.2020.00088.
Shear, J., & Varela, F. J. (Eds.). (2000). The view from within: first-person approaches to the study of consciousness. Imprint Academic.
Shelley, James, "The Concept of the Aesthetic", The Stanford Encyclopedia of Philosophy (Spring 2022 Edition), Edward N. Zalta (ed.), https://plato.stanford.edu/archives/spr2022/entries/aesthetic-concept/
Tajadura-Jiménez, A., Väljamäe, A., Asutay, E., & Västfjäll, D. (2010). Embodied auditory perception: The emotional impact of approaching and receding sound sources. Emotion, 10(2), 216–229. https://doi.org/10.1037/a0018422
Toadvine, Ted, "Maurice Merleau-Ponty", The Stanford Encyclopedia of Philosophy (Spring 2019 Edition), Edward N. Zalta (ed.), https://plato.stanford.edu/archives/spr2019/entries/merleau-ponty/
Tomassoni, Rosella, et al. “Psychology of Light: How Light Influences the Health and Psyche.” Psychology, vol. 06, no. 10, 2015, pp. 1216–22, https://doi.org/10.4236/psych.2015.610119.
Turrell, J., Giménez, C., Trotman, N., & Solomon R. Guggenheim Museum (Eds.). (2013). James Turrell: ... on the occasion of the exhibition James Turrell, Solomon R. Guggenheim Museum, New York, June 21 – September 25, 2013. Guggenheim-Museum Publ.
uschefne. (n.d.). USC HMH Foundation Moving Image Archive » MORTON HEILIG : INVENTOR VR. Retrieved March 12, 2023, from https://www.uschefnerarchive.com/morton-heilig-inventor-vr/ (retrieved 12 Mar 2023)
Van de Mosselaer, N. (2022). The Aesthetics of Virtual Reality . The Journal of Aesthetics and Art Criticism, 80(4), 513–516. https://doi.org/10.1093/jaac/kpac047
Winstock, A. R. et al. (2021) Global Drug Survey (GDS) 2021. Key Findings Report.
Xenakis, I., & Arnellos, A. (2014). Aesthetic perception and its minimal content: a naturalistic perspective. Frontiers in Psychology, 5. https://doi.org/10.3389/fpsyg.2014.01038
Young, K. S. (2018). The impact of mindfulness-based interventions on brain activity. Neuroscience and Biobehavioral Reviews.

Comments

Comment on this article

[1] Ala, T. S. et al. (2018) “Cumulative effects of theta binaural beats on brain power and functional connectivity.” Biomedical Signal Process and Control. volume 42, pp 242-252.

[2] Baakek, Y. N. E. H., & Debbal, S. M. E. A. (2021). Digital drugs (binaural beats): how can it affect the brain/their impact on the brain. Journal of Medical Engineering & Technology, 45(7), 546–551. https://doi.org/10.1080/03091902.2021.1936236

[3] Barratt, M. J., Maddox, A., Smith, N., Davis, J. L., Goold, L., Winstock, A. R., & Ferris, J. A. (2022). Who uses digital drugs? An international survey of ‘binaural beat’ consumers. Drug and Alcohol Review, 41(5), 1126–1130. https://doi.org/10.1111/dar.13464

[4] Best, P. (2021). Freely Available Virtual Reality Experiences as Tools to Support Mental Health Therapy: A Systematic Scoping Review and Consensus Based Interdisciplinary Analysis. https://link.springer.com/article/10.1007/s41347-021-00214-6#article-info

[5] Davies, Char and John Harrison (1996) “Osmose: towards broadening the aesthetics of virtual reality.” ACM SIGGRAPH, Computer Graphics. vol. 30, Issue 4, Nov. 1996, pp 25–28.

[6] Depraz, Nathalie, et al. On Becoming Aware: A Pragmatics of Experiencing. John Benjamins Publishing Company, 2003, https://doi.org/10.1075/aicr.43.

[7] Desnoyers-Stewart, J., Stepanova, E. R., Pasquier, P., & Riecke, B. E. (2019). JeL: Connecting Through Breath in Virtual Reality. Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems, 1–6. https://doi.org/10.1145/3290607.3312845

[8] Diodato, R. (2022). Virtual Reality and Aesthetic Experience. Philosophies, 7(2), 29. https://doi.org/10.3390/philosophies7020029

[9] Edensor, T. (2015). Light Art, Perception, and Sensation. The Senses and Society, 10(2), 138–157. https://doi.org/10.1080/17458927.2015.1042228

[10] Fielke, G. (2016). Subliminal Massage – James Turrell: A Retrospective. Electronic Melbourne Art Journal, 9. https://doi.org/10.38030/emaj.2016.9.6

[11] Fleischmann, Monika and Wolfgang Strauss (1989- 1991). “Home of the Brain”. 14-10-2019, in: Archive of Digital Art. https://digitalartarchive.at/database/general/work/home-of-the-brain.html

[12] Fodor, L. A., Coteț, C. D., Cuijpers, P., Szamoskozi, Ștefan, David, D., & Cristea, I. A. (2018). The effectiveness of virtual reality-based interventions for symptoms of anxiety and depression: A meta-analysis. Scientific Reports, 8(1), 10323. https://doi.org/10.1038/s41598-018-28113-6

[13] Glowacki, David R., et al. “Isness: Using Multi-Person VR to Design Peak Mystical Type Experiences Comparable to Psychedelics.” Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, ACM, 2020, pp.1–14, https://doi.org/10.1145/3313831.3376649

[14] Gromala, Diane, Xin Tong, et al. “Mobius Floe: An Immersive Virtual Reality Game for Pain Distraction.” Electronic Imaging, vol. 28, no. 4, Feb. 2016, pp. 1–5

[15] Gromala, D., Song, M., Yim, J.-D., Fox, T., Barnes, S. J., Nazemi, M., Shaw, C., & Squire, P. (2011). Immersive VR: a non-pharmacological analgesic for chronic pain? CHI ’11 Extended Abstracts on Human Factors in Computing Systems, 1171–1176. https://doi.org/10.1145/1979742.1979704

[16] Harrison, N. R., & Clark, D. P. A. (2016). The Observing Facet of Trait Mindfulness Predicts Frequency of Aesthetic Experiences Evoked by the Arts. Mindfulness, 7(4), 971–978. https://doi.org/10.1007/s12671-016-0536-6

[17] Hong, J. Y., Lam, B., Ong, Z.-T., Ooi, K., Gan, W.-S., Kang, J., Feng, J., & Tan, S.-T. (2019). Quality assessment of acoustic environment reproduction methods for cinematic virtual reality in soundscape applications. Building and Environment, 149, 1–14. https://doi.org/10.1016/j.buildenv.2018.12.004

[18] Hyodo, Y., Sugai, C., Suzuki, J., Takahashi, M., Koizumi, M., Tomura, A., Mitsufuji, Y., & Komoriya, Y. (2021). Psychophysiological Effect of Immersive Spatial Audio Experience Enhanced Using Sound Field Synthesis. 2021 9th International Conference on Affective Computing and Intelligent Interaction (ACII), 1–8. https://doi.org/10.1109/ACII52823.2021.9597435

[19] Jirakittayakorn, N., & Wongsawat, Y. (2017) Brain Responses to a 6-Hz Binaural Beat: Effects on General Theta Rhythm and Frontal Midline Theta Activity. Frontiers in Neuroscience, 11, 365. https://doi.org/10.3389/fnins.2017.00365

[20] Jung, Sungchul, and Robert. W. Lindeman (2021) “Perspective: Does Realism Improve Presence in VR? Suggesting a Model and Metric for VR Experience Evaluation.” Frontiers in Virtual Reality, vol. 2, p. 693327, https://doi.org/10.3389/frvir.2021.693327.

[21] Lanier, J. (2017). Dawn of the new everything: encounters with reality and virtual reality (First edition). Henry Holt and Company.

[22] Lindner, P. (2021). Better, Virtually: the Past, Present, and Future of Virtual Reality Cognitive

[23] Behavior Therapy. International Journal of Cognitive Therapy, 14(1), 23–46. https://doi.org/10.1007/s41811-020-00090-7

[24] Lindquist, M., Maxim, B., Proctor, J., & Dolins, F. (2020). The effect of audio fidelity and virtual reality on the perception of virtual greenspace. Landscape and Urban Planning, 202, 103884. https://doi.org/10.1016/j.landurbplan.2020.103884

[25] Mastandrea, Stefano, et al. (2019) “Art and Psychological Well-Being: Linking the Brain to the Aesthetic Emotion.” Frontiers in Psychology, vol. 10, p. 739

[26] Metzinger, Thomas K. (2018) “Why Is Virtual Reality Interesting for Philosophers?” Frontiers in Robotics and AI, vol. 5, Sept. 2018.

[27] Merleau-Ponty, M., Smith, C., & Merleau-Ponty, M. (1996). Phenomenology of perception (1. Indian ed). Motilal Banarsidass Publ.

[28] Naz, A., Kopper, R., McMahan, R. P., & Nadin, M. (2017). Emotional qualities of VR space. 2017 IEEE Virtual Reality (VR), 3–11. https://doi.org/10.1109/VR.2017.7892225

[29] Nyamtiga, Baraka William, et al. “Edge-Computing- Assisted Virtual Reality Computation Offloading: An Empirical Study.” IEEE Access, vol. 10, 2022, pp. 95892–907

[30] Oing, T., & Prescott, J. (2018). Implementations of Virtual Reality for Anxiety-Related Disorders: Systematic Review. JMIR Serious Games, 6(4), e10965. https://doi.org/10.2196/10965

[31] Olivares, F. A., Vargas, E., Fuentes, C., MartÃnez-PernÃa, D., & Canales-Johnson, A. (2015). Neurophenomenology revisited: second-person methods for the study of human consciousness. Frontiers in Psychology, 6. https://doi.org/10.3389/fpsyg.2015.00673

[32] Ouzounian, G. (2006). Embodied sound: Aural architectures and the body. Contemporary Music Review, 25(1–2), 69–79. https://doi.org/10.1080/07494460600647469

[33] Peacocke, Antonia, "Aesthetic Experience", The Stanford Encyclopedia of Philosophy (Spring 2023 Edition), Edward N. Zalta & Uri Nodelman (eds.), forthcoming URL: https://plato.stanford.edu/archives/spr2023/entries/aesthetic-experience/.

[34] Rajguru, C., Obrist, M., & Memoli, G. (2020). Spatial Soundscapes and Virtual Worlds: Challenges and Opportunities. Frontiers in Psychology, 11, 569056. https://doi.org/10.3389/fpsyg.2020.569056

[35] Riva, Giuseppe, et al. “Transforming Experience: The Potential of Augmented Reality and Virtual Reality for Enhancing Personal and Clinical Change.” Frontiers in Psychiatry, vol. 7, Sept. 2016, https://doi.org/10.3389/fpsyt.2016.00164.

[36] Sayyad, Ehsan, et al. “Walking and Teleportation in Wide-Area Virtual Reality Experiences.” 2020 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), IEEE, 2020, pp. 608–17, https://doi.org/10.1109/ISMAR50242.2020.00088.

[37] Shear, J., & Varela, F. J. (Eds.). (2000). The view from within: first-person approaches to the study of consciousness. Imprint Academic.

[38] Shelley, James, "The Concept of the Aesthetic", The Stanford Encyclopedia of Philosophy (Spring 2022 Edition), Edward N. Zalta (ed.), https://plato.stanford.edu/archives/spr2022/entries/aesthetic-concept/

[39] Tajadura-Jiménez, A., Väljamäe, A., Asutay, E., & Västfjäll, D. (2010). Embodied auditory perception: The emotional impact of approaching and receding sound sources. Emotion, 10(2), 216–229. https://doi.org/10.1037/a0018422

[40] Toadvine, Ted, "Maurice Merleau-Ponty", The Stanford Encyclopedia of Philosophy (Spring 2019 Edition), Edward N. Zalta (ed.), https://plato.stanford.edu/archives/spr2019/entries/merleau-ponty/

[41] Tomassoni, Rosella, et al. “Psychology of Light: How Light Influences the Health and Psyche.” Psychology, vol. 06, no. 10, 2015, pp. 1216–22, https://doi.org/10.4236/psych.2015.610119.

[42] Turrell, J., Giménez, C., Trotman, N., & Solomon R. Guggenheim Museum (Eds.). (2013). James Turrell: ... on the occasion of the exhibition James Turrell, Solomon R. Guggenheim Museum, New York, June 21 – September 25, 2013. Guggenheim-Museum Publ.

[43] uschefne. (n.d.). USC HMH Foundation Moving Image Archive » MORTON HEILIG : INVENTOR VR. Retrieved March 12, 2023, from https://www.uschefnerarchive.com/morton-heilig-inventor-vr/ (retrieved 12 Mar 2023)

[44] Van de Mosselaer, N. (2022). The Aesthetics of Virtual Reality . The Journal of Aesthetics and Art Criticism, 80(4), 513–516. https://doi.org/10.1093/jaac/kpac047

[45] Winstock, A. R. et al. (2021) Global Drug Survey (GDS) 2021. Key Findings Report.

[46] Xenakis, I., & Arnellos, A. (2014). Aesthetic perception and its minimal content: a naturalistic perspective. Frontiers in Psychology, 5. https://doi.org/10.3389/fpsyg.2014.01038

[47] Young, K. S. (2018). The impact of mindfulness-based interventions on brain activity. Neuroscience and Biobehavioral Reviews.

UK Computing Summit 2025: Navigating change (surviving and beyond) - 29-30 April @ Sheffield Hallam University - Register here.

Can You Feel What I Feel? Leveraging aesthetics in visual and spatial audio VR experience

Contributors

Conference

Affiliations

Article

History

Product

Categories

Comment on this article