A Rendering Model for Emotional In-air Handwriting

According to graphology, people’s emotional states can be detected from their handwriting. The purpose of our research is to propose a 3D handwriting rendering model which has emotional capabilities. We developed an in-air handwriting system and selected eight emotions (afraid, angry, disgusted, happy, sad, surprised, amorous and serious) to be conveyed using five rendering parameters (weight, smoothness, tip of stroke, ink density and ink dryness). We then conducted an online survey to determine the optimal parameters’ values. A first result shows that there is a positive correlation between the Euclidean distance between two emotions on the valence-arousal emotion two-dimensional model and the distance between the calculated rendering parameters’ values. Another online survey then revealed that four of the emotions (afraid, sad, serious and angry) are well conveyed. The results are less conclusive for the other four emotions, but further work is being conducted to improve the model when the handwriting is shown in conjunction with the other emotional channels of a social robot.

Content

Author and article information

Contributors

Ziqian Chen

Marie-Luce Bourguet

Gentiane Venture

Conference

Publication date: July 2018

Publication date (Print): July 2018

Pages: 1-5

Affiliations

[0001]Beijing University of Posts and Telecommunications

[0002]Queen Mary University of London

[0003]Tokyo University of Agriculture and Technology

Article

DOI: 10.14236/ewic/HCI2018.111

SO-VID: 08e2662e-b73b-41ed-8337-67342bc60829

License:

This work is licensed under a Creative Commons Attribution 4.0 Unported License. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/

Conference name: Proceedings of the 32nd International BCS Human Computer Interaction Conference

Conference acronym: HCI

Conference number: 32

Conference location: Belfast, UK

Conference date: 4 - 6 July 2018

Conference sponsor: Electronic Workshops in Computing (eWiC)

Conference theme: Human Computer Interaction Conference

History

Product

1477-9358 BCS Learning & Development

Self URI (article page): https://www.scienceopen.com/hosted-document?doi=10.14236/ewic/HCI2018.111

Self URI (journal page): https://ewic.bcs.org/

References

M. Bashir G. Scharfenberg & J. Kempf (2011) Person Authentication by Handwriting in air using a Biometric Smart Pen Device International Conference of the Biometrics Special Interest Group (BIOSIG) Darmstadt, Germany 8-9 September, 2011 219–226.
B. Bauermeister (1988) A Manual of Comparative Typography: the PANOSE System Van Nostrand Reinhold.
C. Breazeal, & R. Brooks (2005) Robot emotion: A functional perspective. In J.M. FellousM.A. Arbib (eds), Who Needs Emotions?: The Brain Meets the Robot Oxford University Press 271–310.
J-A Claret., G. Venture & L. Basañez (2017) Exploiting the Robot Kinematic Redundancy for Emotion Conveyance to Humans as a Lower Priority Task Int J of Soc Robotics 9 277–294.
H. Ding C. Qian J. Han G. Wang W. Xi K. Zhao & J. Zhao (2017) RFIPad: Enabling Cost-Efficient and Device-Free In-air Handwriting Using Passive Tags In Proc. of 37TH IEEE International Conference on Distributed Computing Systems (ICDCS) Atlanta, GA, USA 5-8 June 2017 447–457.
P. Ekman (1992) An Argument for Basic Emotions Cognition and Emotion 6 (3/4), 169–200.
M. Fairhurst M. Erbliek & C. Li (2015) Study of automatic prediction of emotion from handwriting samples IET Biometrics 4, Issue 2 90–97.
P.K. Grewal, & D. Prashar (2012) Behavior Prediction Through Handwriting Analysis International Journal of Computer Science and Technology (IJCST), 3, issue 2, 520–523.
A. Heydarian J.P. Carneiro D. Gerber B. Becerik-Gerber T. Hayes, & W. Wood (2015) Immersive virtual environments versus physical built environments: A benchmarking study for building design and user-built environment explorations Automation in Construction 54 116–126.
S.V. Kedar D.S. Bormane A. Dhadwal S. Alone & R. Agarwal (2015) Automatic Emotion Recognition through Handwriting Analysis: A Review Computing Communication Control and Automation (ICCUBEA) Pune, India 26-27 February 2015 811-816 IEEE.
P. Kumar R. Saini P.P. Roy & D.P. Dogra (2017) 3D Text Segmentation and Recognition Using Leap Motion Multimedia Tools and Applications 76, Issue 15 16491–16510.
L. Likforman-Sulem A. Esposito M. Faundez-Zanuy S. Clémençon & G. Cordasco (2017) EMOTHAW: A Novel Database for Emotional State Recognition From Handwriting and Drawing IEEE Transactions on Human-Machine Systems 47, No. 2 273–284.
G. Paltoglou & M. Thelwall (2013) Seeing Stars of Valence and Arousal in Blog Posts IEEE Transactions on Affective Computing 4, Issue 1 116–123.
R. Plutchik (1982) A Psychoevolutionary Theory of Emotions Social Science Information 21, Issue 4-5 529–553.
V. Potkonjak (2012) Robot Handwriting: Why and How? Interdisciplinary Applications of Kinematics Springer 19–35.
J.A. Russell (1980) A Circumplex Model of Affect Journal of Personality and Social Psychology 39, No. 6 1161–1178.
E. Sesa-Nogueras M. Faundez-Zanuy & J. Mekyska (2012) An Information Analysis of In-Air and On-Surface Trajectories in Online Handwriting Cognitive Computation 4, Issue 2 195–205.
J. Tian Y. Cao W. Xu & S. Wang (2017) Challenge-Response Authentication using In-Air Handwriting Style Verification IEEE Transactions on Dependable and Secure Computing, PP, Issue 99 1–14.
S. Vikram L. Li & S. Russel (2013) Handwriting and Gestures in the Air, Recognizing on the Fly CHI 2013 Paris, France 27 April-2 May 2013.
L. Whyte N. Bouchlaghem A. Thorpe & R. McCaffer (2000) From CAD to virtual reality: modelling approaches, data exchange and interactive 3D building design tools Automation in Construction 10, Issue 1 43–55.
N. Xu W. Wang & X. Qu (2015) Recognition of In-air Handwritten Chinese Character Based on Leap Motion Controller International Conference on Image and Graphics Tianjin China 13-16 August 2015 160-168 Springer International Publishing.
C. Yee (1973) Chinese Calligraphy: An Introduction to Its Aesthetic and Technique, Third Edition, Revised and Enlarged. Harvard University Press.
W. Zhang (2004) The four treasures: Inside the scholar's studio Long River Press. San Francisco.

Comments

Comment on this article

[1] M. Bashir G. Scharfenberg & J. Kempf (2011) Person Authentication by Handwriting in air using a Biometric Smart Pen Device International Conference of the Biometrics Special Interest Group (BIOSIG) Darmstadt, Germany 8-9 September, 2011 219–226.

[2] B. Bauermeister (1988) A Manual of Comparative Typography: the PANOSE System Van Nostrand Reinhold.

[3] C. Breazeal, & R. Brooks (2005) Robot emotion: A functional perspective. In J.M. FellousM.A. Arbib (eds), Who Needs Emotions?: The Brain Meets the Robot Oxford University Press 271–310.

[4] J-A Claret., G. Venture & L. Basañez (2017) Exploiting the Robot Kinematic Redundancy for Emotion Conveyance to Humans as a Lower Priority Task Int J of Soc Robotics 9 277–294.

[5] H. Ding C. Qian J. Han G. Wang W. Xi K. Zhao & J. Zhao (2017) RFIPad: Enabling Cost-Efficient and Device-Free In-air Handwriting Using Passive Tags In Proc. of 37TH IEEE International Conference on Distributed Computing Systems (ICDCS) Atlanta, GA, USA 5-8 June 2017 447–457.

[6] P. Ekman (1992) An Argument for Basic Emotions Cognition and Emotion 6 (3/4), 169–200.

[7] M. Fairhurst M. Erbliek & C. Li (2015) Study of automatic prediction of emotion from handwriting samples IET Biometrics 4, Issue 2 90–97.

[8] P.K. Grewal, & D. Prashar (2012) Behavior Prediction Through Handwriting Analysis International Journal of Computer Science and Technology (IJCST), 3, issue 2, 520–523.

[9] A. Heydarian J.P. Carneiro D. Gerber B. Becerik-Gerber T. Hayes, & W. Wood (2015) Immersive virtual environments versus physical built environments: A benchmarking study for building design and user-built environment explorations Automation in Construction 54 116–126.

[10] S.V. Kedar D.S. Bormane A. Dhadwal S. Alone & R. Agarwal (2015) Automatic Emotion Recognition through Handwriting Analysis: A Review Computing Communication Control and Automation (ICCUBEA) Pune, India 26-27 February 2015 811-816 IEEE.

[11] P. Kumar R. Saini P.P. Roy & D.P. Dogra (2017) 3D Text Segmentation and Recognition Using Leap Motion Multimedia Tools and Applications 76, Issue 15 16491–16510.

[12] L. Likforman-Sulem A. Esposito M. Faundez-Zanuy S. Clémençon & G. Cordasco (2017) EMOTHAW: A Novel Database for Emotional State Recognition From Handwriting and Drawing IEEE Transactions on Human-Machine Systems 47, No. 2 273–284.

[13] G. Paltoglou & M. Thelwall (2013) Seeing Stars of Valence and Arousal in Blog Posts IEEE Transactions on Affective Computing 4, Issue 1 116–123.

[14] R. Plutchik (1982) A Psychoevolutionary Theory of Emotions Social Science Information 21, Issue 4-5 529–553.

[15] V. Potkonjak (2012) Robot Handwriting: Why and How? Interdisciplinary Applications of Kinematics Springer 19–35.

[16] J.A. Russell (1980) A Circumplex Model of Affect Journal of Personality and Social Psychology 39, No. 6 1161–1178.

[17] E. Sesa-Nogueras M. Faundez-Zanuy & J. Mekyska (2012) An Information Analysis of In-Air and On-Surface Trajectories in Online Handwriting Cognitive Computation 4, Issue 2 195–205.

[18] J. Tian Y. Cao W. Xu & S. Wang (2017) Challenge-Response Authentication using In-Air Handwriting Style Verification IEEE Transactions on Dependable and Secure Computing, PP, Issue 99 1–14.

[19] S. Vikram L. Li & S. Russel (2013) Handwriting and Gestures in the Air, Recognizing on the Fly CHI 2013 Paris, France 27 April-2 May 2013.

[20] L. Whyte N. Bouchlaghem A. Thorpe & R. McCaffer (2000) From CAD to virtual reality: modelling approaches, data exchange and interactive 3D building design tools Automation in Construction 10, Issue 1 43–55.

[21] N. Xu W. Wang & X. Qu (2015) Recognition of In-air Handwritten Chinese Character Based on Leap Motion Controller International Conference on Image and Graphics Tianjin China 13-16 August 2015 160-168 Springer International Publishing.

[22] C. Yee (1973) Chinese Calligraphy: An Introduction to Its Aesthetic and Technique, Third Edition, Revised and Enlarged. Harvard University Press.

[23] W. Zhang (2004) The four treasures: Inside the scholar's studio Long River Press. San Francisco.

Celebrating 65 years of The Computer Journal - free-to-read perspectives - bcs.org/tcj65