A Systematic Lightweight Approach for Natural User Interfaces Prototyping

scite shows how a scientific paper has been cited by providing the context of the citation, a classification describing whether it supports, mentions, or contrasts the cited claim, and a label indicating in which section the citation was made.

Header Abstract Content Author and article information REFERENCES Comments

Record: found
Abstract: found
Conference Proceedings: found

Is Open Access

A Systematic Lightweight Approach for Natural User Interfaces Prototyping

Published

proceedings-article

Author(s): Baraa Alabdulwahab , Effie Lai-Chong Law

Publication date (Print): August 2023

Conference name: 36th International BCS Human-Computer Interaction Conference (BCS HCI 23)

Conference theme: The BCS Human-Computer Interaction Conference 2023 was co-located with the INTERACT 2023 conference, the theme of which was "Design for Equlity and Justice", as increasingly, computer science as a discipline is becoming concerned about issues of justice and equality – from fake news to rights for robots, from the ethics of driverless vehicles to the gamergate controversy. The BCS HCI Conference welcomed submissions on all aspects of human-computer interaction. Topics included: User Experience, usability testing and interaction design; Education and Health; Smart Energy, Smart Transport and the Internet of Things; Interaction Technologies and Applications.

Conference date: 28–29 August 2023

Keywords: Natural user interface, Graphical user interface, Smartpen, Pen-based interaction

Bookmark

Abstract

Content

Author and article information

Contributors

Baraa Alabdulwahab

Effie Lai-Chong Law

Conference

Publication date: August 2023

Publication date (Print): August 2023

Pages: 120-129

Affiliations

[0001]School of Computing and Mathematical Sciences, University of Leicester

University Road, LE1 7RH, Leicester, UK

[0002]Department of Computer Science, Durham University

Upper Mountjoy Campus, DH1 3LE Durham, UK

[0003]

Article

DOI: 10.14236/ewic/BCSHCI2023.14

SO-VID: f03ae470-002c-4d2e-b6d8-e19da29b4f1f

License:

This work is licensed under a Creative Commons Attribution 4.0 Unported License. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/

Conference name: 36th International BCS Human-Computer Interaction Conference

Conference acronym: BCS HCI 23

Conference number: 36

Conference location: University of York, UK

Conference date: 28–29 August 2023

Conference sponsor: Electronic Workshops in Computing (eWiC)

History

Product

1477-9358 BCS Learning & Development

Self URI (article page): https://www.scienceopen.com/hosted-document?doi=10.14236/ewic/BCSHCI2023.14

Self URI (journal page): https://ewic.bcs.org/

REFERENCES

Bataille, G., Gouranton, V., Lacoche, J., Pelé, D., & Arnaldi, B. (2022). Unified Model and Framework for Interactive Mixed Entity Systems. Computer Vision, Imaging and Computer Graphics Theory and Applications. VISIGRAPP 2020 (pp. 3-25). Valletta Malta: Springer, Cham.
Bowen, J., Weyers, B., & Liu, B. (2022). Creating Formal Models from Informal Design Artefacts. International Journal of Human–Computer Interaction. doi:10.1080/10447318.2022.2095833.
Carter, A. S., & Hundhausen, C. D. (2010). How is User Interface Prototyping Really Done in Practice? A Survey of User Interface Designers. IEEE Symposium on Visual Languages and Human-Centric Computing (pp. 207-211). Leganes Spain: IEEE.
Cheng, H., Yang, L. and Liu, Z., 2015. Survey on 3D hand gesture recognition. IEEE transactions on circuits and systems for video technology, 26(9), pp.1659-1673.
Chklovski, T., Ratnakar, V., & Gil, Y. (2005). User interfaces with semi-formal representations: a study of designing argumentation structures. IUI '05: Proceedings of the 10th international conference on Intelligent user interfaces (pp. 130-136). San Diego California: ACM.
Davani, A. M., Shirehjini, A. A., & Daraei, S. (2018). Towards interacting with smarter systems. Journal of Ambient Intelligence and Humanized Computing, 187-209.
de Haan, G. (2015). HCI Design Methods: where next? from user-centred to creative design and beyond. ECCE '15: Proceedings of the European Conference on Cognitive Ergonomics 2015 (pp. 1-8). Warsaw Poland: ACM.
Dix, A., Ghazali, M., Gill, S., Hare, J., & Ramduny-Ellis, D. (2009). Physigrams: modelling devices for natural interaction. Formal Aspects of Computing, 613-641.
Feng, Y., Uchidiuno, U.A., Zahiri, H.R., George, I., Park, A.E. and Mentis, H., 2021. Comparison of Kinect and leap motion for intraoperative image interaction. Surgical Innovation, 28(1), pp.33-40.
Galitz, W.O., 2007. The essential guide to user interface design: an introduction to GUI design principles and techniques. John Wiley & Sons.
Hauger, D., Paramythis, A. and Weibelzahl, S., 2011. Using browser interaction data to determine page reading behavior. In User Modeling, Adaption and Personalization: 19th International Conference, UMAP 2011, Girona, Spain, July 11-15, 2011. Proceedings 19 (pp. 147-158). Springer Berlin Heidelberg.
Jagodziński, P. and Wolski, R., 2015. Assessment of application technology of natural user interfaces in the creation of a virtual chemical laboratory. Journal of Science Education and Technology, 24, pp.16-28.
Jensen, L. and Konradsen, F., 2018. A review of the use of virtual reality head-mounted displays in education and training. Education and Information Technologies, 23, pp.1515-1529.
Jin, Y., Ma, M. and Zhu, Y., 2022. A comparison of natural user interface and graphical user interface for narrative in HMD-based augmented reality. Multimedia tools and applications, 81(4), pp.5795-5826.
Kortum, P., 2008. HCI beyond the GUI: Design for haptic, speech, olfactory, and other nontraditional interfaces. Elsevier.
Lai, N.K., Ang, T.F., Por, L.Y. and Liew, C.S., 2018. Learning through intuitive interface: A case study on preschool learning. Computers & Education, 126, pp.443-458.
Lam, H. and Baudisch, P., 2005, April. Summary thumbnails: readable overviews for small screen web browsers. In Proceedings of the SIGCHI conference on Human factors in computing systems (pp. 681-690).
Law, Y. C., Wehrt, W., Sonnentag, S., & Weyers, B. (2023). Obtaining Semi-Formal Models from Qualitative Data: From Interviews Into BPMN Models in User-Centered Design Processes. International Journal of Human–Computer Interaction, 476-493.
Mann, S., 2007, June. Natural Interfaces for Musical Expression: Physiphones and a physics-based organology. In Proceedings of the 7th international conference on New interfaces for musical expression (pp. 118-123).
Norman, D. A. (2010). Natural user interfaces are not natural. interactions, 17(3), 6-10.
Palanque, P., Ladry, J.-F., Navarre, D., & Barboni, E. (2009). High-Fidelity Prototyping of Interactive Systems Can Be Formal Too. HCI 2009: Human-Computer Interaction. New Trends (pp. 667-676). San Diego CA: Springer.
Phamduy, P., DeBellis, M. and Porfiri, M., 2015. Controlling a robotic fish via a natural user interface for informal science education. IEEE Transactions on Multimedia, 17(12), pp.2328-2337.
Serim, B., & Jacucci, G. (2019). Explicating" Implicit Interaction" An examination of the concept and challenges for research. In Proceedings of Conference on Human Factors in Computing Systems (CHI’19) (pp. 1-16).
Shaer, O., & Jacob, R. J. (2009). A specification paradigm for the design and implementation of tangible user interfaces. ACM Transactions on Computer-Human Interaction, 1-39.
Schmidt, A., 2000. Implicit human computer interaction through context. Personal technologies, 4, pp.191-199.
Trætteberg, H. (2002). Model-based User Interface Design. Norwegian University of Science and Technology.
Tsalmpouris, G., Tsinarakis, G., Gertsakis, N., Chatzichristofis, S. A., & Doitsidis, L. (2021). HYDRA: Introducing a Low-Cost Framework for STEM Education Using Open Tools. Electronics, 3056.
Vitzthum, A. (2006). SSIML/AR: A Visual Language for the Abstract Specification of Augmented Reality User Interfaces. 3D User Interfaces (3DUI'06) (pp. 135-143). Alexandria Virginia: IEEE.
Yu, J., Denham, A.R. and Searight, E., 2022. A systematic review of augmented reality game-based Learning in STEM education. Educational technology research and development, 70(4), pp.1169-1194.
Zhao, Y., Qin, Y., Liu, Y., Liu, S., Zhang, T. and Shi, Y., 2014, February. QOOK: enhancing information revisitation for active reading with a paper book. In Proceedings of the 8th International Conference on Tangible, Embedded and Embodied Interaction (pp. 125-132).

Comments

Comment on this article

[1] Bataille, G., Gouranton, V., Lacoche, J., Pelé, D., & Arnaldi, B. (2022). Unified Model and Framework for Interactive Mixed Entity Systems. Computer Vision, Imaging and Computer Graphics Theory and Applications. VISIGRAPP 2020 (pp. 3-25). Valletta Malta: Springer, Cham.

[2] Bowen, J., Weyers, B., & Liu, B. (2022). Creating Formal Models from Informal Design Artefacts. International Journal of Human–Computer Interaction. doi:10.1080/10447318.2022.2095833.

[3] Carter, A. S., & Hundhausen, C. D. (2010). How is User Interface Prototyping Really Done in Practice? A Survey of User Interface Designers. IEEE Symposium on Visual Languages and Human-Centric Computing (pp. 207-211). Leganes Spain: IEEE.

[4] Cheng, H., Yang, L. and Liu, Z., 2015. Survey on 3D hand gesture recognition. IEEE transactions on circuits and systems for video technology, 26(9), pp.1659-1673.

[5] Chklovski, T., Ratnakar, V., & Gil, Y. (2005). User interfaces with semi-formal representations: a study of designing argumentation structures. IUI '05: Proceedings of the 10th international conference on Intelligent user interfaces (pp. 130-136). San Diego California: ACM.

[6] Davani, A. M., Shirehjini, A. A., & Daraei, S. (2018). Towards interacting with smarter systems. Journal of Ambient Intelligence and Humanized Computing, 187-209.

[7] de Haan, G. (2015). HCI Design Methods: where next? from user-centred to creative design and beyond. ECCE '15: Proceedings of the European Conference on Cognitive Ergonomics 2015 (pp. 1-8). Warsaw Poland: ACM.

[8] Dix, A., Ghazali, M., Gill, S., Hare, J., & Ramduny-Ellis, D. (2009). Physigrams: modelling devices for natural interaction. Formal Aspects of Computing, 613-641.

[9] Feng, Y., Uchidiuno, U.A., Zahiri, H.R., George, I., Park, A.E. and Mentis, H., 2021. Comparison of Kinect and leap motion for intraoperative image interaction. Surgical Innovation, 28(1), pp.33-40.

[10] Galitz, W.O., 2007. The essential guide to user interface design: an introduction to GUI design principles and techniques. John Wiley & Sons.

[11] Hauger, D., Paramythis, A. and Weibelzahl, S., 2011. Using browser interaction data to determine page reading behavior. In User Modeling, Adaption and Personalization: 19th International Conference, UMAP 2011, Girona, Spain, July 11-15, 2011. Proceedings 19 (pp. 147-158). Springer Berlin Heidelberg.

[12] Jagodziński, P. and Wolski, R., 2015. Assessment of application technology of natural user interfaces in the creation of a virtual chemical laboratory. Journal of Science Education and Technology, 24, pp.16-28.

[13] Jensen, L. and Konradsen, F., 2018. A review of the use of virtual reality head-mounted displays in education and training. Education and Information Technologies, 23, pp.1515-1529.

[14] Jin, Y., Ma, M. and Zhu, Y., 2022. A comparison of natural user interface and graphical user interface for narrative in HMD-based augmented reality. Multimedia tools and applications, 81(4), pp.5795-5826.

[15] Kortum, P., 2008. HCI beyond the GUI: Design for haptic, speech, olfactory, and other nontraditional interfaces. Elsevier.

[16] Lai, N.K., Ang, T.F., Por, L.Y. and Liew, C.S., 2018. Learning through intuitive interface: A case study on preschool learning. Computers & Education, 126, pp.443-458.

[17] Lam, H. and Baudisch, P., 2005, April. Summary thumbnails: readable overviews for small screen web browsers. In Proceedings of the SIGCHI conference on Human factors in computing systems (pp. 681-690).

[18] Law, Y. C., Wehrt, W., Sonnentag, S., & Weyers, B. (2023). Obtaining Semi-Formal Models from Qualitative Data: From Interviews Into BPMN Models in User-Centered Design Processes. International Journal of Human–Computer Interaction, 476-493.

[19] Mann, S., 2007, June. Natural Interfaces for Musical Expression: Physiphones and a physics-based organology. In Proceedings of the 7th international conference on New interfaces for musical expression (pp. 118-123).

[20] Norman, D. A. (2010). Natural user interfaces are not natural. interactions, 17(3), 6-10.

[21] Palanque, P., Ladry, J.-F., Navarre, D., & Barboni, E. (2009). High-Fidelity Prototyping of Interactive Systems Can Be Formal Too. HCI 2009: Human-Computer Interaction. New Trends (pp. 667-676). San Diego CA: Springer.

[22] Phamduy, P., DeBellis, M. and Porfiri, M., 2015. Controlling a robotic fish via a natural user interface for informal science education. IEEE Transactions on Multimedia, 17(12), pp.2328-2337.

[23] Serim, B., & Jacucci, G. (2019). Explicating" Implicit Interaction" An examination of the concept and challenges for research. In Proceedings of Conference on Human Factors in Computing Systems (CHI’19) (pp. 1-16).

[24] Shaer, O., & Jacob, R. J. (2009). A specification paradigm for the design and implementation of tangible user interfaces. ACM Transactions on Computer-Human Interaction, 1-39.

[25] Schmidt, A., 2000. Implicit human computer interaction through context. Personal technologies, 4, pp.191-199.

[26] Trætteberg, H. (2002). Model-based User Interface Design. Norwegian University of Science and Technology.

[27] Tsalmpouris, G., Tsinarakis, G., Gertsakis, N., Chatzichristofis, S. A., & Doitsidis, L. (2021). HYDRA: Introducing a Low-Cost Framework for STEM Education Using Open Tools. Electronics, 3056.

[28] Vitzthum, A. (2006). SSIML/AR: A Visual Language for the Abstract Specification of Augmented Reality User Interfaces. 3D User Interfaces (3DUI'06) (pp. 135-143). Alexandria Virginia: IEEE.

[29] Yu, J., Denham, A.R. and Searight, E., 2022. A systematic review of augmented reality game-based Learning in STEM education. Educational technology research and development, 70(4), pp.1169-1194.

[30] Zhao, Y., Qin, Y., Liu, Y., Liu, S., Zhang, T. and Shi, Y., 2014, February. QOOK: enhancing information revisitation for active reading with a paper book. In Proceedings of the 8th International Conference on Tangible, Embedded and Embodied Interaction (pp. 125-132).

UK Computing Summit 2025: Navigating change (surviving and beyond) - 29-30 April @ Sheffield Hallam University - Register here.

A Systematic Lightweight Approach for Natural User Interfaces Prototyping

Contributors

Conference

Affiliations

Article

History

Product

Categories

Comment on this article