A new paradigm of interaction for human controlled technical systems

R. Möller

Automation and Process Control Engineering, University of Wuppertal, Dept. of Electrical, Information, Media Engineering, Rainer–Gruenter–Str. 21, Bld. FC, 42349 Wuppertal, Germany e–mail: r.moeller@computer.org

Recibido el 27 de octubre de 2004
Aceptado el 25 de mayo de 2005

Abstract

With today's multimedia computing technology, we are able to return to simple and intuitive control of technical equipment by using all major human senses in combination, that is, auditory, visual, haptic and olfactory modalities. This leads to a new paradigm of human–computer interaction. This paper will present the state of development and use of multimodal interactive user interfaces. Further topics for discussion will be aspects and issues of human engineering concerned with the different modalities noted in this abstract. Actual applications and research will be referenced.

Keywords: Human–computer engineering; virtual reality; multimodal sensory.

Resumen

Con la tecnología multimedia de hoy en día somos capaces de volver al control simple e intuitivo del equipo técnico, combinando los sentidos principales del ser humano, es decir, las modalidades auditivas, visuales, tactilares y olfativas. Esto da lugar a un nuevo paradigma interactivo entre el hombre y el ordenador. Este documento presenta el estado de desarrollo y uso de los interfaces interactivos del usuario. Otros temas de discusión son los aspectos y aplicaciones de la ingeniería humana en lo que respecta las diferentes modalidades reflejadas en este extracto. Se hace referencia a las aplicaciones e investigación reales.

Descriptores: Ingeniería humana; interfaces del usuario; realidad virtual; sentidos multimodales.

PACS: 89.20.Bb; 89.20.Kk; 43.72.+g; 87.19.Dd

DESCARGAR ARTÍCULO EN FORMATO PDF

References

1. S. Akyol, L. Libuda, and K.–F. Kraiss, Multimodale Benut–zung adaptiver Kfz–Bordsysteme, in: K.P. Timpe, T. Jürgensohn, Kraftfahrzeugführung (Springer–Verlag, Berlin, 2001).        [ Links ]

2. A. Wu, M. Shah, and N. da Vitoria Lobo, A Virtual 3D Blackboard: 3D Finger Tracking using a single camera, Fourth IEEE International Conference on Automatic Face and Gesture Recognition, Proceedings, Grenoble (France, 2000).        [ Links ]

3. M. Rauterberg, Different effects of auditory feedback in man–machine interfaces, in: N.A. Stanton and J. Edworthy (eds.), Human Factors in Auditory Warnings, Ashgate Publishing (1999) pp. 225–242.        [ Links ]

4. Multimedia Process Control Room, German Research Foundation (DFG) project: http://www.imat.maschinenbau.uni-kassel.de/forschu/deutsche.html#multi (1997–2010).        [ Links ]

5. W. Mueller, R. Schaefer, and S. Bleul, Interactive Multimodal User Interfaces for Mobile Devices, 37^th Int. Conf. on System Sciences, IEEE Proceedings, 2004.        [ Links ]

6. P. Cosi et al., Labial Coarticulation Modeling for Realistic Facial Animation, in: Fourth IEEE International Conference on Multimodal Interfaces (ICMI'02), IEEE Proceedings (2002) p. 505.        [ Links ]

7. CSLU Toolkit V. 2.0 (http://cslu.ece.ogi.edu/toolkit/), Center for Spoken Language Understanding, Oregon Graduate Institute of Science and Technology, 2004.        [ Links ]

8. http://www.arvika.de , Augmented Reality for Development, Production and Service, bmb+f lead project (German Ministry of Education and Research).        [ Links ]

9. R. Möller, Relevanz computergraphischer Methoden für die Automatisierungstechnik. VDI Fortschrittberichte, Reihe 20, Nr. 171, VDI–Verlag, Düsseldorf, 1995.        [ Links ]

10. R. Möller and R. Karger, Multimediatechnologie – optischer und akustischer Kanal, Proceedings of VDE/GMA Kongress, Stuttgart, 1998.        [ Links ]

11. Mensch–Maschine–Sytemtechnik, K.–P Timpe, H. Kolrep, T. Jürgensohn (ed.) (Symposion Publishing, 2002).        [ Links ]

12. B. Shneiderman and C. Plaisant, Designing the User Interface: Strategies for Effective Human–Computer Interaction, Addison–Wesley Longman, 4^th. ed., 2004        [ Links ]

13. C. Maggioni and H. Röttger, Virtual Touchscreen – a novel User Interface made of Light – Principles, metaphors and experiences, Proceedings of HCI International, Volume I: Ergonomics and User Interfaces (1999) p.301.        [ Links ]

14. M. Lin and K. Salisbury, Comp. Graph. App. 24/2 (2004) 22.        [ Links ]

15. E. Mäkinen and R. Raisamo, Real–Time Face Detection for Kiosk Interfaces. Proceedings of APCHI 2002, Vol. 2, Science Press, Beijing, China, p. 528.        [ Links ]

16. A. Waibel et al., CHIL: Computers in the Human Interaction Loop, 5th International Workshop on Image Analysis for Multimedia Interactive Services (WIAMIS), Proceedings (2004), Lisbon.        [ Links ]