TY - JOUR T1 - Phantom-based multimodal interactions for medical education and training the Munich knee joint simulator. JF - IEEE Transactions on information technology in biomedicine A1 - Riener, R. LA - English UL - https://tuklas.up.edu.ph/Record/UP-99796217609548027 AB - Simulation environments based on virtual reality technologies can support medical education and training. In this paper, the novel approach of an "interactive phantom" is presented that allows a realistic display of haptic contact information typically generated when touching and moving human organs or segments. The key idea of the haptic interface is to attach passive phantom objects to a mechanical actuator. The phantoms look and feel as real anatomical objects. Additional visualization of internal anatomical and physiological information and sound generated during the interaction with the phantom yield a multimodal approach that can increase performance, didactic value, and immersion into the virtual environment. Compared to classical approaches, this multimodal display is convenient to use, provides realistic tactile properties, and can be partly adjusted to different, e.g., pathological properties. The interactive phantom is exemplified by a virtual human knee joint that can support orthopedic education, especially for the training of clinical knee joint evaluation. It is suggested that the technical principle can be transferred to many other fields of medical education and training such as obstetrics and dentistry. KW - Munich knee joint simulator. KW - VR. KW - Acoustic display. KW - Animation. KW - Biomechanics. KW - Clinical knee joint evaluation. KW - Dentistry. KW - Didactic value. KW - Graphical display. KW - Haptic contact information. KW - Internal anatomical information. KW - Mechanical actuator. KW - Medical education. KW - Medical training. KW - Multimodal display. KW - Multimodal sound approach. KW - Obstetrics. KW - Orthopedic education. KW - Pathological properties. KW - Phantom-based multimodal interaction. KW - Physiological information. KW - Realistic tactile properties. KW - Robotics. KW - Virtual human knee joint. KW - Virtual reality technologies. ER -