A Framework to Visualize and Interact with Multimodal Medical Images

Abstract

The simultaneous use of images obtained from different sources is common in medical diagnosis. However, even though the quality of these images has been improving, the integration of multimodality data into a unique 3D representation is still non-trivial. To overcome this problem, multimodal visualization techniques provide better insight by finding suitable strategies to integrate different characteristics of multiple data sets into a single visual representation. This paper describes a framework for interactive multimodal visualization of 3D medical images, focusing on the multimodal visualization model and requirements for developing such systems. A short overview of multimodal visualization systems and techniques is also presented.