| | |
Summary: A Model of Multimodal Fusion for Medical Applications
S. Yang1
, I. Atmosukarto1
, J. Franklin2
, J. F. Brinkley2
, D. Suciu1
, and L. G. Shapiro1
1
Dept. of Computer Science & Engineering, University of Washington, Seattle, WA 98195
2
Dept. of Biological Structure, University of Washington, Seattle, WA 98195
ABSTRACT
Content-based image retrieval has been applied to many different biomedical applications1
. In almost all cases, retrievals
involve a single query image of a particular modality and retrieved images are from this same modality. For example,
one system may retrieve color images from eye exams, while another retrieves fMRI images of the brain. Yet real
patients often have had tests from multiple different modalities, and retrievals based on more than one modality could
provide information that single modality searches fail to see. In this paper, we show medical image retrieval for two
different single modalities and propose a model for multimodal fusion that will lead to improved capabilities for
physicians and biomedical researchers. We describe a graphical user interface for multimodal retrieval that is being
|
