Access the full text.
Sign up today, get DeepDyve free for 14 days.
Nawei Chen (2006)
A Survey of Indexing and Retrieval of Multimodal Documents: Text and Images
Emilia Apostolova, D. You, Z. Xue, Sameer Antani, Dina Demner-Fushman, G. Thoma (2013)
Image retrieval from scientific publications: Text and image content processing to separate multipanel figuresJ. Assoc. Inf. Sci. Technol., 64
D. You, M. Rahman, Sameer Antani, Dina Demner-Fushman, G. Thoma (2013)
Text- and content-based biomedical image modality classification, 8674
T. Tsikrika, H. Müller, C. Kahn (2012)
Log analysis to understand medical professionals' image searching behaviour.Studies in health technology and informatics, 180
NC Ide, RF Loane, D Demner-Fushman (2007)
Essie: a concept-based search engine for structured biomedical textJ Am Med Inf Assoc, 1
Marti Hearst, A. Divoli, Harendra Guturu, Alex Ksikes, Preslav Nakov, Michael Wooldridge, Jerry Ye (2007)
BioText Search Engine: beyond abstract searchBioinformatics, 23 16
Md. Rahman, Sameer Antani, G. Thoma (2011)
A Learning-Based Similarity Fusion and Filtering Approach for Biomedical Image Retrieval Using SVM Classification and Relevance FeedbackIEEE Transactions on Information Technology in Biomedicine, 15
M. Lux, S. Chatzichristofis (2008)
Lire: lucene image retrieval: an extensible java CBIR library
D. Antin-Ozerkis, A. Rubinowitz (2008)
Recognizing lung disease in patients with rheumatoid arthritis, part 2
B. Manjunath, Wei-Ying Ma (1996)
Texture Features for Browsing and Retrieval of Image DataIEEE Trans. Pattern Anal. Mach. Intell., 18
William Hsu, Sameer Antani, L. Long, Leif Neve, G. Thoma (2009)
SPIRS: A Web-based image retrieval system for large biomedical databasesInternational journal of medical informatics, 78 Suppl 1
K. Jung, K. Kim, Anil Jain (2003)
Information Extraction in Images and Video : A Survey
Mark Smucker, James Allan, Ben Carterette (2007)
A comparison of statistical significance tests for information retrieval evaluation
L. Seyfried, D. Hanauer, D. Nease, R. Albeiruti, J. Kavanagh, H. Kales (2009)
Enhanced identification of eligibility for depression research using an electronic medical record search engineInternational journal of medical informatics, 78 12
M. Hall, E. Frank, G. Holmes, B. Pfahringer, P. Reutemann, I. Witten (2009)
The WEKA data mining software: an updateSIGKDD Explor., 11
D. Lowe (2004)
Distinctive Image Features from Scale-Invariant KeypointsInternational Journal of Computer Vision, 60
Ian Soboroff (2005)
Overview of the TREC 2004 Novelty Track.
Matthew Simpson, M. Rahman, S. Phadnis, Emilia Apostolova, Dina Demner-Fushman, Sameer Antani, G. Thoma (2011)
Text and Content-based Approaches to Image Modality Classification and Retrieval for the ImageCLEF 2011 Medical Retrieval Track
(1999)
Modern Information Retrieval
Dina Demner-Fushman, Sameer Antani, Matthew Simpson, G. Thoma (2009)
Annotation and retrieval of clinically relevant imagesInternational journal of medical informatics, 78 12
Shih-Fu Chang, T. Sikora, Atul Puri (2001)
Overview of the MPEG-7 standardIEEE Trans. Circuits Syst. Video Technol., 11
Songhua Xu, Jamie McCusker, M. Krauthammer (2008)
Yale Image Finder (YIF): a new search engine for retrieving biomedical imagesBioinformatics, 24 17
Yuhai Wu (2021)
Statistical Learning TheoryTechnometrics, 41
J. Lee (1995)
Combining multiple evidence from different properties of weighting schemes
Matthew Simpson, D. You, M. Rahman, Dina Demner-Fushman, Sameer Antani, G. Thoma (2012)
ITI's Participation in the ImageCLEF 2012 Medical Retrieval and Classification Tasks
T. Lehmann, M. Güld, Thomas Deselaers, Daniel Keysers, H. Schubert, K. Spitzer, H. Ney, B. Wein (2005)
Automatic categorization of medical images for content-based retrieval and data mining.Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society, 29 2-3
E. Fox, Joseph Shaw (1993)
Combination of Multiple Searches
W. Hersh, A. Cohen, Jianji Yang, Ravi Bhupatiraju, Phoebe Roberts, Marti Hearst (2005)
TREC 2004 Genomics Track Overview
C. Shyu, C. Brodley, A. Kak, A. Kosaka, A. Aisen, L. Broderick (1999)
ASSERT: A Physician-in-the-Loop Content-Based Retrieval System for HRCT Image DatabasesComput. Vis. Image Underst., 75
H. Müller, A. Herrera, Jayashree Kalpathy-Cramer, Dina Demner-Fushman, Sameer Antani, Ivan Eggel (2012)
Overview of the ImageCLEF 2012 Medical Image Retrieval and Classification Tasks
Matthew Simpson, Md. Rahman, Sachin Singhal, Dina Demner-Fushman, Sameer Antani, G. Thoma (2010)
Text- and Content-based Approaches to Image Modality Detection and Retrieval for the ImageCLEF 2010 Medical Retrieval Track
H. Müller, Jayashree Kalpathy-Cramer, Dina Demner-Fushman, Sameer Antani (2012)
Creating a classification of image types in the medical literature for visual categorization, 8319
Nicholas Ide, R. Loane, Dina Demner-Fushman (2007)
Application of Information Technology: Essie: A Concept-based Search Engine for Structured Biomedical TextJ. Am. Medical Informatics Assoc., 14
BS Manjunath, WY Ma (1996)
Texture features for browsing and retrieval of large image dataIEEE Trans Pattern Anal Mach Intell (Special Issue on Digital Libraries), 18
R. Datta, Dhiraj Joshi, Jia Li, James Wang (2008)
Image retrieval: Ideas, influences, and trends of the new ageACM Comput. Surv., 40
Jayashree Kalpathy-Cramer, H. Müller, Steven Bedrick, Ivan Eggel, A. Herrera, T. Tsikrika (2011)
Overview of the CLEF 2011 Medical Image Classification and Retrieval Tasks, 1177
C. Shyu, C. Brodley, A. Kak (1999)
ASSERT: A PHYSICIAN-IN-THE-LOOP CONTENT-BASED IMAGE RETRIEVAL SYSTEM FOR HRCT IMAGE DATABASES, 75
D Antin-Ozerkis, A Rubinowitz (2008)
Recognizing lung disease in patients with rheumatoid arthritis. Part 2: pleuropulmonary disease may be more common than you thoughtJ Respir Dis, 29
H. Müller, Jayashree Kalpathy-Cramer, Ivan Eggel, Steven Bedrick, Joe Reisetter, C. Kahn, W. Hersh (2009)
Overview of the CLEF 2009 Medical Image Retrieval Track
P. Ingwersen (1996)
Cognitive Perspectives of Information Retrieval Interaction: Elements of a Cognitive IR TheoryJ. Documentation, 52
Dina Demner-Fushman, Sameer Antani, Matthew Simpson, G. Thoma (2012)
Design and Development of a Multimodal Biomedical Information Retrieval SystemJ. Comput. Sci. Eng., 6
(2008)
Rubinowitz A (2008) Recognizing lung disease in patients with rheumatoid arthritis. Part 2: pleuropulmonary disease may be more common than you thought
Renzo Angles, Claudio Gutiérrez (2008)
Survey of graph database modelsACM Comput. Surv., 40
Topi Mäenpää (2003)
The local binary pattern approach to texture analysis - extensions and applications
Images are frequently used in articles to convey essential information in context with correlated text. However, searching images in a task-specific way poses significant challenges. To minimize limitations of low-level feature representations in content-based image retrieval (CBIR), and to complement text-based search, we propose a multi-modal image search approach that exploits hierarchical organization of modalities and employs both intra and inter-modality fusion techniques. For the CBIR search, several visual features were extracted to represent the images. Modality-specific information was used for similarity fusion and selection of a relevant image subset. Intra-modality fusion of retrieval results was performed by searching images for specific informational elements. Our methods use text extracted from relevant components in a document to create structured representations as “enriched citations” for the text-based search approach. Finally, the multi-modal search consists of a weighted linear combination of similarity scores of independent output results from textual and visual search approaches (inter modality). Search results were evaluated using a standard ImageCLEFmed 2012 evaluation dataset of 300,000 images with associated annotations. We achieved a mean average precision (MAP) score of 0.2533, which is statistically significant, and better in performance (7 % improvement) over comparable results in ImageCLEFmed 2012.
International Journal of Multimedia Information Retrieval – Springer Journals
Published: Jul 4, 2013
Read and print from thousands of top scholarly journals.
Already have an account? Log in
Bookmark this article. You can see your Bookmarks on your DeepDyve Library.
To save an article, log in first, or sign up for a DeepDyve account if you don’t already have one.
Copy and paste the desired citation format or use the link below to download a file formatted for EndNote
Access the full text.
Sign up today, get DeepDyve free for 14 days.
All DeepDyve websites use cookies to improve your online experience. They were placed on your computer when you launched this website. You can change your cookie settings through your browser.