Document Type : Review Article
Author
Islamic Azad University- Najaf Abad
Abstract
Relevance feedback (RF) approaches are use to improve the performance of content-based image retrieval (CBIR) systems. In this paper, a RF approach based on modification of similarity measure using particle swarm optimization (PSO) in a medical X-ray image retrieval system is proposed. In this algorithm, using PSO, the significance of each feature in the similarity measure is modified to image retrieval. This modification causes that good features have major effect in relevant image retrieval. The defined fitness function in PSO uses relevant and irrelevant retrieved images with different strategies, simultaneously. The relevant and irrelevant images are used to exhort and penalize similarity measure, respectively. To evaluate, the proposed RF is integrated to a CBIR system based on semantic classification. In this system, using merging scheme in a hierarchical structure, the overlapped classes are merged together and determined search space for each query image. The proposed RF evaluated on a database consisting of 10000 medical X-ray images of 57 classes. The proposed algorithm provides the improvement, effectiveness more than the literature.
Keywords
[1] Liu Y., Zhang D., Lu G. and Ma W.Y.; “A Survey of Content-based Image Retrieval with High-level Semantics”, Pattern Recognition, Vol. 40, pp. 262-282, (2007)
[2] Shyu C., Brodley C., Kak A., Kosaka A., Aisen A. and Broderick L.; “Assert: a Physician-in-the-loop Content-Based Image Retrieval System for Hrct Image Databases”, Computer Vis. and Image Under., Vol. 75, No. 1, pp. 111-132, (1999)
[3] Lehmann T., Guld M., Thies C., Fischer B., Spitzer K., Keysers D., Ney H., Kohnen M., Schubert H. and Wein B.; “Content-based Image Retrieval in Medical Applications”, Methods Inform. Med., Vol. 43, No. 4, pp. 354-361, (2004)
[4] Antani S., Lee D.J., Long L.R. and Thoma G.R.; “Evaluation of Shape Similarity Measurement Methods for Spine X-ray Images”, J. of Vis. Comm. and Image Rep., Vol. 15, No. 3, pp. 285-302, (2004)
[5] Dy J.G., Brodley C.E., Kak A., Broderick L.S. and Aisen A.M.; “Unsupervised Feature Selection Applied to Content-based Retrieval of Lung Images”, IEEE Trans. Pattern Anal. Mach. Intell., Vol. 25, No. 3, pp. 37–378, (2003)
[6] Korn P., Sidiropoulos N., Faloutsos C., Siegel E. and Protopapas Z.; “Fast and Effective Retrieval of Medical Tumor Shapes”, IEEE Trans. Knowl. Data Eng., Vol. 10, No. 6, pp. 889-904, (1998)
[7] Yu S.N., Chianga C.T. and Hsieh C.C.; “A Three-object Model for the Similarity Searches of Chest Ct Images”, Computerized Medical Imaging and Graphics, Vol. 29, pp. 617-630, (2005)
[8] Oliveira L.L.G., Silva S.A., Ribeiro L.H.V., Oliveira R.M., Coelho C. and Andrade A.S.S.; “Computer-aided Diagnosis in Chest Radiography for Detection of Childhood Pneumonia”, Int. J. Med. Inform., Vol. 77, No. 8, pp. 555-564, (2007)
[9] Xu X., Lee D.J., Antani S. and Long L.R., “A Spine X-ray Image Retrieval System Using Partial Shape Matching”, IEEE Trans. on Information Technology in Biomedicine, Vol. 12, No. 1, pp. 100-108, (2008)
[10] Nomira O. and Abdel-Mottalebb M.; “Hierarchical Contour Matching for Dental X-ray Radiographs”, Pattern Recognition, Vol. 41, pp. 130-138, (2008)
[11] Greenspan H. and Pinhas A.T., “Medical Image Categorization and Retrieval for Pacs Using the Gmm-Kl Framework”, IEEE Trans. on Information Technology in Biomedicine, Vol. 11, No. 2, pp. 190-202, (2007)
[12] Rahman M.M., Bhattacharya P. and Desai B.C.; “A Framework for Medical Image Retrieval Using Machine Learning and Statistical Similarity Matching Techniques with Relevance Feedback”, IEEE Trans. on Inf. Tech. in Bio., Vol. 11, No. 1, pp. 58-69, (2007)
[13] Rahman M.M., Desai B.C. and Bhattacharya P., “Medical Image Retrieval with Probabilistic Multi-class Support Vector Machine Classifiers and Adaptive Similarity Fusion”, Computerized Medical Imaging and Graphics, Vol. 32, pp. 95-108, (2008)
[14] Yao J., Antani Z.S., Long R. and Thoma G., “Automatic Medical Image Annotation and Retrieval”, Neurocomputing, Vol. 71, No. 10, pp. 2012-2022, (2008)
[15] Chu W.W., Hsu C.C., Cardenas A.F. and Taira R.K.; “Knowledge-based Image Retrieval with Spatial and Temporal Constructs”, IEEE Trans. Knowl. Data Eng., Vol. 10, No. 6, pp. 872-888, (1998)
[16] Pourghassem H. and Ghassemian H.; “A Novel Hybrid Relevance Feedback Based on Euclidean Distance and Probability Function Similarity Measures in a X-ray Medical Images Retrieval System”, Proceeding of 16th Iranian Conference on Electrical Engineering, ICEE2008, Vol.1, pp. 197-202, (May 2008)
[17] Cox I.J., Miller M.L., Minka T.P., Papathomas T. and Yianilos P.N., “The Bayesian Image Retrieval System, Pichunter: Theory, Implementation, and Psychophysical Experiments”, IEEE Trans. on Image Processing, Vol. 9, No. 1, pp. 20-37, (Jan. 2000)
[18] El-Naqa, Yang Y., Galatsanos N.P., Nishikawa R.M. and Wernick M.N.; “A Similarity Learning Approach to Content-based Image Retrieval: Application to Digital Mammography”, IEEE Transactions on Medical Imaging, Vol.23, No.10, pp.1233-1244, (2004)
[19] Su Z., Zhang H., Li S. and Ma S., “Relevance Feedback in Content Based Image Retrieval Bayesian Framework Feature Subspaces, and Progressive Learning”, IEEE Trans. on Image Processing, Vol. 12, No. 8, pp. 924-937, (2003)
[20] Ves E.d., Domingo J., Ayala G. and Zuccarello P.; “A Novel Bayesian Framework for Relevance Feedback in Image Content-based Retrieval Systems”, Pattern Recognition, Vol. 39, pp. 1622-1632, (2006) Zuccarello
[21] Efron M.; “Query Expansion and Dimensionality Reduction: Notions of Optimality in Rocchio Relevance Feedback and Latent Semantic Indexing”, Information Processing and Management, Vol. 44, pp. 163–180, (2008)
[22] Lin H-C, Wang L-H and Chen S-M: “Query Expansion for Document Retrieval Based On Fuzzy Rules and User Relevance Feedback Techniques”, Expert Systems with Applications, Vol. 31, pp. 397–405, (2006)
[23] Wong W.S., Luk R.W.P., Leong H.V., Ho K.S. and Lee D.L.; “Re-examining the Effects of Adding Relevance Information in a Relevance Feedback Environment”, Information Processing and Management, Vol. 44, No. 3, pp. 1086-1116, (May 2008)
[24] Wu Y. and Zhang A., “A Feature Re-weighting Approach for Relevance Feedback in Image Retrieval”, in Proc. of IEEE Int. Conf. on Image (ICIP02), Rochester, New York, (September 2002)
[25] Carneiro G., Chan A.B., Moreno P.J. and Vasconcelos N.; “Supervised Learning of Semantic Classes for Image Annotation and Retrieval”, IEEE Trans. on Pattern Analysis and Machine Intelligence, Vol. 29, No. 3, pp. 394-410, (2007)
[26] Yoo H-W; “Retrieval of Movie Scenes by Semantic Matrix and Automatic Feature Weight Update”, Expert Systems with Applications, Vol. 34, pp. 2382–2395, (2008)
[27] Kim D-H and Yu S-H; “A New Region Filtering and Region Weighting Approach to Relevance Feedback in Content-based Image Retrieval”, The Journal of Systems and Software, Vol. 81, No. 9, pp. 1525-1538, (September 2008)
[28] Rooney N., Patterson D., Galushka M. and Dobrynin V.; “A Relevance Feedback Mechanism for Cluster-based Retrieval”, Information Processing and Management, Vol. 42, pp. 1176-1184, (2006)
[29] Cheng P-C, Chien B-C, Ke H-R and Yang W.P., “A Two-level Relevance Feedback Mechanism for Image Retrieval”, Expert Systems with Applications, Vol. 34, pp. 2193–2200, (2008)
[30] Saha S.K., Das A.K. and Chanda B.; “Image Retrieval Based on Indexing and Relevance Feedback”, Pattern Recognition Letters, Vol. 28, pp. 357–366, (2007)
[31] Qin T., Zhang X.D., Liu T.Y., Wang D.S., Mab W.Y. and Zhang H.J., “An Active Feedback Framework for Image Retrieval”, Pattern Recognition Letters, Vol. 29, pp. 637–646, (2008)
[32] Lu Y., Zhang H., Wenyin L. and Hu C.; “Joint Semantics and Feature Based Image Retrieval Using Relevance Feedback”, IEEE Trans. on Multimedia, Vol. 5, No. 3, pp. 339-347, (2003)
[33] Leona T., Zuccarellob P., Ayalaa G., deVesb E. and Domingoc J.; “Applying Logistic Regression to Relevance Feedback in Image Retrieval Systems”, Pattern Recognition, Vol. 40, pp. 2621- 2632, (2007)
[34] Pourghassem H. and Ghassemian H.; “Content-based Medical Image Classification Using a New Hierarchical Merging Scheme”, Journal of Computerized Medical Imaging and Graphics, Vol. 22, No. 8, pp.651-661, (2008)
[35] Pourghassem H. and Ghassemian H.; “Content-based Medical Classification in a Hierarchical Structure Using a New Unsupervised Clustering”, Proc. of the 13th Computer Society of Iran Computer Conf. (CSICC08), Vol. 1, pp. 78-81, (March 2008)
[36] Pourghassem H. and Ghassemian H.; “Content-based Medical Image Classification Using Spectral Features and Directional Histogram in Multi scale Space”, Proc. of Int. Conf. on Biomedical Engineering (ICBME2008), Vol. 1, pp. 124-130, (January. 2008)
[37] Kennedy J. and Eberhart R.; “Particle Swarm Optimization”, Proc. of the IEEE International Conference on Neural Networks, Perth, Australia, Vol. 4, pp. 1942–1948, (1995)
[38] Persoon E. and Fu, K. “Shape Discrimination Using Fourier Descriptors”, IEEE Trans Sys Man and Cybern., Vol. 7, pp. 170-179, (1977)
[39] Jain A.K.; Fundamentals of Digital Image Processing, Prentice Hall, NJ, (1989)
[40] Yang L. and Algregtsen F., “Fast Computation of Invariant Geometric Moments: a New Method Giving Correct Results”, Proc. IEEE ICIP, pp. 201-204, (1994)
[41] Haralick R.M., Shanmugan K., Dinstein I.; “Textural Features for Image Classification”, IEEE Trans. on Sys. Man and Cybern., Vol. 3, No. 6, pp. 610-621, (1973)
[42] Lehmann T., Guld M., Thies C., Fischer B., Spitzer K., Keysers D., Ney H., Kohnen M., Schubert H. and Wein B.B.; “Content-based Image Retrieval in Medical Applications”, Methods Inform. Med., Vol. 43, No. 4, pp. 354-361, (2004)
[43] Deselaers T., Keysers D. and Ney H.; “Classification Error Rate for Quantitative Evaluation of Content-based Image Retrieval Systems”, Proc. of the 17th Int. Conf. on Pattern Recognition, Vol. 2, pp. 505-508, (2004)
)