A Framework for Extensive Content-Based Image Retrieval System Incorporating Relevance Feedback and Query Suggestion

Authors

DOI:

https://doi.org/10.31181/sor1120242

Keywords:

Relevance Feedback, Content Based Image Retrieval, Random Walker

Abstract

Over the last decade, there has been a huge increase in the number of images, in which visual information has become increasingly important. If images are to be utilized, they must be organized into databases, from which they can be searched based on different criteria. Content-Based Image Retrieval (CBIR) frameworks have become a mainstream subject of research due to their ability to retrieve images based on actual visual content rather than manually assigned textual descriptions. In the CBIR framework, the analysis and interpretation of image information in large and diverse image databases are evidently complex because there is no prior information about the size or scale of individual structures within the images to be analyzed. In CBIR, retrieval is based on visual image features, which can be extracted automatically from images with the help of human intervention through a technique known as relevance feedback. Nonetheless, efficient methods for differentiating the visual content of images are complex to develop. Therefore, rather than providing a perfect solution, CBIR systems must be able to exploit partial solutions to the problem of image understanding. In this paper, an implementation of a CBIR framework is introduced that not only attempts to efficiently capture user intent based on feedback but also provides query suggestions that help users formulate better queries to retrieve desired results efficiently. The proposed technique is straightforward to implement and scales efficiently to large datasets. Extensive experiments on diverse real-world datasets using image similarity measures have revealed the superiority of the proposed method over existing algorithms.

Downloads

Download data is not yet available.

References

Oliva, A., & Torralba, A. (2001). Modeling the shape of the scene: A holistic representation of the spatial envelope. International journal of computer vision, 42, 145-175. https://doi.org/10.1023/A:1011139631724

Hamzaoui, A., Letessier, P., Joly, A., Buisson, O., & Boujemaa, N. (2014). Object-based visual query suggestion. Multimedia tools and applications, 68, 429-454. https://doi.org/10.1007/s11042-012-1340-5

Böhm, C., Berchtold, S., & Keim, D. A. (2001). Searching in high-dimensional spaces: Index structures for improving the performance of multimedia databases. ACM Computing Surveys (CSUR), 33(3), 322-373. https://doi.org/10.1145/502807.502809

Flickner, M., Sawhney, H., Niblack, W., Ashley, J., Huang, Q., Dom, B., Gorkani, M., Hafner, J., Lee, D., Petkovic, D., Steele, D., & Yanker, P. (1995). Query by image and video content: The QBIC system. computer, 28(9), 23-32. https://doi.org/10.1109/2.410146

Griffin, G., Holub, A., & Perona, P. (2007). Caltech-256 object category dataset (Vol. 10). Pasadena: Technical Report 7694, California Institute of Technology.

Wang, J. Z., Li, J., & Wiederhold, G. (2001). SIMPLIcity: Semantics-sensitive integrated matching for picture libraries. IEEE Transactions on pattern analysis and machine intelligence, 23(9), 947-963. https://doi.org/10.1109/34.955109

Guan, J., & Qiu, G. (2007). Modeling user feedback using a hierarchical graphical model for interactive image retrieval. In Advances in Multimedia Information Processing–PCM 2007: 8th Pacific Rim Conference on Multimedia, Hong Kong, China, December 11-14, 2007. Proceedings 8 (pp. 18-29). Springer Berlin Heidelberg. https://doi.org/10.1007/978-3-540-77255-2_3

He, J., Li, M., Zhang, H. J., Tong, H., & Zhang, C. (2004). Manifold-ranking based image retrieval. In Proceedings of the 12th annual ACM international conference on Multimedia (pp. 9-16). https://doi.org/10.1109/TIP.2006.877491

Niblack, C. W., Barber, R., Equitz, W., Flickner, M. D., Glasman, E. H., Petkovic, D., Yanker, P., Faloutsos, C., & Taubin, G. (1993). QBIC project: querying images by content, using color, texture, and shape. In Storage and retrieval for image and video databases (Vol. 1908, pp. 173-187). Spie. https://doi.org/10.1117/12.143648

Auer, P., Hussain, Z., Kaski, S., Klami, A., Kujala, J., Laaksonen, J., Leung, A. P., Pasupa, K., & Shawe-Taylor, J. (2010). Pinview: Implicit feedback in content-based image retrieval. In Proceedings of the First Workshop on Applications of Pattern Analysis (pp. 51-57). PMLR.

Bach, J. R., Fuller, C., Gupta, A., Hampapur, A., Horowitz, B., Humphrey, R., Jain, R. C., & Shu, C. F. (1996). Virage image search engine: an open framework for image management. In Storage and retrieval for still image and video databases IV (Vol. 2670, pp. 76-87). SPIE. https://doi.org/10.1117/12.234785

Bulo, S. R., Rabbi, M., & Pelillo, M. (2011). Content-based image retrieval with relevance feedback using random walks. Pattern Recognition, 44(9), 2109-2122. https://doi.org/10.1016/j.patcog.2011.03.016

Haq, H. B. U., & Saqlain, M. (2023). Iris detection for attendance monitoring in educational institutes amidst a pandemic: A machine learning approach. Journal of industrial intelligence, 1(3), 136-147. https://doi.org/10.56578 /jii010301

Baig, D., Akram, W., Haq, H. B. U., & Asif, M. (2022). Cloud gaming approach to learn programming concepts. Artificial Intelligence and Applications. https://doi.org/10.47852/bonviewAIA32021378

Nawaz, S. (2023). Cloud computing services and security challenges: A review. Lahore Garrison University Research Journal of Computer Science and Information Technology, 7(2), 17-28. https://doi.org/10.54692/lgurjcsit.2023.0702459

Li, Y., Geng, B., Tao, D., Zha, Z. J., Yang, L., & Xu, C. (2012). Difficulty guided image retrieval using linear multiple feature embedding. IEEE Transactions on Multimedia, 14(6), 1618-1630. https://doi.org/10.1109/TMM.2012.2199292

Kim, W. C., Song, J. Y., Kim, S. W., & Park, S. (2008). Image retrieval model based on weighted visual features determined by relevance feedback. Information Sciences, 178(22), 4301-4313. https://doi.org/10.1016/j.ins.2008.06.025

Ul Haq, H. B., & Saqlain, M. (2023). An implementation of effective machine learning approaches to perform sybil attack detection (SAD) in IoT network. Theoretical and applied computational intelligence, 1(1), 1-14. https://doi.org/10.31181/taci1120232

Zhang, J. (2011). Robust content-based image retrieval of multi-example queries. http://ro.uow.edu.au/theses/3222

Zhou, Z. H., Chen, K. J., & Dai, H. B. (2006). Enhancing relevance feedback in image retrieval using unlabeled data. ACM Transactions on Information Systems (TOIS), 24(2), 219-244. https://doi.org/10.1145/1148020.1148023

Published

2024-07-27

How to Cite

Younas, R., Ul Haq, H. B., & Baig, M. D. (2024). A Framework for Extensive Content-Based Image Retrieval System Incorporating Relevance Feedback and Query Suggestion. Spectrum of Operational Research, 1(1), 13-32. https://doi.org/10.31181/sor1120242