A Framework for Extensive Content-Based Image Retrieval System Incorporating Relevance Feedback and Query Suggestion

Authors

  • Rabia Younas Department of Information Technology, Faculty of Computer Science, Lahore Garrison University, Lahore, Pakistan Author
  • Hafiz Burhan Ul Haq Department of Information Technology, Faculty of Computer Science, Lahore Garrison University, Lahore, Pakistan Author
  • Muhammad Daniyal Baig Department of Cyber and Applied Computing, University of Gloucestershire, GL50 2RH Gloucestershire, United Kingdom Author

DOI:

https://doi.org/10.31181/sor1120242

Keywords:

Relevance Feedback, Content Based Image Retrieval, Random Walker

Abstract

Over the last decade, there has been a huge number of images in which visual information has become increasingly important. If the images are to be utilized, they must be organized into databases, from there they can be searched based on different criteria. Content-based Image retrieval (CBIR) frameworks have turned into a mainstream subject of exploration; for their ability to retrieve images based on the real visual content rather than by manually connected textual descriptions. In the CBIR framework, analysis and interpretation of image information in large and diverse image databases is evidently complex because there is no prior information on the size or scale of individual structures within the images to be analyzed. In CBIR, retrieval is based on visual image features, which can be extracted automatically from the images with the help of human intervention, namely a technique called relevance feedback. Nonetheless, efficient ways of differentiating the visual content of images are complex to produce. Therefore, rather than a perfect solution CBIR systems must be able to exploit a partial solution to the problem of image understanding. In this paper, there is implementation of a CBIR framework is introduced that not only tries to efficiently capture the user intent based on the feedback but also provides query suggestions that can help its users to pose better queries to retrieve desired results efficiently. The proposed technique is straightforward to implement and scope efficiently to huge datasets. Extensive experiments on diverse real datasets with image similarity measures have revealed the dominance of the proposed method over original algorithms.

Downloads

Download data is not yet available.

References

Oliva, A., & Torralba, A. (2001). Modeling the shape of the scene: A holistic representation of the spatial envelope. International journal of computer vision, 42, 145-175. https://doi.org/10.1023/A:1011139631724

Hamzaoui, A., Letessier, P., Joly, A., Buisson, O., & Boujemaa, N. (2014). Object-based visual query suggestion. Multimedia tools and applications, 68, 429-454. https://doi.org/10.1007/s11042-012-1340-5

Böhm, C., Berchtold, S., & Keim, D. A. (2001). Searching in high-dimensional spaces: Index structures for improving the performance of multimedia databases. ACM Computing Surveys (CSUR), 33(3), 322-373. https://doi.org/10.1145/502807.502809

Flickner, M., Sawhney, H., Niblack, W., Ashley, J., Huang, Q., Dom, B., Gorkani, M., Hafner, J., Lee, D., Petkovic, D., Steele, D., & Yanker, P. (1995). Query by image and video content: The QBIC system. computer, 28(9), 23-32. https://doi.org/10.1109/2.410146

Griffin, G., Holub, A., & Perona, P. (2007). Caltech-256 object category dataset (Vol. 10). Pasadena: Technical Report 7694, California Institute of Technology.

Wang, J. Z., Li, J., & Wiederhold, G. (2001). SIMPLIcity: Semantics-sensitive integrated matching for picture libraries. IEEE Transactions on pattern analysis and machine intelligence, 23(9), 947-963. https://doi.org/10.1109/34.955109

Guan, J., & Qiu, G. (2007). Modeling user feedback using a hierarchical graphical model for interactive image retrieval. In Advances in Multimedia Information Processing–PCM 2007: 8th Pacific Rim Conference on Multimedia, Hong Kong, China, December 11-14, 2007. Proceedings 8 (pp. 18-29). Springer Berlin Heidelberg. https://doi.org/10.1007/978-3-540-77255-2_3

He, J., Li, M., Zhang, H. J., Tong, H., & Zhang, C. (2004). Manifold-ranking based image retrieval. In Proceedings of the 12th annual ACM international conference on Multimedia (pp. 9-16). https://doi.org/10.1109/TIP.2006.877491

Niblack, C. W., Barber, R., Equitz, W., Flickner, M. D., Glasman, E. H., Petkovic, D., Yanker, P., Faloutsos, C., & Taubin, G. (1993). QBIC project: querying images by content, using color, texture, and shape. In Storage and retrieval for image and video databases (Vol. 1908, pp. 173-187). Spie. https://doi.org/10.1117/12.143648

Auer, P., Hussain, Z., Kaski, S., Klami, A., Kujala, J., Laaksonen, J., Leung, A. P., Pasupa, K., & Shawe-Taylor, J. (2010). Pinview: Implicit feedback in content-based image retrieval. In Proceedings of the First Workshop on Applications of Pattern Analysis (pp. 51-57). PMLR.

Bach, J. R., Fuller, C., Gupta, A., Hampapur, A., Horowitz, B., Humphrey, R., Jain, R. C., & Shu, C. F. (1996). Virage image search engine: an open framework for image management. In Storage and retrieval for still image and video databases IV (Vol. 2670, pp. 76-87). SPIE. https://doi.org/10.1117/12.234785

Bulo, S. R., Rabbi, M., & Pelillo, M. (2011). Content-based image retrieval with relevance feedback using random walks. Pattern Recognition, 44(9), 2109-2122. https://doi.org/10.1016/j.patcog.2011.03.016

Haq, H. B. U., & Saqlain, M. (2023). Iris detection for attendance monitoring in educational institutes amidst a pandemic: A machine learning approach. Journal of industrial intelligence, 1(3), 136-147. https://doi.org/10.56578 /jii010301

Baig, D., Akram, W., Haq, H. B. U., & Asif, M. (2022). Cloud gaming approach to learn programming concepts. Artificial Intelligence and Applications. https://doi.org/10.47852/bonviewAIA32021378

Nawaz, S. (2023). Cloud computing services and security challenges: A review. Lahore Garrison University Research Journal of Computer Science and Information Technology, 7(2), 17-28. https://doi.org/10.54692/lgurjcsit.2023.0702459

Li, Y., Geng, B., Tao, D., Zha, Z. J., Yang, L., & Xu, C. (2012). Difficulty guided image retrieval using linear multiple feature embedding. IEEE Transactions on Multimedia, 14(6), 1618-1630. https://doi.org/10.1109/TMM.2012.2199292

Kim, W. C., Song, J. Y., Kim, S. W., & Park, S. (2008). Image retrieval model based on weighted visual features determined by relevance feedback. Information Sciences, 178(22), 4301-4313. https://doi.org/10.1016/j.ins.2008.06.025

Ul Haq, H. B., & Saqlain, M. (2023). An implementation of effective machine learning approaches to perform sybil attack detection (SAD) in IoT network. Theoretical and applied computational intelligence, 1(1), 1-14. https://doi.org/10.31181/taci1120232

Zhang, J. (2011). Robust content-based image retrieval of multi-example queries. http://ro.uow.edu.au/theses/3222

Zhou, Z. H., Chen, K. J., & Dai, H. B. (2006). Enhancing relevance feedback in image retrieval using unlabeled data. ACM Transactions on Information Systems (TOIS), 24(2), 219-244. https://doi.org/10.1145/1148020.1148023

Published

2024-07-27

How to Cite

Younas, R., Ul Haq, H. B., & Baig, M. D. (2024). A Framework for Extensive Content-Based Image Retrieval System Incorporating Relevance Feedback and Query Suggestion. Spectrum of Operational Research, 1(1), 13-32. https://doi.org/10.31181/sor1120242