Active learning methods for interactive image retrieval

Aus de_evolutionary_art_org
Wechseln zu: Navigation, Suche


P. Gosselin and M. Cord: Active learning methods for interactive image retrieval. Image Processing, IEEE Transactions on, 17(7):1200-1211, july 2008.



Active learning methods have been considered with increased interest in the statistical learning community. Initially developed within a classification framework, a lot of extension are now being proposed to handle multimedia applications. This paper provides algorithms within a statistical framework to extend active learning for online content-based image retrieval (CBIR). The classification framework is presented with experiments to compare several powerful classification techniques in this information retrieval context. Focusing on interactive methods, active learning strategy is then described. The limitations of this approach for CBIR are emphasized before presenting our new active selection process RETIN. First, as any active method is sensitive to the boundary estimation between classes, the RETIN strategy carries out a boundary correction to make the retrieval process more robust. Second, the criterion of generalization error to optimize the active learning selection is modified to better represent the CBIR objective of database ranking. Third, a batch processing of images is proposed. Our strategy leads to a fast and efficient active learning scheme to retrieve sets of online images (query concept). Experiments on large databases show that the RETIN method performs well in comparison to several other active strategies.

Extended Abstract


author = {Gosselin, P. H. and Cord, M.},
title = {Active Learning Methods for Interactive Image Retrieval},
journal = {Trans. Img. Proc.},
issue_date = {July 2008},
volume = {17},
number = {7},
month = jul,
year = {2008},
issn = {1057-7149},
pages = {1200--1211},
numpages = {12},
url = {},
doi = {10.1109/TIP.2008.924286},
acmid = {2321611},
publisher = {IEEE Press},
address = {Piscataway, NJ, USA},

Used References

[1] R. Veltkamp, “Content-based image retrieval system: A survey,” University of Utrecht, Tech. Rep., 2002.

[2] Y. Rui, T. Huang, S. Mehrotra, and M. Ortega, “A relevance feedback architecture for content-based multimedia information retrieval systems,” in IEEE Workshop on Content-Based Access of Image and Video Libraries, 1997, pp. 92–89.

[3] E. Chang, B. T. Li, G. Wu, and K. Goh, “Statistical learning for effective visual information retrieval,” in IEEE International Conference on Image Processing, Barcelona, Spain, September 2003, pp. 609–612.

[4] S. Aksoy, R. Haralick, F. Cheikh, and M. Gabbouj, “A weighted distance approach to relevance feedback,” in IAPR International Conference on Pattern Recognition, vol. IV, Barcelona, Spain, September, 3-8 2000, pp. 812–815.

[5] J. Peng, B. Bhanu, and S. Qing, “Probabilistic feature relevance learning for content-based image retrieval,” Computer Vision and Image Understanding, vol. 75, no. 1-2, pp. 150–164, July-August 1999.

[6] N. Doulamis and A. Doulamis, “A recursive optimal relevance feedback scheme for cbir,” in International Conference in Image Processing (ICIP’01), Thessaloniki, Greece, October 2001.

[7] J. Fournier, M. Cord, and S. Philipp-Foliguet, “Back-propagation algorithm for relevance feedback in image retrieval,” in International Conference in Image Processing (ICIP’01), vol. 1, Thessaloniki, Greece, October 2001, pp. 686–689.

[8] O. Chapelle, P. Haffner, and V. Vapnik, “Svms for histogram based image classification,” IEEE Transactions on Neural Networks, vol. 10, pp. 1055–1064, 1999.

[9] N. Vasconcelos, “Bayesian models for visual information retrieval,” Ph.D. dissertation, Massachusetts Institute of Technology, 2000.

[10] S.-A. Berrani, L. Amsaleg, and P. Gros, “Recherche approximative de plus proches voisins : application la reconnaissance d’images par descripteurs locaux,” Technique et Science Informatiques, pp. 22(9):1201– 1230, 2003.

[11] N. Najjar, J. Cocquerez, and C. Ambroise, “Feature selection for semi supervised learning applied to image retrieval,” in IEEE ICIP, vol. 2, Barcelena, Spain, Sept. 2003, pp. 559–562.

[12] X. Zhu, Z. Ghahramani, and J. Lafferty, “Semi-supervised learning using gaussian fields and harmonic functions,” in International Conference on Machine Learning, 2003.

[13] A. Dong and B. Bhanu, “Active concept learning in image databases,” IEEE Transactions on Systems, Man, and Cybernetics – Part B: Cybernetics, vol. 35, pp. 450–466, 2005.

[14] N. Vasconcelos and M. Kunt, “Content-based retrieval from image databases: current solutions and future directions,” in International Conference on Image Processing, vol. 3, Thessaloniki, Greece, October 2001, pp. 6–9.

[15] Y. Chen, X. Zhou, and T. Huang, “One-class svm for learning in image retrieval,” in International Conference in Image Processing (ICIP), vol. 1, Thessaloniki, Greece, October 2001, pp. 34–37.

[16] S.-A. Berrani, L. Amsaleg, and P. Gros, “Approximate searches: kneighbors + precision,” in International Conference on Information and Knowledge Management, 2003, pp. 24–31.

[17] V. Vapnik, Statistical Learning Theory. Wiley-Interscience, New York, 1998.

[18] S. Tong and D. Koller, “Support vector machine active learning with application to text classification,” Journal of Machine Learning Research, pp. 2:45–66, November 2001.

[19] S. Mika, G. R¨atsch, J. Weston, B. Sch¨olkopf, and K.-R. M¨uller, “Fisher discriminant analysis with kernels,” in Neural Networks for Signal Processing IX, Y.-H. Hu, J. Larsen, E. Wilson, and S. Douglas, Eds. IEEE, 1999, pp. 41–48. [Online]. Available:

[20] B. Sch¨olkopf and A. Smola, Learning with Kernels. MIT Press, Cambridge, MA, 2002.

[21] P. Yin, B. Bhanu, K. Chang, and A. Dong, “Integrating relevance feedback techniques for image retrieval using reinforcement learning,” IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 27, pp. 1536–1551, October 2005.

[22] J. Shawe-Taylor and N. Cristianini, Kernel methods for Pattern Analysis. Cambridge University Press, ISBN 0-521-81397-2, 2004.

[23] T. Joachims, “Transductive inference for text classification using support vector machines,” in Proc. 16th International Conference on Machine Learning. Morgan Kaufmann, San Francisco, CA, 1999, pp. 200–209.

[24] P. Gosselin, M. Najjar, M. Cord, and C. Ambroise, “Discriminative classification vs modeling methods in CBIR,” in IEEE Advanced Concepts for Intelligent Vision Systems (ACIVS), Brussel, Belgium, September 2004.

[25] P. Gosselin and M. Cord, “RETIN AL: An active learning strategy for image category retrieval,” in IEEE International Conference on Image Processing, vol. 4, Singapore, October 2004, pp. 2219–2222.

[26] N. Roy and A. McCallum, “Toward optimal active learning through sampling estimation of error reduction,” in International Conference on Machine Learning, 2001.

[27] D. Cohn, “Active learning with statistical models,” Journal of Artificial Intelligence Research, vol. 4, pp. 129–145, 1996.

[28] D. D. Lewis and J. Catlett, “Heterogeneous uncertainly sampling for supervised learning,” in International Conference on Machine Learning. W.W. Cohen and H. Hirsh, editors, July 1994, pp. 148–56.

[29] J. M. Park, “Online learning by active sampling using orthogonal decision support vectors,” in IEEE Workshop on Neural Networks for Signal Processing, vol. 77, no. 3, December 2000, pp. 263–283.

[30] M. Lindenbaum, S. Markovitch, and D. Rusakov, “Selective sampling for nearest neighbor classifiers,” Machine Learning, pp. 54(2):125–152, February 2004.

[31] I. Cox, M. Miller, T. Minka, T. Papathomas, and P. Yianilos, “The bayesian image retrieval system, PicHunter: Theory, implementation and psychophysical experiments,” IEEE Transactions on Image Processing, vol. 9, no. 1, pp. 20–37, 2000.

[32] D. Geman and R. Moquet, “A stochastic feedback model for image retrieval,” in RFIA’2000, vol. III, Paris, France, February 2000, pp. 173– 180.

[33] S. Tong and E. Chang, “Support vector machine active learning for image retrieval,” in ACM Multimedia, 2001, pp. 107–118.

[34] P. Gosselin and M. Cord, “A comparison of active classification methods for content-based image retrieval,” in International Workshop on Computer Vision meets Databases (CVDB), ACM Sigmod, Paris, France, June 2004.

[35] M. Cord, P. Gosselin, and S. Philipp-Foliguet, “Stochastic exploration and active learning for image retrieval,” Image and Vision Computing, vol. 25, pp. 14–23, 2006.

[36] K. Brinker, “Incorporating diversity in active learning with support vector machines,” in International Conference on Machine Learning, February 2003, pp. 59–66.

[37] “TREC Video Retrieval Evaluation Campain,” http://wwwnlpir.


Full Text

internal file

Sonstige Links