Automatic feature extraction and image classification using genetic programming

Aus de_evolutionary_art_org
Wechseln zu: Navigation, Suche


Harith Al-Sahaf and Kourosh Neshatian and Mengjie Zhang: Automatic feature extraction and image classification using genetic programming. 5th International Conference on Automation, Robotics and Applications (ICARA 2011), pp. 157-162, 6-8 December 2011.



In this paper, we propose a multilayer domain-independent GP-based approach to feature extraction and image classification. We propose two different structures for the system and compare the results with a baseline approach in which domain-specific pre-extracted features are used for classification. In the baseline approach, human/domain expert intervention is required to perform the task of feature extraction. The proposed approach, however, extracts (evolves) features and generates classifiers all automatically in one loop. The experiments are conducted on four image data sets. The results show that the proposed approach can achieve better performance compared to the baseline while removing the human from the loop.

Extended Abstract


Used References

D. Atkins, K. Neshatian, and M. Zhang, "A domain independent genetic programming approach to automatic feature extraction for image classification, " in IEEE Congress on Evolutionary Computation, 2011, pp. 5-8.

P. G. Espejo, S. Ventura, and F. Herrera, "A survey on the application of genetic programming to classification, " IEEE Transactions on Systems, Man, and Cybernetics, Part C, vol. 40, no. 2, pp. 121-144, 2010.

Z. Pan, A. G. Rust, and H. Bolouri, "Image redundancy reduction for neural network classification using discrete cosine transforms, " in IJCNN (3), 2000, pp. 149-154.

R. Poli, W. B. Langdon, and N. F. McPhee, A Field Guide to Genetic Programming., 2008.

T. Hiroyasu, S. Fujita, A. Watanabe, M. Miki, M. Ogura, and M. Fukumoto, "Comparison of gp and sap in the image-processing filter construction using pathology images, " in Image and Signal Processing (CISP), 2010 3rd International Congress on, vol. 2, 2010, pp. 904-908.

J. Heaton, Introduction to Neural Networks with Java, 2nd ed. Heaton Research Inc., 2008.

M. Zhang and M. Lett, "Genetic programming for object detection: Improving fitness functions and optimising training data, " IEEE Intelligent Informatics Bulletin, vol. 7, no. 1, pp. 12-21, 2006.

Y. Lin and B. Bhanu, "Object detection via feature synthesis using mdl-based genetic programming, " IEEE Transactions on Systems, Man, and Cybernetics, Part B, vol. 35, no. 3, pp. 538-547, 2005.

J. Sherrah, R. E. Bogner, and A. Bouzerdoum, "Automatic selection of features for classification using genetic programming, " in ANZIIS, 1996, pp. 284-287.

T. Kowaliw, W. Banzhaf, N. N. Kharma, and S. Harding, "Evolving novel image features using genetic programming-based image transforms, " in IEEE Congress on Evolutionary Computation, 2009, pp. 2502-2507.

W. A. Tackett, "Genetic programming for feature discovery and image discrimination, " in ICGA, 1993, pp. 303-311.

W. R. Smart and M. Zhang, "Classification strategies for image classification in genetic programming, " in Proceeding of Image and Vision Computing Conference, 2003, pp. 402-407.

H. Guo and A. K. Nandi, "Breast cancer diagnosis using genetic programming generated feature, " Pattern Recognition, vol. 39, no. 5, pp. 980-987, 2006.

M. G. Smith and L. Bull, "Genetic programming with a genetic algorithm for feature construction and selection, " Genetic Programming and Evolvable Machines, vol. 6, no. 3, pp. 265-281, 2005.

J. Sherrah, R. E. Bogner, and A. Bouzerdoum, "Automatic selection of features for classification using genetic programming, " in ANZIIS, 1996, pp. 284-287.

J. J. Szymanski, S. P. Brumby, P. Pope, D. Eads, D. Esch-Mosher, M. Galassi, N. R. Harvey, H. D. W. McCulloch, S. J. Perkins, R. Porter, J. Theiler, A. C. Young, J. J. Bloch, and N. David, "Feature extraction from multiple data sources using genetic programming, " in Algorithms and Technologies for Multispectral, Hyperspectral, and Ultraspectral Imagery VIII, ser. SPIE, S. S. Shen and P. E. Lewis, Eds., vol. 4725, August 2002, pp. 338-345. [Online]. Available:

Y. Zhang and P. Rockett, "A generic optimising feature extraction method using multiobjective genetic programming, " Appl. Soft Comput., vol. 11, no. 1, pp. 1087-1097, 2011.

B. T. Lam and V. Ciesielski, "Discovery of human-competitive image texture feature extraction programs using genetic programming, " in GECCO (2), 2004, pp. 1114-1125.

S. A. Stanhope and J. M. Daida, "Genetic programming for automatic target classification and recognition in synthetic aperture radar imagery, " in Evolutionary Programming VII: Proceedings of the Seventh Annual Conference on Evolutionary Programming, ser. LNCS, V. W. Porto, N. Saravanan, D. Waagen, and A. E. Eiben, Eds., vol. 1447. Mission Valley Marriott, San Diego, California, USA: Springer-Verlag, 25-27 March 1998, pp. 735-744.

O. Oechsle and A. F. Clark, "Feature extraction and classification by genetic programming, " in ICVS, 2008, pp. 131-140.

Y. Lin and B. Bhanu, "Evolutionary feature synthesis for object recognition, " IEEE Transactions on Systems, Man, and Cybernetics, Part C, vol. 35, no. 2, pp. 156-171, 2005.

-, "Object detection in multi-modal images using genetic programming, " Appl. Soft.Comput., vol. 4, no. 2, pp. 175-201, 2004.

H. Guo, L. B. Jack, and A. K. Nandi, "Feature generation using genetic programming with application to fault classification, " IEEE Transactions on Systems, Man, and Cybernetics, Part B, vol. 35, no. 1, pp. 89-99, 2005.

M. Zhang, V. Ciesielski, and P. Andreae, "A domain-independent window approach to multiclass object detection using genetic programming, " EURASIP J. Adv. Sig. Proc., vol. 2003, no. 8, pp. 841-859, 2003.

S. Luke, L. Panait, G. Balan, S. Paus, Z. Skolicki, E. Popovici, K. Sullivan, J. Harrison, J. Bassett, R. Hubley, A. Chircop, J.Compton, W. Haddon, S. Donnelly, B. Jamil, J. Zelibor, E. Kangas, F. Abidi, H. Mooers, and J. O'Beirne, "Ecj: A java-based evolutionary computation research system, " 2010, [Online]. Available:

W. D. Smart and M. Zhang, "Using genetic programming for multiclass classification by simultaneously solving component binary classification problems, " in EuroGP, 2005, pp. 227-239.

K. Sung, "Learning and example selection for object and pattern detection, " Ph. D. dissertation, Massachusetts Institute of Technology, 1995.

O. Lezoray, A. Elmoataz, and H. Cardot, "A color object recognition scheme: application to cellular sorting, " Machine Vision and Applications, vol. 14, pp. 166-171, 2003.

S. Munder and D. M. Gavrila, "An experimental study on pedestrian classification, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 11, pp. 1863-1868, 2006.

U. Bhowan, M. Zhang, and M. Johnston, "Genetic programming for classification with unbalanced data, " in EuroGP, 2010, pp. 1-13.

R. H. Chan, C.-W. Ho, and M. Nikolova, "Salt-and-pepper noise removal by median-type noise detectors and detail-preserving regularization, " IEEE Transactions on Image Processing, vol. 14, no. 10, pp. 1479-1485, 2005.

H. Huiping, W. Bingfang, and F. Jinlong, "Analysis to the relationship of classification accuracy, segmentation scale, image resolution, " in Geoscience and Remote Sensing Symposium, 2003. IGARSS '03. Proceedings. 2003 IEEE International, vol. 6, july 2003, pp. 3671-3673 vol. 6.


Full Text

[extern file]

intern file

Sonstige Links