Real-time image classification using LBP and ensembles of ELM
Authors: Cvetković Stevica, Rajković Boban, Nikolić Saša V.
Keywords: image classification; local binary patterns; neural networks; extreme learning machines
Abstract:
This paper presents a method for real-time image classification which combines Local Binary Pattern (LBP) descriptor and ensembles of Extreme Learning Machines (ELM). We start by extraction of a multi-channel LBP descriptor over separate color channels and several scales of the input image. The descriptor is characterized by compactness and robustness to illumination and resolution changes. Image category prediction is done using recently introduced specific single layer neural network called Extreme Learning Machine (ELM). To overcome main disadvantages of the ELM, instability and non-optimal output, we combined multiple ELMs into an ensemble using appropriate score aggregation strategy. Our evaluation on a standard benchmark dataset consisting of a thousand images from ten categories, has shown high accuracy of results while executing in real-time during tests.
References:
[1] Cao, J., Lin, Z., Huang, G., Liu, N. (2012) Voting based extreme learning machine. Information Sciences, 185(1): 66-77
[2] Chang, C., Lin, C. (2011) Libsvm. ACM Transactions on Intelligent Systems and Technology, 2(3): 1-27
[3] Cvetković, S., Nikolić, S.V., Ilić, S. (2014) Effective combining of color and texture descriptors for indoor-outdoor image classification. Facta universitatis – series: Electronics and Energetics, vol. 27, br. 3, str. 399-410
[4] Cvetković, S., Stojanović, M.B., Nikolić, S.V. (2015) Multi-channel descriptors and ensemble of Extreme Learning Machines for classification of remote sensing images. Signal Processing: Image Communication, 39: 111-120
[5] Huang, G., Huang, G., Song, S., You, K. (2015) Trends in extreme learning machines: A review. Neural Networks, 61: 32-48
[6] Huang, G., Zhou, H., Ding, X., Zhang, R. (2012) Extreme Learning Machine for Regression and Multiclass Classification. IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 42(2): 513-529
[7] Huang, G., Zhu, Q., Siew, C. (2006) Extreme learning machine: Theory and applications. Neurocomputing, 70(1-3): 489-501
[8] Lazebnik, S., Schmid, C., Ponce, J. (2006) Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories. u: IEEE Computer Society Conference on Computer Vision and Pattern Recognition – Volume 2 (CVPR’06), volume 2, pages 2169-2178
[9] Liu, N., Wang, H. (2010) Ensemble Based Extreme Learning Machine. IEEE Signal Processing Letters, 17(8): 754-757
[10] Ojala, T., Pietikäinen, M., Mäenpää, T. (2002) Multi-resolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Transactions on Pattern Analysis and Machine Intelligence, 24(7): 971
[11] Ojala, T., Pietikainen, M., Harwood, D. (1996) A comparative study of texture measures with classification based on feature distributions. Pattern Recognition, 29(1): 51
[12] Tang, J., Deng, C., Huang, G. (2016) Extreme Learning Machine for Multilayer Perceptron. IEEE Transactions on Neural Networks and Learning Systems, 27(4): 809-821
[13] Wang, J.Z., Lia, J., Wiederhold, G. (2001) SIMPLIcity: Semantics-sensitive integrated matching for picture libraries. IEEE Transactions on Pattern Analysis and Machine Intelligence, 23 (9), str. 947-963
[14] Zhang, X., Yang, Y., Han, Z., Wang, H., Gao, C. (2013) Object class detection. ACM Computing Surveys, 46(1): 1-53
[15] Zhao, Y. (2012) Theories and applications of lbp: A survey. u: de-Shuang Huang, Gan Yong, Gupta Phalguni, Gromiha Michael M. [ur.] Advanced intelligent computing theories and applications: With aspects of artificial intelligence (Lecture Notes in Computer Science), Berlin-Heidelberg: Springer, pages 112-120, volume 6839 of