Content-based Image Retrieval of Environmental Microorganisms Using Double-stage Optimisation-based Fusion

Yanling Zou; Chen Li; Kimiaki Shirahama; Tao Jiang; Marcin Grzegorzek

doi:10.52731/iee.v3.i4.203

Yanling Zou Chengdu University of Informtion Technology
Chen Li Northeastern University
Kimiaki Shirahama University of Siegen
Tao Jiang Chengdu University of Informtion Technology
Marcin Grzegorzek University of Siegen

DOI: https://doi.org/10.52731/iee.v3.i4.203

Keywords: Environmental Microorganisms, Content-based Image Retrieval, Microscopic Images, Double-stage Fusion, Multiple Colour Channel Fusion

Abstract

Environmental Microorganisms (EMs) are very tiny living beings which impact the entire biosphere by their environmental functions. Traditionally, a lot of manual efforts through morphological analysis using microscopes have been put on looking for EMs. However, these methods are time-consuming and laborious. To overcome this, we develop a Contentbased Image Retrieval (CBIR) system for the EM image retrieval task within a Doublestage Optimisation-based Fusion framework. In the first stage, in order to effectively use the colour information of EM images, a Multiple Colour Channel Fusion (MCCR) method based on a Particle Swarm Optimisation (PSO) is developed to search for similar database images to a query image using local features. In the second stage, in order to enhance the retrieval performance of the first stage, a retrieval method based on Immune Evolutionary Particle Swarm Optimisation - Shuffled Frog Leaping Algorithm (IEPSO-SFLA) is devised to further combine global features. Finally, the experimental result shows that our doublestage fusion method obtains a mean average precision of 35.87% for 21 classes of EMs, which is superior to the existing methods.

References

I. L. Pepper, C. P. Gerba, and T. J. Gentry, Environmental Microbiology. San Diego, USA: Academic Press, 2014.

YL. Zou and C. Li and Z. Boukhers and K. Shirahama and T. Jiang and M. Grzegorzek, “Environmental microbiological content-based image retrieval system using internal structure histogram,” in Proc. of CORES, 2015, pp. 543–552.

YL. Zou and C. Li and K. Shirahama and T. Jiang and M. Grzegorzek, “Environmental microorganism image retrieval using multiple colour channels fusion and particle swarm optimisation,” in Proc. of ICIP, 2016, pp. 2475–2479.

C. Li, K. Wang, and N. Xu, “A Survey for the Applications of Content-based Microscopic Image Analysis in Microorganism Classification Domains,” Artificial Intelligence Review, pp. 1–70, 2017.

Z. Li, Z. Zhang, and C. Yu, “Shuffled frog leaping algorithm based on immune evolutionary particle swarm optimization,” Journal of Computer Applications(in Chinese), vol. 31, no. 12, pp. 3288–3291, 2011.

C. Li, K. Shirahama, and M. Grzegorzek, “Application of content-based image analysis to environmental microorganism classification,” Biocybernetics and Biomedical Engineering, vol. 35, no. 1, pp. 10–21, 2015.

C. Li and K. Shirahama and M. Grzegorzek, “Environmental microbiology aided by content-based image analysis,” Pattern Analysis and Applications, vol. 19, no. 2, p. 531547, 2016.

C. Li, K. Shirahama, and M. Grzegorzek, “Environmental microorganism classification using sparse coding and weakly supervised learning,” in Proc. of EMR@ICMR, 2015, pp. 9–14.

D. Lowe, “Distinctive image features from scale-invariant keypoints,” International Journal of Computer Vision, vol. 60, no. 2, pp. 91–110, 2004.

A. Bosch, A. Zisserman, and X. Muoz, “Scene classification using a hybrid generative/discriminative approach,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 30, no. 4, pp. 712–727, 2008.

K. van de Sande, T. Gevers, , and C. Snoek, “Evaluating colour descriptors for object and scene recognition,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 32, no. 9, pp. 1582–1596, 2010.

J. Yu, M. Wang, and D. Tao, “Semisupervised multiview distance metric learning for cartoon synthesis,” IEEE Transactions on Image Processing, vol. 21, no. 11, pp. 4636–4648, 2012.

C. G. M. Snoek, M. Worring, and A. W. M. Smeulders, “Early versus late fusion in semantic video analysis,” in Proc. of MM, 2005, pp. 399–402.

J. Kennedy and R. C. Eberhart, “Particle swarm optimization,” in Proc. of ICNN, vol. 4, 1995, pp. 1942–1948.

R. C. Eberhart and Y. Shi, “Particle swarm optimization: developments, applications and resources,” in Proc. of CEC, vol. 1, 2001, pp. 81–86.

M. Eusuff and K. Lansey, “Optimization of water distribution network design using shuffled frog leaping algorithm,” Journal of Water Resources Planning and Management, vol. 129, no. 3, pp. 210–225, 2003.

E. Elbeltagi, T. Hegazy, and D. Grierson, “Comparison among five evolutionary-based optimization algorithms,” Advanced Engineering Informatics, vol. 19, pp. 43–53, 2005.

F. Perez and C. Koch, “Toward colour image segmentation in analog VLSI: algorithm and hardware,” International Journal of Computer Vision, vol. 12, no. 1, pp. 17–42, 1994.

H. Cheng, X. Jiang, A. Sun, and J. Wang, “Colour image segmentation: advances and prospects,” Pattern Recognition, vol. 34, no. 12, pp. 2259–2281, 2001.

K. Mikolajczyk and C. Schmid, “Scale and affine invariant interest point detectors,” International Journal of Computer Vision, vol. 60, no. 1, pp. 63–86, 2004.

M. Fischler and R. Bolles, “Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography,” Communications of the ACM, vol. 24, no. 6, pp. 381–395, 1981.

M. G. Hinchey, R. Sterritt, and C. Rouff, “Swarms and swarm intelligence,” Computer, vol. 40, no. 4, pp. 111–113, 2007.

K. He, X. Zhang, S. Ren, and J. Sun, “Deep residual learning for image recognition,” CoRR, vol. abs/1512.03385, 2016.