Adaptive tTrainer for Multi-layer Perceptron using African Vultures Optimization Algorithm

Authors

  • Tuqa Ali Mohamed
  • Muntadher Khamees Mustafa

DOI:

https://doi.org/10.24237/ASJ.02.01.679B

Keywords:

training MLP, ANN, WOA, SCA, GWO, and AVOA.

Abstract

This paper utilized a newly proposed multi-layer perceptron (MLP) that has been trained using
a meta-heuristic technique (algorithm) that was developed using the idea of the African
Vultures Optimization Algorithm. The precision and consistency of the proposed method's
convergence as performance metrics. The African Vultures Optimization Algorithm(AVOA)
was recently proposed for use in training multi-layer perceptron (MLP), and it employs the five
most common classification data sets currently available( XOR, balloon, breast cancer, heart,
Iris) in the California University at Irvine UCI Repository .The newly Optimizers (AVOA) are
being us for the first time as a Multi-Layer Perceptron (MLP) trainer, and its results are
compared to those obtained using the more established gray wolf optimization (GWO), the
whale optimization algorithm (WOA), and the sine cosine algorithm are examples of
optimization techniques (SCA). Previously, AVOA was used to determine the best weights and
biases for the optimal solution.

References

Bhesdadiya, R., Jangir, P., Jangir, N., Trivedi, I. N., & Ladumor, D. (2016).Training multi-layer perceptron in neural network using whale optimization algorithm. Indian J Sci Technol, 9(19), 28-36.‏

McCulloch WS, Pitts W (1943) A logical calculus of the ideas immanent in nervous activity. Bull Math Biophysics 5:115–133

Bebis G, Georgiopoulos M (1994) Feed-forward neural networks. Potentials, IEEE 13:27–31

Kohonen, T. (1990). The self-organizing map. Proceedings of the IEEE, 78(9), 1464-1480.‏

Park J, Sandberg IW (1993) Approximation and radial-basisfunction networks. Neural Comput 5:305–3

Ghosh-Dastidar, S., & Adeli, H. (2009). Spiking Neural Networks. International journal of neural systems, 19 4, 295-308 .

Hertz J (1991) Introduction to the theory of neural computation. Basic Books 1

Mirjalili S, Mirjalili SM, Lewis A (2014) Grey wolf optimizer. Adv Eng Softw 69:46–61

A. Botalb, M. Moinuddin, U. M. Al-Saggaf, and S. S. A. Ali, “Contrasting Convolutional Neural Network (CNN) with Multi-Layer Perceptron (MLP) for Big Data Analysis,” Int. Conf. Intell. Adv. Syst. ICIAS 2018, no. August, pp. 1–5, 2018,

J. Hamidzadeh, R. Monsefi, and H. Sadoghi Yazdi, “DDC: Distance-based decision classifier,” Neural Comput. Appl., vol. 21, no. 7, pp. 1697–1707, 2012,

S. Mirjalili, S. M. Mirjalili, and A. Lewis, “Let a biogeography-based optimizer train your Multi-Layer Perceptron,” Inf. Sci. (Ny)., vol. 269, pp. 188–209, 2014,

S. Lee and J. Y. Choeh, “Predicting the helpfulness of online reviews using multilayer perceptron neural networks,” Expert Syst. Appl., vol. 41, no. 6, pp. 3041–3046, 2014,

S. Mirjalili, “How effective is the Grey Wolf optimizer in training multi-layer perceptrons,” Appl. Intell., vol. 43, no. 1, pp. 150–161, 2015, doi: 10.1007/s10489-014-0645-7.

H. Ramchoun, M. Amine, J. Idrissi, Y. Ghanou, and M. Ettaouil, “Multilayer Perceptron: Architecture Optimization and Training,” Int. J. Interact. Multimed. Artif.

I. Aljarah, H. Faris, and S. Mirjalili, “Optimizing connection weights in neural networks using the whale optimization algorithm,” Soft Comput., vol. 22, no. 1, pp. 1–15, 2018,

M. Hesami, R. Naderi, and M. Tohidfar, “Modeling and optimizing In vitro sterilization of chrysanthemum via multilayer perceptron-non-dominated sorting genetic algorithm-II (MLP-NSGAII),” Front. Plant Sci., vol. 10, no. March, pp. 1–13, 2019,

A. Heidari, H. Faris, I. Aljarah, and S. Mirjalili, “An efficient hybrid multilayer perceptron neural network with grasshopper optimization,” Soft Comput., vol. 23, no. 17, pp. 7941–7958, 2019.

S. Samadianfard et al., “Wind speed prediction using a hybrid model of the multi-layer perceptron and whale optimization algorithm,” Energy Reports, vol. 6, pp. 1147–1159, 2020.

I. Al-Badarneh, M. Habib, I. Aljarah, and H. Faris, “Neuro-evolutionary models for imbalanced classification problems,” J. King Saud Univ. - Comput. Inf. Sci., no. xxxx, 2020

M. Stock and P. Index, “Training Multilayer Perceptron with Genetic Algorithms and Particle Swarm Optimization for,” mdpi, vol. 5, 2020.

Abdollahzadeh, B., Soleimanian Gharehchopogh, F., & Mirjalili, S. (2021). Artificial gorilla troops optimizer: A new nature‐inspired metaheuristic algorithm for global optimization problems. International Journal of Intelligent Systems, 36(10), 5887-5958.

Bebis G, Georgiopoulos M (1994) Feed-forward neural networks. Potentials, IEEE 13:27–31

B. Abdollahzadeh, F. S. Gharehchopogh, and S. Mirjalili, “African vultures optimization algorithm: A new nature-inspired metaheuristic algorithm for global optimization problems,” Comput. Ind. Eng., vol. 158, no. January, p. 107408, 2021

J. Fan, Y. Li, and T. Wang, “An improved African vultures optimization algorithm based on tent chaotic mapping and time-varying mechanism,” PLoS One, vol. 16, no. 11, p. e0260725, 2021.

D. F. Campos, A. Matos, and A. M. Pinto, “An adaptive velocity obstacle avoidance algorithm for autonomous surface vehicles,” in 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2019, pp. 8089–8096.

Yakout, A. H., Kotb, H., AboRas, K. M., & Hasanien, H. M. (2022). Comparison among different recent metaheuristic algorithms for parameters estimation of solid oxide fuel cell: Steady-state and dynamic models. Alexandria Engineering Journal, 61(11), 8507-8523.

Blake, C., Keogh, E. and Merz, C.J. (1998) UCI repository of machine learning databases. University of California, Irvine. http://www.ics.uci.edu/~mlearn/MLRepo sitory.html

A. Botalb, M. Moinuddin, U. M. Al-Saggaf, and S. S. A. Ali, “Contrasting Convolutional Neural Network (CNN) with Multi-Layer Perceptron (MLP) for Big Data Analysis,” Int. Conf. Intell. Adv. Syst. ICIAS 2018, no. August, pp. 1–5, 2018.

Downloads

Published

2024-02-14

How to Cite

Tuqa Ali Mohamed, & Muntadher Khamees Mustafa. (2024). Adaptive tTrainer for Multi-layer Perceptron using African Vultures Optimization Algorithm. Academic Science Journal, 2(1), 200–217. https://doi.org/10.24237/ASJ.02.01.679B

Issue

Section

Articles