A memetic dynamic coral reef optimisation algorithm for simultaneous training, design, and optimisation of artificial neural networks

Research areas:

• Uncategorized

Year:

2024

Type of Publication:

Article

Keywords:

Artificial neural networks, Neuroevolution, Coral reef optimisation algorithm, Local search, Classification, Robust estimators

Authors:

• Bérchez-Moreno, Francisco
• Durán-Rosal, Antonio Manuel
• Hervás-Martínez, César
• Gutiérrez, Pedro Antonio
• Fernández, Juan Carlos

Journal:

Scientific Reports

Volume:

14

Pages:

6961

Month:

Marzo

ISSN:

2045-2322

BibTex:

@article{MemeticDSCRO_2024, author = "Francisco B{\'e}rchez-Moreno and Antonio Manuel Dur{\'a}n-Rosal and C{\'e}sar Herv{\'a}s-Mart{\'i}nez and Pedro Antonio Guti{\'e}rrez and Juan Carlos Fern{\'a}ndez", abstract = "Artificial Neural Networks (ANNs) have been used in a multitude of real-world applications given their predictive capabilities, and algorithms based on gradient descent, such as Backpropagation (BP) and variants, are usually considered for their optimisation. However, these algorithms have been shown to get stuck at local optima, and they require a cautious design of the architecture of the model. This paper proposes a novel memetic training method for simultaneously learning the ANNs structure and weights based on the Coral Reef Optimisation algorithms (CROs), a global-search metaheuristic based on corals’ biology and coral reef formation. Three versions based on the original CRO combined with a Local Search procedure are developed: (1) the basic one, called Memetic CRO; (2) a statistically guided version called Memetic SCRO (M-SCRO) that adjusts the algorithm parameters based on the population fitness; (3) and, finally, an improved Dynamic Statistically-driven version called Memetic Dynamic SCRO (M-DSCRO). M-DSCRO is designed with the idea of improving the M-SCRO version in the evolutionary process, evaluating whether the fitness distribution of the population of ANNs is normal to automatically decide the statistic to be used for assigning the algorithm parameters. Furthermore, all algorithms are adapted to the design of ANNs by means of the most suitable operators. The performance of the different algorithms is evaluated with 40 classification datasets, showing that the proposed M-DSCRO algorithm outperforms the other two versions on most of the datasets. In the final analysis, M-DSCRO is compared against four state-of-the-art methods, demonstrating its superior efficacy in terms of overall accuracy and minority class performance.", awards = "JCR (2023): 3.8, Position: 25/134 (Q1), Category: MULTIDISCIPLINARY SCIENCES", comments = "JCR (2023): 3.8, Position: 25/134 (Q1), Category: MULTIDISCIPLINARY SCIENCES", doi = "10.1038/s41598-024-57654-2", issn = "2045-2322", journal = "Scientific Reports", keywords = "Artificial neural networks, Neuroevolution, Coral reef optimisation algorithm, Local search, Classification, Robust estimators", month = "Marzo", note = "JCR (2023): 3.8, Position: 25/134 (Q1), Category: MULTIDISCIPLINARY SCIENCES", pages = "6961", title = "{A} memetic dynamic coral reef optimisation algorithm for simultaneous training, design, and optimisation of artificial neural networks", url = "www.nature.com/articles/s41598-024-57654-2", volume = "14", year = "2024", }

Note:

JCR (2023): 3.8, Position: 25/134 (Q1), Category: MULTIDISCIPLINARY SCIENCES

Abstract:

Artificial Neural Networks (ANNs) have been used in a multitude of real-world applications given their predictive capabilities, and algorithms based on gradient descent, such as Backpropagation (BP) and variants, are usually considered for their optimisation. However, these algorithms have been shown to get stuck at local optima, and they require a cautious design of the architecture of the model. This paper proposes a novel memetic training method for simultaneously learning the ANNs structure and weights based on the Coral Reef Optimisation algorithms (CROs), a global-search metaheuristic based on corals’ biology and coral reef formation. Three versions based on the original CRO combined with a Local Search procedure are developed: (1) the basic one, called Memetic CRO; (2) a statistically guided version called Memetic SCRO (M-SCRO) that adjusts the algorithm parameters based on the population fitness; (3) and, finally, an improved Dynamic Statistically-driven version called Memetic Dynamic SCRO (M-DSCRO). M-DSCRO is designed with the idea of improving the M-SCRO version in the evolutionary process, evaluating whether the fitness distribution of the population of ANNs is normal to automatically decide the statistic to be used for assigning the algorithm parameters. Furthermore, all algorithms are adapted to the design of ANNs by means of the most suitable operators. The performance of the different algorithms is evaluated with 40 classification datasets, showing that the proposed M-DSCRO algorithm outperforms the other two versions on most of the datasets. In the final analysis, M-DSCRO is compared against four state-of-the-art methods, demonstrating its superior efficacy in terms of overall accuracy and minority class performance.

Comments:

JCR (2023): 3.8, Position: 25/134 (Q1), Category: MULTIDISCIPLINARY SCIENCES