Generalised Triangular Distributions for ordinal deep learning: novel proposal and optimisation

Research areas:

• Methodology - Ordinal classification

Year:

2023

Type of Publication:

Article

Authors:

• Vargas, Víctor Manuel
• Durán-Rosal, Antonio Manuel
• Guijo-Rubio, David
• Gutiérrez, Pedro Antonio
• Hervás-Martínez, César

Journal:

Information Sciences

Volume:

648

Pages:

119606

Month:

Noviembre

ISSN:

0020-0255

BibTex:

@article{252023, author = "V{\'i}ctor Manuel Vargas and Antonio Manuel Dur{\'a}n-Rosal and David Guijo-Rubio and Pedro Antonio Guti{\'e}rrez and C{\'e}sar Herv{\'a}s-Mart{\'i}nez", abstract = "Deep learning techniques for ordinal classification have recently gained significant attention. Predicting an ordinal variable, that is, a variable that demonstrates a natural relationship between categories, is of relevance for a number of real-world problems in various fields of knowledge. For example, a medical diagnosis can occur at different stages of the disease. Applying standard classifiers to ordered labels can lead to errors in distant categories, when errors in an ordinal problem ideally tend to be produced in adjacent classes because of their similarity. To address this issue, we propose a soft labelling approach based on generalised triangular distributions, which are asymmetric and different for each class. The parameters of these distributions are determined using a metaheuristic and are specifically adapted to the given problem. Moreover, this approach enables the model to avoid errors in distant classes (e.g. classifying a patient with a severe disease as healthy). A comprehensive comparison was performed using eight datasets and five performance metrics. The main advantage of the proposed soft-labelling approach is that it adapts the distributions to each problem, resulting in greater flexibility and better performance. The results and statistical analysis show that the proposed methodology significantly outperforms all other methods.", awards = "JCR(2022): 8.1, Position: 13/158 (Q1D1) Category: COMPUTER SCIENCE, INFORMATION SYSTEMS", comments = "JCR(2022): 8.1, Position: 13/158 (Q1D1) Category: COMPUTER SCIENCE, INFORMATION SYSTEMS", doi = "10.1016/j.ins.2023.119606", issn = "0020-0255", journal = "Information Sciences", month = "Noviembre", note = "JCR(2022): 8.1, Position: 13/158 (Q1D1) Category: COMPUTER SCIENCE, INFORMATION SYSTEMS", pages = "119606", title = "{G}eneralised {T}riangular {D}istributions for ordinal deep learning: novel proposal and optimisation", url = "www.sciencedirect.com/science/article/pii/S002002552301191X", volume = "648", year = "2023", }

Note:

JCR(2022): 8.1, Position: 13/158 (Q1D1) Category: COMPUTER SCIENCE, INFORMATION SYSTEMS

Abstract:

Deep learning techniques for ordinal classification have recently gained significant attention. Predicting an ordinal variable, that is, a variable that demonstrates a natural relationship between categories, is of relevance for a number of real-world problems in various fields of knowledge. For example, a medical diagnosis can occur at different stages of the disease. Applying standard classifiers to ordered labels can lead to errors in distant categories, when errors in an ordinal problem ideally tend to be produced in adjacent classes because of their similarity. To address this issue, we propose a soft labelling approach based on generalised triangular distributions, which are asymmetric and different for each class. The parameters of these distributions are determined using a metaheuristic and are specifically adapted to the given problem. Moreover, this approach enables the model to avoid errors in distant classes (e.g. classifying a patient with a severe disease as healthy). A comprehensive comparison was performed using eight datasets and five performance metrics. The main advantage of the proposed soft-labelling approach is that it adapts the distributions to each problem, resulting in greater flexibility and better performance. The results and statistical analysis show that the proposed methodology significantly outperforms all other methods.

Comments:

JCR(2022): 8.1, Position: 13/158 (Q1D1) Category: COMPUTER SCIENCE, INFORMATION SYSTEMS