RODIN. Repositorio de Objetos de Docencia e Investigación de la Universidad de Cádiz
Publication
Artículo científico (JournalArticle)
Cost-sensitive probabilistic predictions for support vector machines
Support vector machines (SVMs) are widely used and constitute one of the best examined and used machine learning models for two-class classification. Classification in SVM is based on a score procedure, yielding a deterministic classification rule, which can be transformed into a probabilistic rule (as implemented in off-the-shelf SVM libraries), but is not probabilistic in nature. On the other hand, the tuning of the regularization parameters in SVM is known to imply a high computational effort and generates pieces of information that are not fully exploited, not being used to build a probabilistic classification rule. In this paper we propose a novel approach to generate probabilistic outputs for the SVM. The new method has the following three properties. First, it is designed to be cost-sensitive, and thus the different importance of sensitivity (or true positive rate, TPR) and specificity (true negative rate, TNR) is readily accommodated in the model. As a result, the model can deal with imbalanced datasets which are common in operational business problems as churn prediction or credit scoring. Second, the SVM is embedded in an ensemble method to improve its performance, making use of the valuable information generated in the parameters tuning process. Finally, the probabilities estimation is done via bootstrap estimates, avoiding the use of parametric models as competing approaches. Numerical tests on a wide range of datasets show the advantages of our approach over benchmark procedures.
Project:
AEI / Plan Estatal de Investigación Científica y Técnica y de Innovación 2017-2020 PID2019-110886RB-I00
,
EC / H2020 822214
,
AEI / PR2019-029 TED2021-130216A-I00
,
Universidad de Cádiz FJC2021-047209-I
,
AEI US-1381178
,
Junta de Andalucía P18-FR-2369
View at: http://hdl.handle.net/10498/32645