Pasar al contenido principal

Resultados relacionados

Resultados totales (Incluyendo duplicados): 10
Encontrada(s) 1 página(s)

RODIN. Repositorio de Objetos de Docencia e Investigación de la Universidad de Cádiz
Publicación Artículo científico (JournalArticle)

On sparse ensemble methods: An application to short-term predictions of the evolution of COVID-19

  • Benítez-Peña, Sandra
  • Carrizosa, Emilio
  • Guerrero, Vanesa
  • Jiménez-Gamero, M. Dolores
  • Martín-Barragán, Belén
  • Molero-Río, Cristina
  • Ramírez Cobo, Josefa
  • Romero Morales, Dolores
  • Sillero-Denamiel, M. Remedios
Since the seminal paper by Bates and Granger in 1969, a vast number of ensemble methods that combine different base regressors to generate a unique one have been proposed in the literature. The so-obtained regressor method may have better accuracy than its components, but at the same time it may overfit, it may be distorted by base regressors with low accuracy, and it may be too complex to understand and explain. This paper proposes and studies a novel Mathematical Optimization model to build a sparse ensemble, which trades off the accuracy of the ensemble and the number of base regressors used. The latter is controlled by means of a regularization term that penalizes regressors with a poor individual performance. Our approach is flexible to incorporate desirable properties one may have on the ensemble, such as controlling the performance of the ensemble in critical groups of records, or the costs associated with the base regressors involved in the ensemble. We illustrate our approach with real data sets arising in the COVID-19 context. (c) 2021 The Authors. Published by Elsevier B.V. This is an open access article under the CC BY-NC-ND license ( http://creativecommons.org/licenses/by-nc-nd/4.0/ ), We thank the reviewers for their thorough comments and suggestions, which have been very valuable to strengthen the quality of the paper. This research has been financed in part by research projects EC H2020 MSCA RISE NeEDS (Grant agreement ID: 822214); FQM-329 and P18-FR-2369 (Junta de Andalucia, Spain); MTM2017-89422-P (Ministerio de Economia, Industria y Competitividad, Spain); PID2019-110886RB-I00 (Ministerio de Ciencia, Innovacin y Universidades, Spain); PR2019-029 (Universidad de Cadiz, Spain); PITUFLOW-CM-UC3M (Comunidad de Madrid and Universidad Carlos III de Madrid, Spain); and EP/R00370X/1 (EPSRC, United Kingdom). This support is gratefully acknowledged.
RODIN. Repositorio de Objetos de Docencia e Investigación de la Universidad de Cádiz
Publicación Artículo científico (JournalArticle)

A cost-sensitive constrained Lasso

  • Blanquero, Rafael
  • Carrizosa, Emilio
  • Ramírez Cobo, Josefa
  • Sillero-Denamiel, M. Remedios
The Lasso has become a benchmark data analysis procedure, and numerous variants have been proposed in the literature. Although the Lasso formulations are stated so that overall prediction error is optimized, no full control over the accuracy prediction on certain individ- uals of interest is allowed. In this work we propose a novel version of the Lasso in which quadratic performance con- straints are added to Lasso-based objective functions, in such a way that threshold values are set to bound the prediction errors in the different groups of interest (not necessarily disjoint). As a result, a constrained sparse regression model is defined by a nonlinear optimization prob- lem. This cost-sensitive constrained Lasso has a direct application in heterogeneous samples where data are collected from distinct sources, as it is standard in many biomedical contexts. Both theoretical properties and empirical studies concerning the new method are explored in this paper. In addition, two illustrations of the method on biomedical and sociological contexts are considered.
RODIN. Repositorio de Objetos de Docencia e Investigación de la Universidad de Cádiz
Publicación Artículo científico (JournalArticle)

Variational inference for responsible logistic regression

  • Carrizosa, Emilio
  • Jiménez-Llamas, Rafael
  • Ramírez Cobo, Josefa
Machine Learning is increasingly used in high-stakes applications such as health- care or finance, where interpretability, transparency and fairness are critical. These demands have led to growing interest in models that can meet such requirements. Logistic regression remains a popular choice in these contexts due to its versatility and interpretability. While sparsity has been explored extensively and fairness only recently, few works have considered both simultaneously. In this work, we present a novel approach to logistic regression based on Mean-Field Variational Inference (MFVI), which integrates both sparsity and fairness into a unified Bayesian frame- work. We do so by modifying the KL divergence term in the variational objective with a penalization that encourages fair solutions, while also incorporating a sparsity- inducing prior that allows for feature selection. We further adapt the inference process to include group sparsity, enabling the selection or elimination of grouped features such as dummy variables derived from categorical inputs. The numerical results show a triple trade-off between accuracy, fairness and interpretability which may significantly improve the user’s capability to properly balance the three criteria.
RODIN. Repositorio de Objetos de Docencia e Investigación de la Universidad de Cádiz
Publicación Artículo científico (JournalArticle)

Variable selection for Naive Bayes classification

  • Blanquero, Rafael
  • Carrizosa, Emilio
  • Ramírez Cobo, Josefa
  • Sillero-Denamiel, M. Remedios
The Naive Bayes has proven to be a tractable and efficient method for classification in multivariate analysis. However, features are usually correlated, a fact that violates the Naive Bayes' assumption of conditional independence, and may deteriorate the method's performance. Moreover, datasets are often characterized by a large number of features, which may complicate the interpretation of the results as well as slow down the method's execution. In this paper we propose a sparse version of the Naive Bayes classifier that is characterized by three properties. First, the sparsity is achieved taking into account the correlation structure of the covariates. Second, different performance measures can be used to guide the selection of features. Third, performance constraints on groups of higher interest can be included. Our proposal leads to a smart search, which yields competitive running times, whereas the flexibility in terms of performance measure for classification is integrated. Our findings show that, when compared against well-referenced feature selection approaches, the proposed sparse Naive Bayes obtains competitive results regarding accuracy, sparsity and running times for balanced datasets. In the case of datasets with unbalanced (or with different importance) classes, a better compromise between classification rates for the different classes is achieved., This research is partially supported by research grants and projects MTM2015-65915-R (Ministerio de Economia y Competitividad, Spain) and PID2019-110886RB-I00 (Ministerio de Ciencia, Innovacion y Universidades, Spain) , FQM-329 and P18-FR-2369 (Junta de Andalucia, Spain) , PR2019-029 (Universidad de Cadiz, Spain) , Fundacion BBVA and EC H2020 MSCA RISE NeEDS Project (Grant agreement ID: 822214) . This support is gratefully acknowledged. Document
RODIN. Repositorio de Objetos de Docencia e Investigación de la Universidad de Cádiz
Publicación Artículo científico (JournalArticle)

Constrained Naive Bayes with application to unbalanced data classification

  • Blanquero, Rafael
  • Carrizosa, Emilio
  • Ramírez Cobo, Josefa
  • Sillero-Denamiel, M. Remedios
The Naive Bayes is a tractable and efficient approach for statistical classification. In general classification problems, the consequences of misclassifications may be rather different in different classes, making it crucial to control misclassification rates in the most critical and, in many realworld problems, minority cases, possibly at the expense of higher misclassification rates in less problematic classes. One traditional approach to address this problem consists of assigning misclassification costs to the different classes and applying the Bayes rule, by optimizing a loss function. However, fixing precise values for such misclassification costs may be problematic in realworld applications. In this paper we address the issue of misclassification for the Naive Bayes classifier. Instead of requesting precise values of misclassification costs, threshold values are used for different performance measures. This is done by adding constraints to the optimization problem underlying the estimation process. Our findings show that, under a reasonable computational cost, indeed, the performance measures under consideration achieve the desired levels yielding a user-friendly constrained classification procedure.
RODIN. Repositorio de Objetos de Docencia e Investigación de la Universidad de Cádiz
Publicación Artículo científico (JournalArticle)

Fair Logistic Regression via Penalized Mean-Field Variational Inference

  • Carrizosa, Emilio
  • Jiménez-Llamas, Rafael
  • Ramírez Cobo, Josefa
Fairness in Machine Learning (ML) has recently risen in importance due to its demand by both society and institutions, either private or public. This is due to the discrimination or disparities that may arise as a consequence of biases in the data sets that are used for training the prediction algorithms. As a consequence, the applicability of such algorithms may be limited. In this paper we propose a fair version of the logistic regression via Mean-Field Variational Bayes (MFVB). Fairness is defined in terms of a carefully selected metric that, not only is interpretable for the considered logistic regression problem, but also leads to tractable MFVB equations. In addition, it allows for the problem to be solved in a private manner, further increasing the applicability of the method. The MFVB equations are solved through a Coordinate Ascent Variational Inference (CAVI) algorithm, where a proper selection of the hyper-parameters is shown to be crucial to assure accurate classification rates. Numerical experiments illustrate how the novel approach provides a trade-off between the accuracy of the method and the predictions’ level of fairness that eases the decision making process.
RODIN. Repositorio de Objetos de Docencia e Investigación de la Universidad de Cádiz
Publicación Artículo científico (JournalArticle)

A bivariate two-state Markov modulated Poisson process for failure modeling

  • Yera, Yoel G.
  • Lillo, Rosa E.
  • Nielsen, B.F.
  • Ramírez Cobo, Josefa
  • Ruggeri, Fabrizio
Motivated by a real failure dataset in a two-dimensional context, this paper presents an extension of the Markov modulated Poisson process (MMPP) to two dimensions. The one-dimensional MMPP has been proposed for the modeling of dependent and non-exponential inter-failure times (in contexts as queuing, risk or reliability, among others). The novel two-dimensional MMPP allows for dependence between the two sequences of inter- failure times, while at the same time preserves the MMPP properties, marginally. The generalization is based on the Marshall–Olkin exponential distribution. Inference is undertaken for the new model through a method combining a matching moments approach with an Approximate Bayesian Computation (ABC) algorithm. The performance of the method is shown on simulated and real datasets representing times and distances covered between consecutive failures in a public transport company. For the real dataset, some quantities of importance associated with the reliability of the system are estimated as the probabilities and expected number of failures at different times and distances covered by trains until the occurrence of a failure.
RODIN. Repositorio de Objetos de Docencia e Investigación de la Universidad de Cádiz
Publicación Artículo científico (JournalArticle)

Analysis of an aggregate loss model in a Markov renewal regime

  • Ramírez Cobo, Josefa
  • Carrizosa, Emilio
  • Lillo, Rosa E.
In this article we consider an aggregate loss model with dependent losses. The losses occurrence process is governed by a two-state Markovian arrival process (MAP2), a Markov renewal process process that allows for (1) correlated inter-losses times, (2) non-exponentially distributed inter-losses times and, (3) overdisperse losses counts. Some quantities of interest to measure persistence in the loss occurrence process are obtained. Given a real operational risk database, the aggregate loss model is estimated by fitting separately the inter-losses times and severities. The MAP2 is estimated via direct maximization of the likelihood function, and severities are modeled by the heavy-tailed, double-Pareto Lognormal distribution. In comparison with the fit provided by the Poisson process, the results point out that taking into account the dependence and overdispersion in the inter-losses times distribution leads to higher capital charges.
RODIN. Repositorio de Objetos de Docencia e Investigación de la Universidad de Cádiz
Publicación Artículo científico (JournalArticle)

Analysis of an aggregate loss model in a Markov renewal regime

  • Ramírez Cobo, Josefa
  • Carrizosa, Emilio
  • Lillo, Rosa E.
In this article we consider an aggregate loss model with dependent losses. The loss occurrence process is governed by a two-state Markovian arrival process ( M A P 2 ), a Markov renewal process that allows for (1) correlated inter-loss times, (2) non-exponentially distributed inter-loss times and, (3) overdisperse loss counts. Some quantities of interest to measure persistence in the loss occurrence process are obtained. Given a real OpRisk database, the aggregate loss model is estimated by fitting separately the inter-loss times and severities. The M A P 2 is estimated via direct maximization of the likelihood function, and severities are modeled by the heavy-tailed, double-Pareto Lognormal distribution. In comparison with the fit provided by the Poisson process, the results point out that taking into account the dependence and overdispersion in the inter-loss times distribution leads to higher capital charges.
RODIN. Repositorio de Objetos de Docencia e Investigación de la Universidad de Cádiz
Publicación Artículo científico (JournalArticle)

Fitting procedure for the two-state Batch Markov modulated Poisson process

  • Yera, Yoel G.
  • Lillo, Rosa E.
  • Ramírez Cobo, Josefa
The Batch Markov Modulated Poisson Process (BMMPP) is a subclass of the versatile Batch Markovian Arrival process (BMAP) which has been proposed for the modeling of dependent events occurring in batches (as group arrivals, failures or risk events). This paper focuses on exploring the possibilities of the $\bmmpp$ for the modeling of real phenomena involving point processes with group arrivals. The first result in this sense is the characterization of the two-state BMMPP with maximum batch size equal to K, the BMMPP2(K), by a set of moments related to the inter-event time and batch size distributions. This characterization leads to a sequential fitting approach via a moments matching method. The performance of the novel fitting approach is illustrated on both simulated and a real teletraffic data set, and compared to that of the EM algorithm. In addition, as an extension of the inference approach, the queue length distributions at departures in the queueing system BMMPP/M/1 is also estimated.