RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publicación
Capítulo o parte de un libro (BookPart)
Discriminative Bernoulli Mixture Models for Handwritten Digit Recognition
Bernoulli-based models such as Bernoulli mixtures
or Bernoulli HMMs (BHMMs), have been successfully applied
to several handwritten text recognition (HTR) tasks which
range from character recognition to continuous and isolated
handwritten words. All these models belong to the generative
model family and, hence, are usually trained by (joint) maximum
likelihood estimation (MLE). Despite the good properties
of the MLE criterion, there are better training criteria such as
maximum mutual information (MMI). The MMI is a widespread
criterion that is mainly employed to train discriminative models
such as log-linear (or maximum entropy) models. Inspired by
the Bernoulli mixture classifier, in this work a log-linear model
for binary data is proposed, the so-called mixture of multiclass
logistic regression. The proposed model is proved to be
equivalent to the Bernoulli mixture classifier. In this way, we
give a discriminative training framework for Bernoulli mixture
models. The proposed discriminative training framework is
applied to a well-known Indian digit recognition task., Work supported by the EC (FEDER/FSE) and the Spanish MEC/MICINN under the MIPRCV “Consolider Ingenio 2010” program (CSD2007-00018), iTrans2 (TIN2009-14511) and MITTRAL (TIN2009-14633-C03-01) projects. Also supported by the IST Programme of the European Community, under the PASCAL2 Network of Excellence, IST-2007-216886, and by the Spanish MITyC under the erudito.com (TSI-020110-2009-439).