RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publication
Capítulo o parte de un libro (BookPart)
Multimodal output combination for transcribing historical handwritten documents
Transcription of digitalised historical documents is an interesting task in the document analysis area.
This transcription can be achieved by using Handwritten Text Recognition (HTR) on digitalised pages or by using Automatic Speech Recognition (ASR) on the dictation of contents. Moreover, another option is using both systems in a multimodal combination to obtain a draft transcription, given that combining the outputs of different recognition systems will generally improve the recognition accuracy.
In this work, we present a new combination method based on Confusion Network. We check its effectiveness for transcribing a Spanish historical book.
Results on both unimodal combination with different optical (for HTR) and acoustic (for ASR) models, and multimodal combination, show a relative reduction of Word and Character Error Rate of 14.3% and 16.6%, respectively, over the HTR baseline., Work partially supported by European Union -7th FP, under grant 600707 (tranScriptorium), and by the Spanish MEC under projects STraDA (TIN2012-37475-C02-01), Active2Trans (TIN2012-31723), and SmartWays (RTC-2014-1466-4).