Ada-boosting Extreme learning machines for handwritten digit and digit strings recognition

Abstract

Automatic handwriting recognition of digit strings, is of academic and commercial interest. Current algorithms are already quite good at learning to recognize handwritten digits, which enables to use them for sorting letters and reading personal checks. Neural networks are a powerful technology for classification of visual inputs arising from documents, and have been extensively used in many fields due to their ability to approximate complex nonlinear mappings directly from the input sample. Different variations of Multi-Layer Neural Networks (MLNN), using back propagation training algorithm, yield a very high recognition rates on handwritten digits benchmarks, but lacks the aspect of speed in training time. Learning time is an important factor while designing any computational intelligent algorithm for classifications, especially when online improving by adapting new samples is needed. Extreme Learning Machine (ELM) has been proposed as an alternative ANN, which significantly reduce the amount of time needed to train a MLNN and has been widely used for many applications. The ELM analytical process of learning reduces the time of learning comparing to back propagation by avoiding the process of iterative learning. In this paper, we present a process which boosts few Extreme learning machines using Ada-boosting in order to improve the recognition rates iteratively. A pre-processing step is used to improve the ability of the ELM, and special weighting process to improve the boosting process. To evaluate the presented approach, we have used the (HDRC 2013) data-set which have bee used at the 2014 competition on handwritten digit string recognition organized in conjunction with ICFHR2014 of Western Arabic digit string recognition with varying length. Very high accurate results in terms of very low error rates while keeping efficient time of online training were achieved by the presented approach, which enables on demand time/precision tradeoff.