Automatic Counting Based On Scanned Election Form Using Feature Match and Convolutional Neural Network

In a democratic state, General Election (Pemilu) is a procedure for selecting regional heads regulated in Article 1 paragraph 3 of the 1945 Constitution. KPU (Komisi Pemilihan Umum) is a state institution that organizes by prioritize transparency and accountability in each stage of general elections in Indonesia. One form of openness that has always been in the media spotlight is the vote counting process. The manual calculation process carried out by the General Election Commissions (KPU) on form C1 is time-consuming and resourceful because it involves paid volunteers. In this study, the authors used the proposed method to build a numerical handwriting recognition system on the C1 KPU form. Method proposed is a recognition flow including table detection with candidate contour techniques, feature matching, number segmentation, and digit classification with the convolutional neural network (CNN). The datasets used are from the official KPU election websites in 2014 and 2019. We use capsnet to classify each segmented digit with 95.65% accuracy. The trained model was tested using validation form and reach 80.73% document accuracy using 2019 election form.