A Novel Framework for Plagiarism Detection: A Case Study for Urdu Language

Abstract

Plagiarism is an act of presenting someone else's idea, words and original work as one's own without acknowledging the original source. It creates many problems, especially for academic institutions and researchers. There are many plagiarism detection tools publically available which are used to overcome these problems, however these tools mainly work for particular languages like Arabic and English. In South Asian countries specifically India and Pakistan, a huge part of research content is available in Hindi and Urdu languages. Unfortunately, plagiarism detection in Urdu text cannot acquire the proper attention of research community because it has complex sentence structure and lacks linguistic resources. In this paper, we propose a novel framework for plagiarism detection specifically for Urdu language. There is no benchmark corpus available for Urdu plagiarism detection, and therefore we developed a corpus of Urdu language. We applied distance measuring method along with vector space method to measure the similarity between suspicious and source text. For evaluation purpose, we defined different classes of plagiarized text such as paraphrase, heavily plagiarized, light plagiarized and direct copy-paste. Moreover, we evaluated each class of plagiarized text in terms of precision, recall, and f-measure. The experimental results have presented that Levenshiten distance and Jaccard containment methods produced significant improvement in the performance of plagiarism detection compared with existing methods.