SciELO - Scientific Electronic Library Online

 
vol.20 issue2Unsupervised Opinion Polarity Detection based on New Lexical ResourcesIntegrated Routing and Positioning in Mobile Ad Hoc Networks author indexsubject indexsearch form
Home Pagealphabetic serial listing  

Services on Demand

Journal

Article

Indicators

Related links

  • Have no similar articlesSimilars in SciELO

Share


Computación y Sistemas

Print version ISSN 1405-5546

Abstract

SIDOROV, Grigori et al. Automatic Detection of Similarity of Programs in Karel Programming Language based on Natural Language Processing Techniques. Comp. y Sist. [online]. 2016, vol.20, n.2, pp.279-288. ISSN 1405-5546.  http://dx.doi.org/10.13053/cys-20-2-2369.

In this paper, we present a method for calculating similarity between programs (source codes). One of the applications of the task is detection of code reuse, for example, in the case of plagiarism. The Karel programming language is used for experiments. In order to determine similarity between Karel programs and/or similar software solutions, we make use of techniques from the fields of natural language processing and information retrieval. These techniques use representations of documents as vectors of features and their values. Usually, the features are n-grams of words or n-grams of characters. In addition, we consider application of the latent semantic analysis for reduction of the number of dimensions of the vector space. Finally, we use a supervised machine learning approach for classification of texts (or programs, which are texts as well) based on their similarity. For evaluation of the proposed method, two corpora were developed: the first corpus is composed of 100 different programs with a total of 9,341 source codes. The second corpus consists of 34 tasks with a total of 374 codes, which are grouped by the proposed solution. Our experiments showed that for the first corpus, the best results were obtained using trigrams of terms (words) accompanied with application of latent semantic analysis, while for the second corpus, the best representation was achieved using character trigrams.

Keywords : Similarity; n-grams; program; source code; latent semantic analysis; information retrieval; natural language processing.

        · abstract in Spanish     · text in Spanish     · Spanish ( pdf )