SciELO - Scientific Electronic Library Online

 
vol.21 issue4SNEIT: Salient Named Entity Identification in TweetsComplexity Metric for Code-Mixed Social Media Text author indexsubject indexsearch form
Home Pagealphabetic serial listing  

Services on Demand

Journal

Article

Indicators

Related links

  • Have no similar articlesSimilars in SciELO

Share


Computación y Sistemas

On-line version ISSN 2007-9737Print version ISSN 1405-5546

Abstract

BANERJEE, Somnath; NASKAR, Sudip Kumar; ROSSO, Paolo  and  BANDYOPADHYAY, Sivaji. Named Entity Recognition on Code-Mixed Cross-Script Social Media Content. Comp. y Sist. [online]. 2017, vol.21, n.4, pp.681-692. ISSN 2007-9737.  https://doi.org/10.13053/cys-21-4-2850.

Focusing on the current multilingual scenario in social media, this paper reports automatic extraction of named entities (NE) from code-mixed cross-script social media data. Our prime target is to extract NE for question answering. This paper also introduces a Bengali-English (Bn-En) code-mixed cross-script dataset for NE research and proposes domain specific taxonomies for NE. We used formal as well as informal language-specific features to prepare the classification models and employed four machine learning algorithms (Conditional Random Fields, Margin Infused Relaxed Algorithm, Support Vector Machine and Maximum Entropy Markov Model) for the NE recognition (NER) task. In this study, Bengali is considered as the native language while English is considered as the non-native language. However, the approach presented in this paper is generic in nature and could be used for any other code-mixed dataset. The classification models based on CRF and SVM performed well among the classifiers.

Keywords : Named entity recognition; code-mixed cross-script; Bengali-English social media content.

        · text in English     · English ( pdf )