Services on Demand
Journal
Article
Indicators
- Cited by SciELO
- Access statistics
Related links
- Similars in SciELO
Share
Computación y Sistemas
On-line version ISSN 2007-9737Print version ISSN 1405-5546
Abstract
BANERJEE, Somnath; NASKAR, Sudip Kumar; ROSSO, Paolo and BANDYOPADHYAY, Sivaji. Named Entity Recognition on Code-Mixed Cross-Script Social Media Content. Comp. y Sist. [online]. 2017, vol.21, n.4, pp.681-692. ISSN 2007-9737. https://doi.org/10.13053/cys-21-4-2850.
Focusing on the current multilingual scenario in social media, this paper reports automatic extraction of named entities (NE) from code-mixed cross-script social media data. Our prime target is to extract NE for question answering. This paper also introduces a Bengali-English (Bn-En) code-mixed cross-script dataset for NE research and proposes domain specific taxonomies for NE. We used formal as well as informal language-specific features to prepare the classification models and employed four machine learning algorithms (Conditional Random Fields, Margin Infused Relaxed Algorithm, Support Vector Machine and Maximum Entropy Markov Model) for the NE recognition (NER) task. In this study, Bengali is considered as the native language while English is considered as the non-native language. However, the approach presented in this paper is generic in nature and could be used for any other code-mixed dataset. The classification models based on CRF and SVM performed well among the classifiers.
Keywords : Named entity recognition; code-mixed cross-script; Bengali-English social media content.