Services on Demand
Journal
Article
Indicators
- Cited by SciELO
- Access statistics
Related links
- Similars in SciELO
Share
Computación y Sistemas
On-line version ISSN 2007-9737Print version ISSN 1405-5546
Abstract
KOLESNIKOVA, Olga. Survey of Word Co-occurrence Measures for Collocation Detection. Comp. y Sist. [online]. 2016, vol.20, n.3, pp.327-344. ISSN 2007-9737. https://doi.org/10.13053/cys-20-3-2456.
This paper presents a detailed survey of word co-occurrence measures used in natural language processing. Word co-occurrence information is vital for accurate computational text treatment, it is important to distinguish words which can combine freely with other words from other words whose preferences to generate phrases are restricted. The latter words together with their typical co-occurring companions are called collocations. To detect collocations, many word co-occurrence measures, also called association measures, are used to determine a high degree of cohesion between words in collocations as opposed to a low degree of cohesion in free word combinations. We describe such association measures grouping them in classes depending on approaches and mathematical models used to formalize word co-occurrence.
Keywords : Word co-occurrence measure; association measure; collocation; statistical language model; rule-based language model; hybrid approach to model word co-occurrence.