SciELO - Scientific Electronic Library Online

 
vol.22 issue1Automatic Theorem Proving for Natural Logic: A Case Study on Textual EntailmentA metric for the Evaluation of Restricted Domain Ontologies author indexsubject indexsearch form
Home Pagealphabetic serial listing  

Services on Demand

Journal

Article

Indicators

Related links

  • Have no similar articlesSimilars in SciELO

Share


Computación y Sistemas

Print version ISSN 1405-5546

Comp. y Sist. vol.22 n.1 México Jan./Mar. 2018

http://dx.doi.org/10.13053/cys-22-1-2790 

Articles of the Thematic Issue

An Overview of Ontology Learning Tasks

María Somodevilla García1  * 

Darnes Vilariño Ayala1 

Ivo Pineda1 

1 Benemérita Universidad Autónoma de Puebla, Puebla, Mexico. dvilarinoayala@gmail.com, ivopinedatorres@gmail.com

Abstract:

Ontology Learning (OL), for the Semantic Web has become widely used for knowledge representation. Therefore, the success of the Semantic Web depends strongly on the proliferation of ontologies, which requires fast and sound ontologies engineering learning process in order to provide an efficient knowledge acquisition service. The vision of ontology learning includes a number of complementary disciplines whose feed on different types of unstructured, semi-structured and fully structured data in order to support a semi-automatic, cooperative ontology engineering process. This article presents a general review of work related to types and tasks involving OL. These works consider fundamental types of Ontology Learning, schema extraction, creation and population, besides of evaluation methods and tools.

Keywords: Overview; ontology learning; semantic Web; semiautomatic techniques

1 Introduction

An ontology of a domain D is a specification of a conceptualization of D. An ontology typically consists of: a list of concepts important for domain D, a list of attributes describing the concepts, a list of taxonomic relationships among these concepts and a list of non-taxonomic semantical relationships among these concepts [5]. Ontologies are the fundamental form of knowledge representation in Semantic Web. The vast majority of currently used ontologies have been built entirely by hand, even those in OBO Foundry. This manual development process represents a major knowledge acquisition bottleneck. One consequence of this has been a series of ongoing efforts largely led by members of the Natural Language Processing (NLP) and Text Mining communities to automate, or semi-automate the ontology construction process.

In summary, Ontology Learning is motivated by the high manual cost of ontology construction, the continuous change in science and knowledge in general, the very large amount of existing text with numbers growing exponentially and the extensive need for a variety of ontology type resources like vocabularies, taxonomies and formal taxonomies [5].

Challenges in Ontology Learning Semantic Web Technologies1 are caused by data heterogeneity and uncertainty on Web. Applications relying on reasoning need consistent ontologies, which must be explicitly supported by ontology learning. Knowledge extraction from growing amounts of web data requires scalable ontology learning.

The data quality is enforced by ontology evaluation which enables formal correctness, completeness and consistency; human involvement increases the quality of learned ontologies. Applications of ontologies mainly are found on Semantic Web, Web pages are annotated with ontologies or user queries for Web pages are analyzed at knowledge level and they are answered by inference on ontological knowledge. Other important applications include knowledge representation and knowledge management systems, intelligent query-answering systems and information retrieval and extraction.

In section 2 fundamental types of Ontology Learning are enlisted along with a brief explanation. The ontology learning tasks are detailed in section 3. Measures and methods of evaluation are addressed in section 4. Section 5 presents eight systems whose general purpose is to learn semantic knowledge from texts for later use it in ontologies development.

2 Fundamental Types of Ontology Learning

Ontologies can be “learned” automatically. Ontology Learning defines a set of methods and techniques for fundamental development of new ontologies, for extension or adaption of already existing ontologies in a (semi), automatic way from various resources. Four fundamental types has been identified and they are briefly described in the following paragraphs2.

2.1 Ontology Learning from Text

This type includes automatic or semi-automatic generation of lightweight ontologies by means of text mining and information extraction.

2.2 Linked Data Mining

In this type meaningful patterns in RDF graphs via statistical schema induction or statistical relational learning are detected.

2.3 Concept Learning in Description Logics and OWL

It consist of learning schema axioms from existing ontologies and instance data mostly based on Inductive Logic Programming

2.4 Crowdsourcing Ontologies

This type combines the speed of computers with the accuracy of humans, as e.g. taxonomy construction via Amazon Turk or games with a purpose.

3 Ontology Learning Tasks

Ontology learning is used to (semi) automatically extract whole ontologies from natural language text [4, 6, 7]. The process is usually split into the following tasks, which are not all necessarily applied in every ontology learning system.

3.1 Ontology Schema Extraction

Squema extraction carries out the extraction of ontology schemata from heterogeneous documents with the help of human experts. A corpus of texts has to be identified, collected and preprocessed in advance. Some works about schema extraction correspond to the main (roots), clases in the process of ontology creation.

OURAL project (Ontologies for the Use of digital learning Resources and semantic Annotations on Line) is proposed in [20]. OURAL integrates areas such as educational sciences, Informatics and Cognitive psychology, in order to create new services for e-learning. As a result, it is possible to obtain classes by using Natural Language Processing (NLP) techniques to specific learning situations which are described in natural language. In [18], the authors also analyze the Educational domain, however, when they applied it to the Chinese language, a preprocessing process was carried out in order to analyze the characteristics of the language such as coupling, relevance and consensus.

In investigations such as [30] methods for extracting classes in a semiautomatic way are presented.A database of verbs, alternations of diathesis and syntactic-semantics schemes of Spanish (ADESSE)[42], is presented. ADESSE stores approximately 160,000 clauses retrieved from a corpus which are used for the extraction of semantic patterns that lead to the determination of the ontology classes. This methodology was applied in the Educational area and replicated in a financial environment [30]. Extraction of classes was complemented with experts’ opinion in the domain. A method for concepts’ extraction using pattern extraction, linguistic calculations and weight calculations with NLP as the morphological labeling is proposed in [30].

3.2 Ontology Creation

Consist in the design of an ontology from the scratch by a team of experts being supported by Machine Learning techniques. Experts make suggestions of well suited relations among concepts. Finally, the reasoner evaluates the consistency of the designed ontology from its hierarchy construction. Most ontologies contain a sub asumption hierarchies of classes, however, it may also be desirable to extract different types of axioms from the text, including disjointness and equivalence. According to the ontological process, the following step is the one corresponding to the creation of the ontology. Table 1, shows the works for both automatic and manual creation of ontologies. In addition, it is attached a column to specify the domain worked in each investigation. The project Artequackt is proposed in [1], a system that generates biographies of using tools such as WordNet4.

Table 1 Ontology creation [49

Building Method Authors Domain
Automatic [1] Biographies of painters
[43] Technical and medical texts
[25] Unstructured document (FIFA)
[30] ADESSE
[11] EOLSS collection
Manual [44] Basic news
[50] English learning material
[47] Online courses handbooks
[9] Science history
[10] Online education
[13]
[3]
Software Engineering courses
[2] ETN
[38] Intelligence levels
[41] Level K12 books
[23]
[22]
E-learning

Other investigations like [26], show a mechanism for the ontologies construction based on the episodes extraction in a domain of unstructured documents. Since projects are carried out for the Chinese language, the main focus is to study the characteristics of the Language prior to the ontology construction. Projects are being tested with news of the FIFA being evaluating them with retrieval metrics as precision and recall.

Other investigations like [25],show a mechanism for the ontologies construction based on the episodes extraction in a domain of unstructured documents. Since projects are carried out for the Chinese language, the main focus is to study the characteristics of the Language prior to the ontology construction. Projects are being tested with news of the FIFA being evaluating them with retrieval metrics as precision and recall.

In addition to the previously mentioned research, other works related to the ontologies creation were analyzed. In [43], an environment is developed for the incremental extraction of knowledge from natural text. They proposed a hybrid methodology that uses POSTagging, and WordNet for the extraction of key elements. The final process is semiautomatic and requires previous training of the corpus domain; in addition, taxonomic relationships and semantic concepts are extracted.

A methodology for obtaining information for ontologies automatic construction in Spanish from text is proposed in [30], mainly for the knowledge extraction from Web. The methodology is based on three sequential stages: search for concepts, extraction of relationships and construction of ontologies.

Finally, in [11], a similar investigation is carried out but using a method which does not analyze the language syntactic structure, but rather studies its level of semantic deep (allowing scenarios multilingual); it also use resolution Anaphora techniques, grouping and lexicon-syntactic pattern extraction.

The investigations about ontologies construction by manual means focus on their domain and evaluation considering the approach used for this proposal (mainly pedagogical investigation). An ontology for the events recognition using 20 News articles from a set of articles is presented in [44], which describes the academic life of the basic level. Pattern extraction and evaluation are performed with IR metrics, reporting superior results to 90% in accuracy.

Ontologies for classroom learning are presented in [18] and [23]. The first research proposes an ontology for the interaction between the student and the teacher in the English language; while in the second the ontology involves the use of the Internet for the improvement of learning. An ontology is proposed for each entity participating in the teaching learning process. The evaluation was performed manually by domain experts.

Other investigations like in [47] [10],[13] and more recently in [14], focus on online education creating ontologies manually based on the resources available to the students online. They mainly use XML to perform the tests which are evaluated manually. In [3], it presents a domain ontology over use-case diagrams created for online environments, specifically for Software Engineering course, this work is also evaluated by experts in the domain.

Other authors[41] focus on the autonomous learning online, proposing an ontology based on the Internet of Things; more than on-line learning, they focus on learning inside the classroom with the help of technology taking as reference the types of intelligence of the students. In [2], the process of ontology creation from the course information offered at the higher level, where the student can choose the courses to take according to his academic background. The structure and hierarchy of the classes are manually made.

The research in [9], proposed a Web application to help users to examine a conceptual space and to explore temporal relations between scientific events. Ontology was formulated using a small number of general predicates (semantic and physical) and a detailed analysis of the rules and relationships that compose it. In [38], an ontology is presented on the lifestyle in people with noncommunicable diseases using semantic Web tools. The main focus of the research focuses on the use of techniques for the ontologies integration.

3.3 Extraction of Ontology Instances

This step consist of the extraction of ontology instances from semi-structured / unstructured data to populate alreadyexisting ontology schemata with individuals. Technologies from Information Retrieval and Data Mining are applied. For the ontologies population, investigations were to carry out this automatic and semi-automatic activity. Table 2, shows some of the works and the domain in which they performed their experiments.

Table 2 Ontologies population [49

Population method Authors Domain
Automatic [19] Google texts
[36]
[46]
Independent
[15] Legal and tourism
[35] Academic Profiles
Semiautomatic [44] Scientific papers
[39] Geographic locations
[14] Independent

A method is proposed to populate ontologies with the use of googled text fragments in [19]. This is based in hand-made patterns for classes and relationships. These patterns are consulted in Google and later the new instances are analyzed previous to be used. In other research [36], two methodologies are proposed which addressed the automatic instantiation of ontologies, from a point of view combining traditional linguistic analysis and technologies for the extraction of textual knowledge. The analysis is based on the contextual distance and the knowledge gain based on semantic roles.

Population independent of domain with an unsupervised automatic model is proposed in [46], by using tourism texts extracted from Wikipedia.

In [15] also tourism texts are used, in addition to a legal corpus proposing a generic process that approaches the automatic population. The authors use extraction of grammatical categories, named entities, morphological tagger and evaluate by querying and WordNet.

Authors in [35], also work in the automatic population in the domain of PhD thesis protocol academic profiles. They use curricular records and summaries of scientific publications in Spanish. The assessment is made against a set of class individuals, relationships between individuals and property values, which were identified and represented by experts in the scientific-academic domain.

Other authors handle semiautomatic population, taking as reference experts in the domain under analysis and NPL techniques. In [44], a system for the semi-automatic ontologies population with instances of unstructured text is described.

It applies supervised learning using tools such as [39], which present a weakly supervised approach to the ontology population using in manual analysis and generating a set of weighted characteristics. The evaluation is performed with IR metrics (precision and recall).

A Web question answering system that combines multiple knowledge bases is presented in [14]. They use a parser of NLP which transforms queries into SPARQL.

4 Evaluation

Ontology evaluation is based on measures and methods to examine a set of criteria. The ontology evaluation approaches basically differ on how many of these criteria are targeted, and their main motivation behind evaluating the taxonomy. Six basic methods for ontology based evaluation has been identified: metric, natural language, clean, lexicon and task based. In the next sections a breve explanation of each one will be provide along the techniques related to them [37, 34].

4.1 Metric Based Evaluation

It presents a set of processes that the user is expected to carry in order to obtain the stability measures of existing ontologies. The following are some features can be used as metrics for evaluation: ontology’s content and language, methodology followed to develop the ontology, software environments and costs

4.2 Clean Based Evaluation

The main focus of this method is to help the users to clean the taxonomies. It provides structural and fundamental insight into the model by considering aspects such as rigidity, unity, identity and dependence. The main application of this evaluation method is to clean the upper level of the WordNet taxonomy [48].

4.3 Lexicon Based Evaluation

This evaluation method is applied on the results of automatic ontology mining techniques that aims to create ontologies, and not to populate ontologies with instances. The evaluation focuses on the the scope of the vocabulary, the wellness of the taxonomy and the adequacy of the non-taxonomic relations. The overall quality of an ontology is not only determined by the quality of the artifact itself, but also by the the quality of its evaluation method. Providing an analysis on the set-up and conditions under which an evaluation of an ontology takes place can only be beneficial to the entire domain of ontology engineering.

4.4 Corpus Based Evaluation

Corpus-based approaches, also known as data-driven approaches, are used to evaluate how far an ontology sufficiently covers a given domain. One basic approach is to perform an automated term extraction on the corpus and simply count the number of concepts that overlap between the ontology and the corpus. Another approach is to use a vector space representation of the concepts in both the corpus and the ontology under evaluation in order to measure the fit between them. [40], evaluate the quality of its constructed taxonomy from a large text corpus by comparing it with six topic specific gold standard taxonomies. These six reference taxonomies are generated from Wikipedia using their proposed GraBTax algorithm

4.5 Task-based Evaluation

Task-based approaches try to measure how far an ontology helps improving the results of a certain task. This type of evaluation considers that a given ontology is intended for a particular task, and is only evaluated according to its performance in this task, regardless of all structural characteristics. Adapting an existing task-based evaluation, the approach in [33] explains how crowdsourcing, involving application users, can efficiently help in the improvement of an application ontology all along the ontology lifecycle. A real case experiment on an application ontology designed for the semantic annotation of Geo-business user data illustrates the proposal. Next section the techniques used by seven prominent ontology learning systems and the evaluation of these techniques is presented.

5 Ontologies Learning Systems

An overview of the system in terms of its developers, the motivation behind the system, and its application domains is provided. Besides. the techniques employed by each system in terms of the corresponding tasks to be achieved.

ASIUM [17, 16], is a semi-automated ontology learning system. The aim of this approach is to learn semantic knowledge from texts and use the knowledge for the portability from one domain to the other. ASIUM uses linguistics and statistics-based techniques to perform its ontology learning tasks: preprocessing texts and discovering subcategorization frames, extracting terms and form concepts, and constructing hierarchy.

Text-to-Onto [8, 26, 27], is a semi-automated system that is part of an ontology management infrastructure called KAON.4 KAON is a comprehensive tool suite for ontology creation and management. Text-to-Onto uses linguistics and statistics-based techniques to perform its ontology learning tasks as preprocessing texts and extracting terms, forming concepts, constructing hierarchy and discovering non-taxonomic relations and labeling non-taxonomic relations.

TextStorm/Clouds [31], is a semi-automated ontology learning system that is part of an idea sharing and generation system called Dr. Divago [32]. The aim of this approach is to build and refine domain ontology for use in Dr. Divago for searching resources in a multidomain environment in order to generate musical pieces or drawings. TextStorm/Clouds uses logic and linguistics-based techniques to perform its ontology learning tasks as preprocessing texts and extracting terms, constructing hierarchy, discovering non-taxonomic relations, and labeling non-taxonomic relations and extracting axioms.

SYNDIKATE [21], is a stand-alone automated ontology learning system. SYNDIKATE uses only linguistics-based techniques to perform its ontology learning tasks as extracting terms, forming concepts, constructing hierarchy, discovering non-taxonomic relations, and labeling nontaxonomic relations.

OntoLearn [28, 29, 45], is part of a project for developing an interoperable infrastructure for small and medium enterprises in the tourism sector under the Federated European Tourism Information System6 (FETISH). OntoLearn uses linguistics and statistics-based techniques to perform its ontology learning tasks as preprocessing texts and extracting terms, forming concepts, and constructing hierarchies.

CRCTOL [24], which stands for concept-relation-concept tuple-based ontology learning, is a system for constructing ontologies from domain-specific documents. CRCTOL uses linguistics and statistics-based techniques to perform its ontology learning tasks as preprocessing texts, extracting terms and forming concepts and constructing hierarchy and discovering non-taxonomic relations.

The more recent OntoGain system [12], from the Technical University of Crete is designed for the unsupervised acquisition of ontologies from unstructured text. OntoGain has been tested against Text2Onto, the successor of Text-To-Onto, in two different domains, namely, the medical and computer science domains. OntoGain uses linguistics and statistics-based techniques to perform its ontology learning tasks as preprocessing texts, extracting terms and forming concepts and constructing hierarchy and discover non-taxonomic relations.

There are several key issues that will likely define the research directions in this area in the near future [37], namely: (1) the issue of noise, authority, and validity in Web data for ontology learning; (2) the integration of social data into the learning process to incorporate consensus into ontology building; (3) the design of new techniques for exploiting the structural richness of collaboratively maintained Web data; (4) the representation of ontological entities as language-independent constructs; (5) the applicability of existing techniques for learning ontologies for different writing systems (e.g., alphabetic, logographic); (6) the efficiency and robustness of existing techniques for Web-scale ontology learning; (7) the increasing role of ontology mapping as more ontologies become available; and (8) the extensibility of existing lightweight ontologies to formal ones.

6 Conclusion and Future Work

Ontology learning is an active field of research in order to facilitate the task of ontology engineering. Another important role for OL is to allow ontologies to be kept up to date more effectively. Ontology based evaluation remains an important open problem and several novelty approaches has been proposed. Diverse systems and tools are under development in OL area. There is no such single method that will be efficient by itself instead of a combination of them according to the application problem is recommended.Open research areas related to ontology learning considers Web-scale, open heterogeneous data repositories, social networks, formal languages and cross-language learning among others.

Acknowledgements

We would like to thank our students, firstly Yuridiana Alemán, for her work on state of the art. Research for this paper was partially financed by Vicerrectoria of Research and Graduate Studies, Benemerital Autonomous University of Puebla, through the project Model of Teaching-Learning Process applying Ontological Engineering.

References

1. Alani, H., Kim, S., Millard, D. E., Weal, M. J., Hall, W., Lewis, P. H., & Shadbolt, N. R. (2003). Automatic ontology-based knowledge extraction from web documents. IEEE Intelligent Systems, Vol. 18, No. 1, pp. 14-21. [ Links ]

2. Aleman, Y., & Somodevilla, M. J. (2017). A proposal for domain ontological learning. Research in Computing Science, Vol. 133, pp. 63-70. [ Links ]

3. Ameen, A., Khan, K. U. R., & Rani, B. P. (2012). Creation of ontology in education domain. Technology for Education (T4E), 2012 IEEE Fourth International Conference on, IEEE, pp. 237-238. [ Links ]

4. Bagiampou, M., & Kameas, A. (2012). A use case diagrams ontology that can be used as common reference for software engineering education. Intelligent Systems (IS), 2012 6th IEEE International Conference, IEEE, pp. 035-040. [ Links ]

5. Bouamrane, M.-M., Luz, S., & Masoodian, M. (2008). Ontologies in interactive systems-ontoract’08 international workshop. Ontologies in Interactive Systems, 2008. ONTORACT’08. First International Workshop on, IEEE, pp. 3-6. [ Links ]

6. Brewster, C., Jupp, S., Luciano, J., Shotton, D., Stevens, R. D., & Zhang, Z. (2009). Issues in learning an ontology from text. BMC bioinformatics, Vol. 10, No. 5, pp. S1. [ Links ]

7. Celjuska, D., & Vargas-Vera, M. (2004). Ontosophie: A semi-automatic system for ontology population from text. International Conference on Natural Language Processing (ICON), pp. 60. [ Links ]

8. Chowdhury, G. G. (2003). Natural language processing. Annual review of information science and technology, Vol. 37, No. 1, pp. 51-89. [ Links ]

9. >Cimiano, P., Mädche, A., Staab, S., & Völker, J. (2009). Ontology learning. In Handbook on ontologies. Springer, pp. 245-267. [ Links ]

10. Corda, I., Bennett, B., & Dimitrova, V. (2008). Interacting with an ontology to explore historical domains. Ontologies in Interactive Systems, 2008. ONTORACT’08. First International Workshop on, IEEE, pp. 65-74. [ Links ]

11. Dai, X., & Li, X. (2010). Study of learning source ontology modeling in remote education. Multimedia Technology (ICMT), 2010 International Conference on, IEEE, pp. 1-4. [ Links ]

12. De la Villa Moreno, M. Á. (2016). Método para la Construcción Automática de Ontologías Basado en Patrones Lingüísticos. Ph.D. thesis, ETSI Informatica. [ Links ]

13. Drymonas, E., Zervanou, K., & Petrakis, E. G. (2010). Unsupervised ontology acquisition from plain texts: The ontogain system. NLDB, Springer, pp. 277-287. [ Links ]

14. Du, L., Zheng, G., You, B., Bai, L., & Zhang, X. (2012). Research of online education ontology model. Computational and Information Sciences (ICCIS), 2012 Fourth International Conference on, IEEE, pp. 780-783. [ Links ]

15. El-Ansari, A., Beni-Hssane, A., & Saadi, M. (2017). A multiple ontologies based system for answering natural language questions. In Europe and MENA Cooperation Advances in Information and Communication Technologies. Springer, pp. 177-186. [ Links ]

16. Faria, C., Serra, I., & Girardi, R. (2014). A domain-independent process for automatic ontology population from text. Science of Computer Programming, Vol. 95, pp. 26-43. [ Links ]

17. Faure, D., & Nedellec, C. (1999). Knowledge acquisition of predicate argument structures from technical texts using machine learning: The system asium. Knowledge Acquisition, Modeling and Management, pp. 329-334. [ Links ]

18. Faure, D., & Poibeau, T. (2000). First experiments of using semantic knowledge learned by asium for information extraction task using intex. Proceedings of the ECAI workshop on Ontology Learning, pp. 156-178. [ Links ]

19. Fu, J., Jia, K., & Xu, J. (2008). Domain ontology learning for question answering system in network education. Young Computer Scientists, 2008. ICYCS 2008. The 9th International Conference for, IEEE, pp. 2647-2652. [ Links ]

20. Geleijnse, G., & Korst, J. H. (2005). Automatic ontology population by googling. BNAIC, pp. 120-126. [ Links ]

21. Grandbastien, M., Azouaou, F., Desmoulins, C., Faerber, R., Leclet, D., & Quénu-Joiron, C. (2007). Sharing an ontology in education: Lessons learnt from the oural project. Advanced Learning Technologies, 2007. ICALT 2007. Seventh IEEE International Conference on, IEEE, pp. 694-698. [ Links ]

22. Hahn, U., & Romacker, M. (2001). The syndikate text knowledge base generator. Proceedings of the first international conference on Human language technology research, Association for Computational Linguistics, pp. 1-6. [ Links ]

23. Hssina, B., Bouikhalene, B., & Merbouha, A. (2017). An ontology to assess the performances of learners in an e-learning platform based on semantic web technology: Moodle case study. In Europe and MENA Cooperation Advances in Information and Communication Technologies. Springer, pp. 103-112. [ Links ]

24. Hu, J., Li, Z., & Xu, B. (2016). An approach of ontology based knowledge base construction for chinese k12 education. Multimedia and Image Processing (ICMIP), 2016 First International Conference on, IEEE, pp. 83-88. [ Links ]

25. Jiang, X., & Tan, A.-H. (2010). Crctol: A semantic-based domain ontology learning system. Journal of the Association for Information Science and Technology, Vol. 61, No. 1, pp. 150-168. [ Links ]

26. Lee, C.-S., Kao, Y.-F., Kuo, Y.-H., & Wang, M.-H. (2007). Automated ontology construction for unstructured text documents. Data & Knowledge Engineering, Vol. 60, No. 3, pp. 547-566. [ Links ]

27. Maedche, A., & Staab, S. (2000). The text-to-onto ontology learning environment. Software Demonstration at ICCS-2000-Eight International Conference on Conceptual Structures, volume 38, sn, pp. 890-930. [ Links ]

28. Maedche, A., & Volz, R. (2001). The ontology extraction & maintenance framework text-to-onto. Proc. Workshop on Integrating Data Mining and Knowledge Management, USA, pp. 1-12. [ Links ]

29. Missikoff, M., Navigli, R., & Velardi, P. (2002). Integrated approach to web ontology learning and engineering. Computer, Vol. 35, No. 11, pp. 60-63. [ Links ]

30. Navigli, R., Velardi, P., Cucchiarelli, A., Neri, F., & Cucchiarelli, R. (2004). Extending and enriching wordnet with ontolearn. Proc. 2nd Global WordNet Conf.(GWC), pp. 279-284. [ Links ]

31. Ochoa, J. L., Hernández-Alcaraz, M. L., Valencia-García, R., & Martínez-Béjar, R. (2011). A semantic role-based approach for ontology learning from spanish texts. International Symposium on Distributed Computing and Artificial Intelligence, Springer, pp. 273-280. [ Links ]

32. Oliveira, A., Pereira, F. C., & Cardoso, A. (2001). Automatic reading and learning from text. Proceedings of the international symposium on artificial intelligence (ISAI), pp. 530-551. [ Links ]

33. Pereira, F. C., & Cardoso, A. (1999). Dr. divago: Searching for new ideas in a multi-domain environment. Proceedings of the 8th Cognitive Science of Natural Language Processing (CSNLP). [ Links ]

34. Pittet, P., & Barthélémy, J. (2015). Exploiting users’ feedbacks: Towards a task-based evaluation of application ontologies throughout their lifecycle. International Conference on Knowledge Engineering and Ontology Development, volume 2. [ Links ]

35. Raad, J., & Cruz, C. (2015). A survey on ontology evaluation methods. Proceedings of the International Conference on Knowledge Engineering and Ontology Development, part of the 7th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management. [ Links ]

36. Reyes-Ortiz, J. A., Bravo, M., Herrera-Alcántara, O., & Gudiño, A. (2015). Poblado automático de ontologías de perfiles académicos a partir de textos en español. Research in Computing Science, Vol. 95, pp. 159-170. [ Links ]

37. Ruiz Martínez, J. M. (2012). Metodología para la población automática de ontologías: aplicación en los dominios de medicina y turismo. [ Links ]

38. Shah, H., Shah, P., & Deulkar, K. (2015). A survey of ontology evaluation techniques for data retrieval. International Engineering & Computer Science, Vol. 4, No. 11, pp. 14960-14962. [ Links ]

39. Somodevilla, M. J., Mena, I., Pineda, I. H., & de Celis, M. C. P. (2015). Deducting lifestyle patterns by ontologies’ swrl rules. Database and Expert Systems Applications (DEXA), 2015 26th International Workshop on, IEEE, pp. 9-13. [ Links ]

40. Tanev, H., & Magnini, B. (2008). Weakly supervised approaches for ontology population. Proceedings of the 2008 Conference on Ontology Learning and Population: Bridging the Gap Between Text and Knowledge, The Netherlands, IOS Press, pp. 129-143. [ Links ]

41. Treeratpituk, P., Khabsa, M., & Giles, C. L. (2013). Graph-based approach to automatic taxonomy generation (grabtax). arXiv preprint arXiv:1307.1718. [ Links ]

42. Uskov, V., Pandey, A., Bakken, J. P., & Margapuri, V. S. (2016). Smart engineering education: The ontology of internet-of-things applications. Global Engineering Education Conference (EDUCON), 2016 IEEE, IEEE, pp. 476-481. [ Links ]

43. Vaamonde, G., González Domínguez, F., & García-Miguel, J. M. (2010). Adesse. a database with syntactic and semantic annotation of a corpus of spanish. Proceedings of the seventh international conference on language resources and evaluation (LREC), pp. 1903-1910. [ Links ]

44. Valencia García, R. et al. (2005). Un entorno para la extracción incremental de conocimiento desde texto en lenguaje natural. Universidad de Murcia. [ Links ]

45. Vargas-Vera, M., & Celjuska, D. (2004). Event recognition on news stories and semi-automatic population of an ontology. Web Intelligence, 2004. WI 2004. Proceedings. IEEE/WIC/ACM International Conference on, IEEE, pp. 615-618. [ Links ]

46. Velardi, P., Navigli, R., Cuchiarelli, A., & Neri, R. (2005). Evaluation of ontolearn, a methodology for automatic learning of domain ontologies. Ontology Learning from Text: Methods, evaluation and applications, Vol. 123, pp. 92. [ Links ]

47. Vicient, C., Sánchez, D., & Moreno, A. (2013). An automatic approach for ontology-based feature extraction from heterogeneous textualresources. Engineering Applications of Artificial Intelligence, Vol. 26, No. 3, pp. 1092-1106. [ Links ]

48. Wu, H. (2008). Research of internet education system based on ontology. Fuzzy Systems and Knowledge Discovery, 2008. FSKD’08. Fifth International Conference on, volume 4, IEEE, pp. 602-605. [ Links ]

49. Yu, J., Thom, J. A., & Tam, A. (2007). Ontology evaluation using wikipedia categories for browsing. Proceedings of the sixteenth ACM conference on Conference on information and knowledge management, ACM, pp. 223-232. [ Links ]

50. Zhu, F., Fok, A. W., Ip, H. H., & Cao, J. (2008). Engonto: Integrated multiple english learning ontology for personalized education. Computer Science and Software Engineering, 2008 International Conference on, volume 5, IEEE, pp. 210-213. [ Links ]

Received: July 28, 2016; Accepted: October 15, 2016

* Corresponding author: María Somodevilla García, e-mail: mariajsomodevilla@gmail.com

Creative Commons License This is an open-access article distributed under the terms of the Creative Commons Attribution License