versión On-line ISSN 1870-9044
Polibits no.43 México ene./jun. 2011
Semantic Textual Entailment Recognition using UNL
Partha Pakray1*, Soujanya Poria1**, Sivaji Bandyopadhyay1***, and Alexander Gelbukh2
2 Faculty of Law, Waseda University, Tokyo, Japan, on Sabbatical leave from the Center for Computing Research, National Polytechnic Institute, Mexico City, Mexico (email: firstname.lastname@example.org).
Manuscript received November 2, 2010.
Manuscript accepted for publication January 12, 2011.
A twoway textual entailment (TE) recognition system that uses semantic features has been described in this paper. We have used the Universal Networking Language (UNL) to identify the semantic features. UNL has all the components of a natural language. The development of a UNL based textual entailment system that compares the UNL relations in both the text and the hypothesis has been reported. The semantic TE system has been developed using the RTE3 test annotated set as a development set (includes 800 texthypothesis pairs). Evaluation scores obtained on the RTE4 test set (includes 1000 texthypothesis pairs) show 55.89% precision and 65.40% recall for YES decisions and 66.50% precision and 55.20% recall for NO decisions and overall 60.3% precision and 60.3% recall.
Key words: Textual Entailment, Universal Networking Language (UNL), RTE3 Test Annotated Data, RTE4 Test Data
This work was supported in part by the Government of India and Government of Mexico (joint DSTCONACYT project) and Government of Mexico (CONACYT 50206H, SIPIPN 20113295, as well as SNI and CONACYT Sabbatical program as to the fourth author).
 R. BarHaim, I. Dagan, B. Dolan, L. Ferro, D. Giampiccolo, B. Magnini, and I. Szpektor, "The Second PASCAL Recognising Textual Entailment Challenge," in Proceedings of the Second PASCAL Challenges Workshop on Recognising Textual Entailment, Venice, Italy. 2006. [ Links ]
 L. Bentivogli, I. Dagan, H.T. Dang, D. Giampiccolo, and B. Magnini, "The Fifth PASCAL Recognizing Textual Entailment Challenge," in TAC 2009 Workshop, National Institute of Standards and Technology Gaithersburg, Maryland USA. 2009. [ Links ]
 I. Dagan, O. Glickman, and B. Magnini, "The PASCAL Recognising Textual Entailment Challenge," in Proceedings of the PASCAL RTE Challenge. 2005. [ Links ]
 D. Giampiccolo, H. T. Dang, B. Magnini, I. Dagan, and E. Cabrio, "The Fourth PASCAL Recognizing Textual Entailment Challenge," in TAC 2008 Proceedings. 2008. [ Links ]
 D. Giampiccolo, B. Magnini, I. Dagan, and B. Dolan, "The Third PASCAL Recognizing Textual Entailment Challenge," in Proceedings of the ACLPASCAL Workshop on Textual Entailment and Paraphrasing, Prague, Czech Republic. 2007. [ Links ]
 E.M. Voorhees and D. Harman, "Overview of the Seventh Text Retrieval Conference," in Proceedings of the Seventh Text REtrieval Conference (TREC7). NIST Special Publication. 1999. [ Links ]
 D. Yuret, A. Han, and Z. Turgut, "SemEval2010 Task 12: Parser Evaluation using Textual Entailments," in Proceedings of the SemEval2010 Evaluation Exercises on Semantic Evaluation. 2010. [ Links ]
 G. Zhao, M. Petridis, G. Sidorov, and J. Ma, "A critical examination of node similarity graph matching algorithm," Research in computing science, vol. 40, pp. 7382, 2008. [ Links ]