Development of a tool for the semantic and syntactic analysis of texts in russian

Abstract

Natural language processing can be divided into several levels. However, if considered separately, these levels are difficult to analyse, and the difficulties occurring on one level can only be resolved on the next one. This is especially apparent on the syntactic level, since the connections between words are determined by the “meaning” of the text, i.e. the level of semantics. Therefore we propose to combine the stages of syntactic and semantic analysis into a single stage. Semantic and syntactic analysis allows considering the semantics at the level of syntactic analysis, thereby reducing ambiguity of the text and improving the quality of the analysis. In order to implement the analysis algorithm, we determined the rules for establishing relationships between words, and developed algorithms for eliminating the ambiguity of words and search for relationships within key phrases and sentences. The article also presents the results of the implementation of the suggested semantic and syntactic analysis algorithm.