Filtering stop words is an important task when processing text queries for information retrieval in large data sets. Existing mathematical models of this problem are not suitable for all families of natural languages. For example, they do not cover families of languages to which the Uzbek language may be classified. In this work, an attempt is made to construct a new mathematical model of this problem for Turkic languages, which include Uzbek. This model concerns the so-called agglutinative languages, in which the task of automatically recognizing unimportant words in Uzbek language texts is much more difficult, since stop words are “masked” in the text. This paper proposes a model of a mathematical structure that corresponds to the type of language being studied and allows filtering words that are not essential for information retrieval. This model allows you to compress texts to work with various methods for identifying stop words.
| Mualliflar | Madatov, Kh.A., Мадатов, Х.А. |
|---|---|
| Jurnal | Ҳисоблаш ва амалий математика муаммолари |
| Nashr sanasi | 2024-05-22 |
| Son | 2 |
| Betlar | 99-105 |
| Til | Rus |
TF-IDF, stop words, tuple, dictionary, unique words, TF-IDF, несущественное слово, кортеж, словарь, уникальные слова
This article is devoted to the problem of assessing the level of information security of educational information systems in the context of digital transformation of society. It proposes a methodology based on expert…
Artificial intelligence-based methods can significantly improve the traditional expen sive drug development process, given the fact that various generative models are already widely used in chemistry. Generative models…
The analysis and prediction of pollutant dispersion in the atmosphere continue to be crucial areas of environmental research. Mathematical models are the most effective tools for identifying and understanding the…
The paper examines the hydrodynamic process of in-situ leaching, used for the ex traction of expensive metals from ore deposits by acid treatment of the collector. For a comprehensive study, monitoring and forecasting…
The paper presents the problem of numerical calculation of turbulent flow in a channel with an obstacle based on the COMSOL MULTIPHYSICS software package. Turbulent flow in a channel with an obstacle is a complex…
The article analyzed the accumulated experience in the development of oil fields, algorithms for solving various filtration problems, the development of computer programs for the design, forecasting and analysis of oil…
This article presents a numerical solution to the boundary inverse problem for the equation of relaxation filtration in porous media under elastic conditions. To solve the problem, the marching method of De Sousa was…
A mathematical model has been developed for studying and predicting the process of transport and diffusion of harmful substances in the surface layer of the atmosphere. The model is based on the fundamental laws of…
The article covers the theoretical and practical aspects of the mathematical model for predicting the movement and level of underground water based on the studied literature. An improved mathematical model based on…
This article discusses the mathematical modeling of the processes of the deformed state of mesh plates with a complex configuration of the area in the plan. In particular, a mathematical model of the deformed state…