The article deals with the topic of tokenization of text corpora of the Uzbek language, which should take into account the linguistic features of the spelling of the language. The types of words are analyzed and a mathematical model of word formation for complex, paired, repeated, and compound words is proposed. And also based on the models developed a finite state machine to demonstrate the spelling rules of the language, and the rules are implemented by regular expressions
| Mualliflar | Bakaev, I.I. |
|---|---|
| Jurnal | ТАТУ хабарлари |
| Nashr sanasi | 2021-04-03 |
| Til | en |
| DOI | 10.51348/tuitmct431 |
DOI: 10.51348/tuitmct431 · Maqolaning asl sahifasi
In recent years, the world's population growth has been intensifying, resulting in specific problems related to the depletion of natural resources, food shortages, declining fertile lands, and changing weather…
The article discusses the features and areas of application of multi-axis electromagnetic mechatronic modules in modules of mechatronic and robotic systems that allow not only to increase productivity and improve the…
Fundamental changes have occurred in today’s economy. These changes alter the relationship we have with our customers, our suppliers, our business partners and our colleagues. IT developments have presented companies…
The article describes an implementing a real time speaker identification system by voice for embedded and general purpose computers. A review and analysis of existing speaker identification algorithms are made. The…
The article examines the morphology of the Karakalpak language, which belongs to the Kipchak group of the Turkic language family. The forms of word formation in the Karakalpak language, their sequences and the affixes…
The article deals with the problems of determining the main quality indicators of a telecommunications network with different types of communication channels and the time-varying structure of their functioning to ensure…
In this paper, a mathematical model of the operation process of the ZigBee standard wireless network for remote monitoring systems based on the Markov chain apparatus was developed. Using the model was evaluated of the…
In this study, the reliability of mobile system base stations (BTS) is assessed by analyzing data obtained on faults in about 200 BTS over a six-month period. Five BTSs with the highest number of failures and duration…
The article discusses the approach to creating projects of organizational management systems that allow to use the theoretical and practical results of research in the field of artificial intelligence in their design…