In the field of natural language processing, the stages of graphematic analysis (tokenization), morphological analysis (lemmatization and stemming), syntactic analysis (parsing), and semantic analysis are important for almost all areas of NLP. It is possible to create many software applications from processed natural language for digital technology. In NLP, the lemmatization and stemming technologies of morphological analysis are common to all languages, and they determine the normal form of word forms in the dictionary. Although the task of lemmatization and stemming is the same, they differ in terms of producing the result. While stemming is valuable as a fast process, lemmatization is considered important in terms of providing a clear linguistic result. Although lemmatization with the feature of determining inflection was intended for inflectional languages, it is currently also used for agglutinative languages. Both technologies are important in the processing of the Uzbek language. This article discusses the similarities and differences between lemmatization and stemming, the use of both technologies in the Uzbek language, and the distinction between the term "morphological analysis" in NLP and Uzbek linguistics.
| Mualliflar | Manzura Abjalova |
|---|---|
| Jurnal | Ўзбекистон: тил ва маданият |
| Nashr sanasi | 2024-09-10 |
| Jild | 3 |
| Son | 3 |
| Betlar | 6-21 |
| Til | en |
| DOI | 10.52773/tsuull.uzlc.2024.3/hvmn8509 |
DOI: 10.52773/tsuull.uzlc.2024.3/hvmn8509 · Maqolaning asl sahifasi · PDF
When analyzing the specific performance role, performance method, purpose of expression, poetic features, structure, and rhyme of the “Yor-yor” songs related to the wedding ceremonies of the Turkic peoples, the specific…
Borrowed tourism terms used in the Azerbaijani language in the article and their charter process, unification issues were studied. It is determined that the development of the field of tourism is the lexicon of tourism…
Sarı Saltuk, a dervish who lived in the 13th century, and Ibn Battuta, a traveler who lived in the 14th century, were born in relatively close centuries. Another common feature of both is that they dared to move away…
The article examines the influence of Abdulla Oripov’s great predecessors and contemporaries and his literary circle on the development of Abdulla Oripov’s aesthetic views. Based on the analysis, it has been proven that…
During the Samanid rule (9th-10th centuries), the Turks, as in the Abbasid palace in Baghdad, played an important role in the administration of this dynasty from the beginning to the end. During the Samanid period…
The paper studies the problems of methodology and theory of intergeneration attitudes. As the initial methodological basis of this problem Platon’s idea about the patrimonial person is designated as well as the views of…
The poem "My Uzbekistan" expresses the deep love of the Uzbek people for their homeland It is an effective work that highlights the national identity. Poetry, history of Uzbekistan, draws attention to the beauty of…
This article analyses the identification features of handwritten texts related to the judicial investigation process. In particular, the gram- matical, lexical-semantic and stylistic features of handwritten texts whose…
This study examines the advantages and disadvantages of using artificial intelligence (AI) in education. The introduction of AI opens up new opportunities for personalizing learning, improving teaching efficiency, and…
The article covers the basics of studying homonyms in the Uzbek and Turkish languages in the linguocognitive aspect. It is noted that studies of homonymy in world linguistics are studied primarily on the basis of a…