Language recognition in natural language processing (NLP) aims to determine the specific language of a text or document. As the number of languages increases, this task becomes more complex. This study introduces a detailed model for detecting languages from text, with an emphasis on the Latin-Cyrillic script of the Uzbek language. Noting the research gap in this domain, we unveil a precise Uzbek Latin-Cyrillic script recognition model leveraging an apt transformer architecture. The model was tested on our self-compiled Uzbek language corpus, which also offers a robust benchmark for subsequent Uzbek language identification studies. Our approach encompasses 21 languages, including Uzbek, across both Latin and Cyrillic alphabets. Our findings highlight that the XLM-RoBERTa transformer-driven language detection model significantly outperforms its predecessors in terms of accuracy and efficiency.
| Mualliflar | Адилова, Ф.Т., Давронов, Р.Р., Сафаров, Р.А. |
|---|---|
| Jurnal | Рақамли технологияларнинг назарий ва амалий масалалари |
| Nashr sanasi | 2023-10-02 |
| Jild | 5 |
| Son | 3 |
| Betlar | 47-56 |
| Til | Ingliz |
NLP, Multilingual Language Models, Cloud Natural Language API, Open AI, ChatGPT, model compression, transformer, NLP, Многоязычные языковые модели, Облачный API естественного языка, Открытый ИИ, ChatGPT, сжатие модели, преобразователь
Ushbu maqolada dinamik va kalitga bog‘liq bo‘lgan S-boxlarni generatsiyalash uchun oddiy va innovatsion sxema taklif qilingan bo‘lib, mazkur algoritm yordamida generatsiyalangan almashtirish jadvalidan oqimli shifrlash…
Currently, the demand for mobile applications for evaluating and analyzing the performance of medical information systems is increasing due to the need of time for digitization. Medical mobile applications are software…
Ushbu maqolada kvant algoritmlarning Grover usuli orqali global optimallashtirish masalasini yechish jarayonlari koʻrib chiqilgan boʻlib, global optimallashtirish masalasini kvant algoritmlar orqali yechishda bir…
In the article reviewed basics of quantization of digital images, discriting non-continuous images sampling and uniform quantization of brightness based on the use of a rectangular raster are practiced. This is due to…
This article examines the types, methods of creation and technology of log-periodic dipole antennas (LDPA), and presents the features of the use of these antennas in the field of communications. During the study, an…
Shaxsni ovozi asosida identifikatsiyalash tizimlari bugungi kunda amaliyotda keng qoʻllanilmoqda. Jumladan, ma’lumotlar bazasiga kirish, bank, kriminalistik ekspertiza kabilarda sohalarda keng qoʻllanilmoqda. Shaxsni…
Usually, the complete system of thermoelasticity equations consists of the equation of motion, the Dugamel-Neumann relations, the Cauchy relation, and the heat influx equation. In this case, usually the boundary value…
Fires are one of the most serious and destructive natural and man-made disasters, having dangerous consequences for human life, property and the environment. This article presents the general structure of a hardware and…
The dynamics of electrically conductive media in electric and magnetic fields is currently an extensive and well-developed science, formed at the intersection of mechanics and electrodynamics. When constructing such…
Despite being spoken by nearly 50 million individuals, the Uzbek language remains underrepresented in Natural Language Processing (NLP). One primary reason is the limited availability of Uzbek linguistic resources. With…
Рақамли технологияларнинг назарий ва амалий масалалари — barcha maqolalar