Language recognition in natural language processing (NLP) aims to determine the specific language of a text or document. As the number of languages increases, this task becomes more complex. This study introduces a detailed model for detecting languages from text, with an emphasis on the Latin-Cyrillic script of the Uzbek language. Noting the research gap in this domain, we unveil a precise Uzbek Latin-Cyrillic script recognition model leveraging an apt transformer architecture. The model was tested on our self-compiled Uzbek language corpus, which also offers a robust benchmark for subsequent Uzbek language identification studies. Our approach encompasses 21 languages, including Uzbek, across both Latin and Cyrillic alphabets. Our findings highlight that the XLM-RoBERTa transformer-driven language detection model significantly outperforms its predecessors in terms of accuracy and efficiency.
| Mualliflar | Адилова, Ф.Т., Давронов, Р.Р., Сафаров, Р.А. |
|---|---|
| Jurnal | Рақамли технологияларнинг назарий ва амалий масалалари |
| Nashriyot | ТАТУ Самарқанд филиали |
| ISSN | 2181-3086, 2181-3094 |
| Nashr sanasi | 2023-10-02 |
| Jild | 5 |
| Son | 3 |
| Betlar | 47-56 |
| Til | Ingliz |
| Ilmiy soha | Texnika |
| Indeksga qo‘shilgan | 2026-08-26 |
NLP, Multilingual Language Models, Cloud Natural Language API, Open AI, ChatGPT, model compression, transformer, NLP, Многоязычные языковые модели, Облачный API естественного языка, Открытый ИИ, ChatGPT, сжатие модели, преобразователь
| APA | Адилова, Ф.Т., Давронов, Р.Р., & Сафаров, Р.А. (2023). An Integrated Analysis of Multilingual Texts Spanning Dual Alphabets. Рақамли технологияларнинг назарий ва амалий масалалари, 5(3), 47-56. https://ijdt.uz/index.php/ijdt/article/view/110 |
|---|---|
| GOST (OAK) | Адилова, Ф.Т., Давронов, Р.Р., Сафаров, Р.А. An Integrated Analysis of Multilingual Texts Spanning Dual Alphabets // Рақамли технологияларнинг назарий ва амалий масалалари. – 2023. – T. 5, № 3. – P. 47-56. |
| MLA | Адилова, Ф.Т., Давронов, Р.Р., and Сафаров, Р.А. “An Integrated Analysis of Multilingual Texts Spanning Dual Alphabets.” Рақамли технологияларнинг назарий ва амалий масалалари, 5(3), 47-56, 2023. https://ijdt.uz/index.php/ijdt/article/view/110 |
| Chicago | Адилова, Ф.Т., Давронов, Р.Р., and Сафаров, Р.А. “An Integrated Analysis of Multilingual Texts Spanning Dual Alphabets.” Рақамли технологияларнинг назарий ва амалий масалалари, 5(3), 47-56 (2023). https://ijdt.uz/index.php/ijdt/article/view/110 |
| Harvard | Адилова, Ф.Т., Давронов, Р.Р., and Сафаров, Р.А (2023) ‘An Integrated Analysis of Multilingual Texts Spanning Dual Alphabets’, Рақамли технологияларнинг назарий ва амалий масалалари, 5(3), 47-56. https://ijdt.uz/index.php/ijdt/article/view/110 |
| BibTeX | @article{article2023,
title = {An Integrated Analysis of Multilingual Texts Spanning Dual Alphabets},
author = {Адилова, Ф.Т. and Давронов, Р.Р. and Сафаров, Р.А.},
journal = {Рақамли технологияларнинг назарий ва амалий масалалари},
year = {2023},
volume = {5},
number = {3},
pages = {47-56},
url = {https://ijdt.uz/index.php/ijdt/article/view/110}
} |
Boshqa maqola uchun iqtibos tayyorlash
Despite being spoken by nearly 50 million individuals, the Uzbek language remains underrepresented in Natural Language Processing (NLP). One primary reason is the limited availability of Uzbek linguistic resources. With…
Fires are one of the most serious and destructive natural and man-made disasters, having dangerous consequences for human life, property and the environment. This article presents the general structure of a hardware and…
Shaxsni ovozi asosida identifikatsiyalash tizimlari bugungi kunda amaliyotda keng qoʻllanilmoqda. Jumladan, ma’lumotlar bazasiga kirish, bank, kriminalistik ekspertiza kabilarda sohalarda keng qoʻllanilmoqda. Shaxsni…
In the article reviewed basics of quantization of digital images, discriting non-continuous images sampling and uniform quantization of brightness based on the use of a rectangular raster are practiced. This is due to…
Currently, the demand for mobile applications for evaluating and analyzing the performance of medical information systems is increasing due to the need of time for digitization. Medical mobile applications are software…
Ushbu maqolada dinamik va kalitga bog‘liq bo‘lgan S-boxlarni generatsiyalash uchun oddiy va innovatsion sxema taklif qilingan bo‘lib, mazkur algoritm yordamida generatsiyalangan almashtirish jadvalidan oqimli shifrlash…
Ushbu maqolada kvant algoritmlarning Grover usuli orqali global optimallashtirish masalasini yechish jarayonlari koʻrib chiqilgan boʻlib, global optimallashtirish masalasini kvant algoritmlar orqali yechishda bir…
This article examines the types, methods of creation and technology of log-periodic dipole antennas (LDPA), and presents the features of the use of these antennas in the field of communications. During the study, an…
Usually, the complete system of thermoelasticity equations consists of the equation of motion, the Dugamel-Neumann relations, the Cauchy relation, and the heat influx equation. In this case, usually the boundary value…
The dynamics of electrically conductive media in electric and magnetic fields is currently an extensive and well-developed science, formed at the intersection of mechanics and electrodynamics. When constructing such…
Рақамли технологияларнинг назарий ва амалий масалалари — barcha maqolalar · 2023-yil arxivi
Artificial intelligence-based methods can significantly improve the traditional expen sive drug development process, given the fact that various generative models are already widely used in chemistry. Generative models…
Quantum technologies are transforming industries by harnessing the principles of quantum mechanics. These innovations promise to revolutionize computing, communi cations, sensing, cryptography, and healthcare, offering…
The discovery of new chemical compounds with specified properties is a challenging problem in drug development. Many studies encode molecules as string representations derived from molecular graphs; however, this…
Large Language Models (LLM) have demonstrated remarkable capabilities in understanding and generating natural language in various fields, including medicine. The article presents an assessment of GMT-4 based on two…
This article presents a new internal validity index of clustering called the Core Separation Index (CSI), designed to improve the quality and automate graph-based density clustering algorithms. The proposed index…
Despite being spoken by nearly 50 million individuals, the Uzbek language remains underrepresented in Natural Language Processing (NLP). One primary reason is the limited availability of Uzbek linguistic resources. With…
This article examines compression as a meaning-oriented strategy in sign language translation and interpreting. Compression is understood not as arbitrary shortening, but as the selective reformulation of a source…
This study investigates the impact of Edge Computing on bandwidth utilization in Internet of Things (IoT)–driven Nigerian telecom networks. The rapid growth of IoT devices has significantly increased data traffic…
This article analyzes the scientific, pedagogical, and methodological foundations for the effective integration of national upbringing factors with modern global competencies in the context of continuous education…
This article addresses the problem of improving an adaptive traffic signal control algorithm at urban intersections by taking into account the dynamic characteristics of traffic flow. Fixed-time control under conditions…
Maqolada paxta xomashyosini yirik iflosliklardan tozalash jarayonida arrali baraban va kolosnikli panjara o‘rtasidagi o‘zaro ta’sirni takomillashtirish masalasi ko‘rib chiqilgan. Mavjud tozalagichlarda qo‘llaniladigan…
Maqolada paxta xomashyosini yirik va mayda iflosliklardan tozalash samaradorligini oshirishga qaratilgan ilmiy tadqiqotlar tizimlashtirilib, konstruktiv va texnologik omillarning o‘zaro ta’siri qiyosiy tahlil qilindi…