Collecting textual data from websites for low-resource languages

Uteuliev, Nietbay Uteulievich, Abdalieva, Gulistan Rafikovna, Kalmuratov, Bekbos Kushkinbaevich, Asenbaeva, Dalloris Adilbayevna, Утеулиев, Ниетбай Утеулиевич, Абдалиева, Гулистан Рафиковна, Калмуратов, Бекбос Кушкинбаевич, Асенбаева, Даллорис Адилбаевна, Uteuliev, Nietbay Uteulievich, Abdalieva, Gulistan Rafikovna, Kalmuratov, Bekbos Kushkinbaevich, Asenbaeva, Dalloris Adilbay qizi

Ilim ha’m ja’miyet · 2026-yil

Annotatsiya

This article focuses on the automatic collection of textual data from websites for low-resource languages, using the Karakalpak language as a case study. The study developed a methodology for collecting article texts from kknews.uz, yuz.uz, and joqargikenes.uz using Python, Requests, and BeautifulSoup. As a result, 1 386 navigation pages were analyzed, and a primary raw text database containing 18 784 articles and 6 090 553 words was formed. The collected raw corpus may serve as an initial resource for further preprocessing and for future development of NLP systems, machine translation tools, and Transformer-based models for the Karakalpak language.

Maqola ma’lumotlari
MualliflarUteuliev, Nietbay Uteulievich, Abdalieva, Gulistan Rafikovna, Kalmuratov, Bekbos Kushkinbaevich, Asenbaeva, Dalloris Adilbayevna, Утеулиев, Ниетбай Утеулиевич, Абдалиева, Гулистан Рафиковна, Калмуратов, Бекбос Кушкинбаевич, Асенбаева, Даллорис Адилбаевна, Uteuliev, Nietbay Uteulievich, Abdalieva, Gulistan Rafikovna, Kalmuratov, Bekbos Kushkinbaevich, Asenbaeva, Dalloris Adilbay qizi
JurnalIlim ha’m ja’miyet
NashriyotНукус давлат педагогика институти
ISSN2010-720x, 2181-1555
Nashr sanasi2026-06-30
Son4-1
Betlar46-48
TilIngliz
Indeksga qo‘shilgan2026-08-26

Maqolaning asl sahifasi

Kalit so‘zlar

qoraqalpoq tili, web scraping, elektron korpus, kam resursli tillar, NLP, каракалпакский язык, веб-скрейпинг, электронный корпус, языки с ограниченными ресурсами, NLP, Karakalpak language, web scraping, electronic corpus, low-resource languages, NLP

Iqtibos keltirish

APAUteuliev, Nietbay Uteulievich, Abdalieva, Gulistan Rafikovna, Kalmuratov, Bekbos Kushkinbaevich, Asenbaeva, Dalloris Adilbayevna, Утеулиев, Ниетбай Утеулиевич, Абдалиева, Гулистан Рафиковна, Калмуратов, Бекбос Кушкинбаевич, Асенбаева, Даллорис Адилбаевна, Uteuliev, Nietbay Uteulievich, Abdalieva, Gulistan Rafikovna, Kalmuratov, Bekbos Kushkinbaevich, & Asenbaeva, Dalloris Adilbay qizi (2026). COLLECTING TEXTUAL DATA FROM WEBSITES FOR LOW-RESOURCE LANGUAGES. Ilim ha’m ja’miyet, (4-1), 46-48. https://journal.ndpi.uz/index/article/view/2026-4-1-014
GOST (OAK)Uteuliev, Nietbay Uteulievich va b. COLLECTING TEXTUAL DATA FROM WEBSITES FOR LOW-RESOURCE LANGUAGES // Ilim ha’m ja’miyet. – 2026. – № 4-1. – P. 46-48.
MLAUteuliev, Nietbay Uteulievich, Abdalieva, Gulistan Rafikovna, Kalmuratov, Bekbos Kushkinbaevich, Asenbaeva, Dalloris Adilbayevna, Утеулиев, Ниетбай Утеулиевич, Абдалиева, Гулистан Рафиковна, Калмуратов, Бекбос Кушкинбаевич, Асенбаева, Даллорис Адилбаевна, Uteuliev, Nietbay Uteulievich, Abdalieva, Gulistan Rafikovna, Kalmuratov, Bekbos Kushkinbaevich, and Asenbaeva, Dalloris Adilbay qizi. “COLLECTING TEXTUAL DATA FROM WEBSITES FOR LOW-RESOURCE LANGUAGES.” Ilim ha’m ja’miyet, (4-1), 46-48, 2026. https://journal.ndpi.uz/index/article/view/2026-4-1-014
ChicagoUteuliev, Nietbay Uteulievich, Abdalieva, Gulistan Rafikovna, Kalmuratov, Bekbos Kushkinbaevich, Asenbaeva, Dalloris Adilbayevna, Утеулиев, Ниетбай Утеулиевич, Абдалиева, Гулистан Рафиковна, Калмуратов, Бекбос Кушкинбаевич, Асенбаева, Даллорис Адилбаевна, Uteuliev, Nietbay Uteulievich, Abdalieva, Gulistan Rafikovna, Kalmuratov, Bekbos Kushkinbaevich, and Asenbaeva, Dalloris Adilbay qizi. “COLLECTING TEXTUAL DATA FROM WEBSITES FOR LOW-RESOURCE LANGUAGES.” Ilim ha’m ja’miyet, (4-1), 46-48 (2026). https://journal.ndpi.uz/index/article/view/2026-4-1-014
HarvardUteuliev, Nietbay Uteulievich, Abdalieva, Gulistan Rafikovna, Kalmuratov, Bekbos Kushkinbaevich, Asenbaeva, Dalloris Adilbayevna, Утеулиев, Ниетбай Утеулиевич, Абдалиева, Гулистан Рафиковна, Калмуратов, Бекбос Кушкинбаевич, Асенбаева, Даллорис Адилбаевна, Uteuliev, Nietbay Uteulievich, Abdalieva, Gulistan Rafikovna, Kalmuratov, Bekbos Kushkinbaevich, and Asenbaeva, Dalloris Adilbay qizi (2026) ‘COLLECTING TEXTUAL DATA FROM WEBSITES FOR LOW-RESOURCE LANGUAGES’, Ilim ha’m ja’miyet, (4-1), 46-48. https://journal.ndpi.uz/index/article/view/2026-4-1-014
BibTeX
@article{uteulievnietbayuteulievich2026,
  title = {COLLECTING TEXTUAL DATA FROM WEBSITES FOR LOW-RESOURCE LANGUAGES},
  author = {Uteuliev, Nietbay Uteulievich and Abdalieva, Gulistan Rafikovna and Kalmuratov, Bekbos Kushkinbaevich and Asenbaeva, Dalloris Adilbayevna and Утеулиев, Ниетбай Утеулиевич and Абдалиева, Гулистан Рафиковна and Калмуратов, Бекбос Кушкинбаевич and Асенбаева, Даллорис Адилбаевна and Uteuliev, Nietbay Uteulievich and Abdalieva, Gulistan Rafikovna and Kalmuratov, Bekbos Kushkinbaevich and Asenbaeva, Dalloris Adilbay qizi},
  journal = {Ilim ha’m ja’miyet},
  year = {2026},
  number = {4-1},
  pages = {46-48},
  url = {https://journal.ndpi.uz/index/article/view/2026-4-1-014}
}

Boshqa maqola uchun iqtibos tayyorlash

Ilim ha’m ja’miyet jurnalidan boshqa maqolalar

Ilim ha’m ja’miyet — barcha maqolalar · 2026-yil arxivi

Uteuliev, Nietbay Uteulievich — boshqa maqolalari