Automated construction of a punctuation-tagged corpus for transformer–bilstm-based punctuation restoration in uzbek

Sharipov, Maksud Siddiqovich, Adinayev, Hushnudbek Saylboyevich, Шарипов, Максуд Сиддикович, Адинаев, Хушнудбек Сайлбоевич, Sharipov, Maqsud Siddiqovich, Adinayev, Xushnudbek Saylboyevich

Ilim ha’m ja’miyet · 2026-yil

Annotatsiya

This study proposes an automated algorithm for constructing a punctuation-annotated dataset for training Transformer–BiLSTM models in Uzbek. The process includes text normalization, punctuation-aware tokenization, token-level labeling, dataset partitioning, and conversion into CoNLL format. A total of 11 labels are used, and the resulting corpus contains 11,888,213 tokens. The proposed method is intended for preparing large-scale annotated Uzbek data for punctuation restoration.

Maqola ma’lumotlari
MualliflarSharipov, Maksud Siddiqovich, Adinayev, Hushnudbek Saylboyevich, Шарипов, Максуд Сиддикович, Адинаев, Хушнудбек Сайлбоевич, Sharipov, Maqsud Siddiqovich, Adinayev, Xushnudbek Saylboyevich
JurnalIlim ha’m ja’miyet
NashriyotНукус давлат педагогика институти
ISSN2010-720x, 2181-1555
Nashr sanasi2026-09-30
Son6-1
Betlar37-39
TilIngliz
Ilmiy sohaTexnika
Indeksga qo‘shilgan2026-10-01

Kalit so‘zlar

punktuatsiyani tiklash, oʻzbek tili, Transformer, BiLSTM, tabiiy tilni qayta ishlash, восстановление пунктуации, узбекский язык, Transformer, BiLSTM, обработка естественного языка, punctuation restoration, Uzbek language, Transformer, BiLSTM, natural language processing

Ilmiy soha

Iqtibos keltirish

APASharipov, Maksud Siddiqovich, Adinayev, Hushnudbek Saylboyevich, Шарипов, Максуд Сиддикович, Адинаев, Хушнудбек Сайлбоевич, Sharipov, Maqsud Siddiqovich, & Adinayev, Xushnudbek Saylboyevich (2026). AUTOMATED CONSTRUCTION OF A PUNCTUATION-TAGGED CORPUS FOR TRANSFORMER–BILSTM-BASED PUNCTUATION RESTORATION IN UZBEK. Ilim ha’m ja’miyet, (6-1), 37-39. https://journal.ndpi.uz/index/article/view/2026-6-1-011
GOST (OAK)Sharipov, Maksud Siddiqovich va b. AUTOMATED CONSTRUCTION OF A PUNCTUATION-TAGGED CORPUS FOR TRANSFORMER–BILSTM-BASED PUNCTUATION RESTORATION IN UZBEK // Ilim ha’m ja’miyet. – 2026. – № 6-1. – P. 37-39.
MLASharipov, Maksud Siddiqovich, Adinayev, Hushnudbek Saylboyevich, Шарипов, Максуд Сиддикович, Адинаев, Хушнудбек Сайлбоевич, Sharipov, Maqsud Siddiqovich, and Adinayev, Xushnudbek Saylboyevich. “AUTOMATED CONSTRUCTION OF A PUNCTUATION-TAGGED CORPUS FOR TRANSFORMER–BILSTM-BASED PUNCTUATION RESTORATION IN UZBEK.” Ilim ha’m ja’miyet, (6-1), 37-39, 2026. https://journal.ndpi.uz/index/article/view/2026-6-1-011
ChicagoSharipov, Maksud Siddiqovich, Adinayev, Hushnudbek Saylboyevich, Шарипов, Максуд Сиддикович, Адинаев, Хушнудбек Сайлбоевич, Sharipov, Maqsud Siddiqovich, and Adinayev, Xushnudbek Saylboyevich. “AUTOMATED CONSTRUCTION OF A PUNCTUATION-TAGGED CORPUS FOR TRANSFORMER–BILSTM-BASED PUNCTUATION RESTORATION IN UZBEK.” Ilim ha’m ja’miyet, (6-1), 37-39 (2026). https://journal.ndpi.uz/index/article/view/2026-6-1-011
HarvardSharipov, Maksud Siddiqovich, Adinayev, Hushnudbek Saylboyevich, Шарипов, Максуд Сиддикович, Адинаев, Хушнудбек Сайлбоевич, Sharipov, Maqsud Siddiqovich, and Adinayev, Xushnudbek Saylboyevich (2026) ‘AUTOMATED CONSTRUCTION OF A PUNCTUATION-TAGGED CORPUS FOR TRANSFORMER–BILSTM-BASED PUNCTUATION RESTORATION IN UZBEK’, Ilim ha’m ja’miyet, (6-1), 37-39. https://journal.ndpi.uz/index/article/view/2026-6-1-011
BibTeX
@article{sharipovmaksudsiddiqovich2026,
  title = {AUTOMATED CONSTRUCTION OF A PUNCTUATION-TAGGED CORPUS FOR TRANSFORMER–BILSTM-BASED PUNCTUATION RESTORATION IN UZBEK},
  author = {Sharipov, Maksud Siddiqovich and Adinayev, Hushnudbek Saylboyevich and Шарипов, Максуд Сиддикович and Адинаев, Хушнудбек Сайлбоевич and Sharipov, Maqsud Siddiqovich and Adinayev, Xushnudbek Saylboyevich},
  journal = {Ilim ha’m ja’miyet},
  year = {2026},
  number = {6-1},
  pages = {37-39},
  url = {https://journal.ndpi.uz/index/article/view/2026-6-1-011}
}

Boshqa maqola uchun iqtibos tayyorlash

Ilim ha’m ja’miyet jurnalidan boshqa maqolalar

Ilim ha’m ja’miyet — barcha maqolalar · 2026-yil arxivi

Sharipov, Maksud Siddiqovich — boshqa maqolalari

Texnika sohasidagi boshqa maqolalar

Texnika sohasidagi OAK jurnallari