A mathematical model for the automatic extraction of idioms in Turkic languages

Nazirova, E.Sh., Madetbaeva, N.B., Mirzaeva, F.Sh., Islomova, M.B., Назирова, Э.Ш., Мадетбаева, Н.Б., Мирзаева, Ф.Ш., Исломова, М.Б.

Ҳисоблаш ва амалий математика муаммолари · 2026-yil

Annotatsiya

This paper presents a complete mathematical model for the automatic extraction of phraseological units (idioms) from texts in Turkic languages, with a focus on Uzbek. The task is formulated as a binary classification problem and is solved by a three-stage pipeline. At the first stage, a set of idiom candidates is generated by a linguistic filter based on verb-headed grammatical templates. At the second stage, each candidate is mapped to a feature vector that combines statistical association (pointwise mutual information), syntactic fixedness (a flexibility index), semantic non-compositionality, and template-lexical indicators. At the third stage, a decision function is trained using four classification algorithms, namely Naive Bayes, logistic regression, support vector machines (SVM), and gradient boosting. The model was evaluated on a combined Uzbek corpus of 1.07 million lemma-tokens, supported by a phraseological ontology of 1,362 units and a manually annotated, stratified gold-standard set of 400 sentences. The best overall result was achieved by the SVM (????1 = 0.795; recall = 0.906), followed closely by gradient boosting (????1 = 0.791), whereas the lexical string-matching baseline proved nearly ineffective (????1 = 0.100) and ontology-based matching provided the highest precision (???? = 0.854). Stratified analysis showed that the main advantage of the model lies in recognizing morphologically transformed forms of idioms, where the learning-based model reached a recall of 0.919 against 0.041 for the lexical baseline. The role of each method within the processing pipeline and its most effective area of application are discussed.

Maqola ma’lumotlari
MualliflarNazirova, E.Sh., Madetbaeva, N.B., Mirzaeva, F.Sh., Islomova, M.B., Назирова, Э.Ш., Мадетбаева, Н.Б., Мирзаева, Ф.Ш., Исломова, М.Б.
JurnalҲисоблаш ва амалий математика муаммолари
NashriyotТошкент ахборот технологиялари университети қошидаги, Ахборот-коммуникация технологиялари илмий-инновацион, маркази
ISSN2181-8460, 2181-046X
Nashr sanasi2026-09-15
Son4
Betlar152-170
TilIngliz
Ilmiy sohaTexnika
DOI10.71310/pcam.4_74.2026.10
Indeksga qo‘shilgan2026-09-16

Kalit so‘zlar

phraseological unit, idiom detection, binary classification, pointwise mutual information, syntactic fixedness, Uzbek language, фразеологизм, автоматическое выделение фразеологизмов, бинарная классификация, поточечная взаимная информация, синтаксическая устойчивость, узбекский язык

Ilmiy soha

Iqtibos keltirish

APANazirova, E.Sh., Madetbaeva, N.B., Mirzaeva, F.Sh., Islomova, M.B., Назирова, Э.Ш., Мадетбаева, Н.Б., Мирзаева, Ф.Ш., & Исломова, М.Б. (2026). A mathematical model for the automatic extraction of idioms in Turkic languages. Ҳисоблаш ва амалий математика муаммолари, (4), 152-170. https://doi.org/10.71310/pcam.4_74.2026.10
GOST (OAK)Nazirova, E.Sh. va b. A mathematical model for the automatic extraction of idioms in Turkic languages // Ҳисоблаш ва амалий математика муаммолари. – 2026. – № 4. – P. 152-170. – DOI: 10.71310/pcam.4_74.2026.10.
MLANazirova, E.Sh., Madetbaeva, N.B., Mirzaeva, F.Sh., Islomova, M.B., Назирова, Э.Ш., Мадетбаева, Н.Б., Мирзаева, Ф.Ш., and Исломова, М.Б. “A mathematical model for the automatic extraction of idioms in Turkic languages.” Ҳисоблаш ва амалий математика муаммолари, (4), 152-170, 2026. https://doi.org/10.71310/pcam.4_74.2026.10
ChicagoNazirova, E.Sh., Madetbaeva, N.B., Mirzaeva, F.Sh., Islomova, M.B., Назирова, Э.Ш., Мадетбаева, Н.Б., Мирзаева, Ф.Ш., and Исломова, М.Б. “A mathematical model for the automatic extraction of idioms in Turkic languages.” Ҳисоблаш ва амалий математика муаммолари, (4), 152-170 (2026). https://doi.org/10.71310/pcam.4_74.2026.10
HarvardNazirova, E.Sh., Madetbaeva, N.B., Mirzaeva, F.Sh., Islomova, M.B., Назирова, Э.Ш., Мадетбаева, Н.Б., Мирзаева, Ф.Ш., and Исломова, М.Б (2026) ‘A mathematical model for the automatic extraction of idioms in Turkic languages’, Ҳисоблаш ва амалий математика муаммолари, (4), 152-170. https://doi.org/10.71310/pcam.4_74.2026.10
BibTeX
@article{nazirovaesh2026,
  title = {A mathematical model for the automatic extraction of idioms in Turkic languages},
  author = {Nazirova, E.Sh. and Madetbaeva, N.B. and Mirzaeva, F.Sh. and Islomova, M.B. and Назирова, Э.Ш. and Мадетбаева, Н.Б. and Мирзаева, Ф.Ш. and Исломова, М.Б.},
  journal = {Ҳисоблаш ва амалий математика муаммолари},
  year = {2026},
  number = {4},
  pages = {152-170},
  doi = {10.71310/pcam.4_74.2026.10},
  url = {https://doi.org/10.71310/pcam.4_74.2026.10}
}

Boshqa maqola uchun iqtibos tayyorlash

Ҳисоблаш ва амалий математика муаммолари jurnalidan boshqa maqolalar

Ҳисоблаш ва амалий математика муаммолари — barcha maqolalar · 2026-yil arxivi

Nazirova, E.Sh. — boshqa maqolalari

Texnika sohasidagi boshqa maqolalar

Texnika sohasidagi OAK jurnallari