TRANSFORMER ARXITEKTURASIGA ASOSLANGAN TIL MODELLARI YORDAMIDA O‘ZBEK TILI MATNLARINI SEMANTIK TAHLIL QILISH
Keywords:
Transformer arxitektura, sun’iy intellekt, semantik tahlil, tabiiy tilni qayta ishlash, til modellari, BERT, GPT, RoBERTa, XLNet, T5, kontekstAbstract
Maqolada sun’iy intellekt texnologiyalariga asoslangan holatda matnlarning semantik tahlil qilish jarayonlari, zamonaviy yondashuvlar va mavjud muammolarga yondashuvlar o‘rganilgan. Tadqiqotda Transformer arxitekturasiga asoslangan til modellari (BERT, GPT, RoBERTa) tahlil qilinib, ularning imkoniyatlari va cheklovlari o‘zbek tilidagi matnlar misolida baholangan. Shuningdek, xalqaro miqyosda keng tarqalmagan milliy yoki mintaqaviy tillar(lokal tillar)da semantik tahlilni rivojlantirish bo‘yicha tavsiyalar ishlab chiqilgan.
References
1. Jurafsky, D. Speech and Language Processing: An Introduction to Natural Language Processing, Computational Linguistics, and Speech Recognition / D. Jurafsky, J. H. Martin. – 2nd ed. – Upper Saddle River, NJ: Prentice Hall, 2009. –P. 988-1000
2. Raffel, C. Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer / C. Raffel, N. Shazeer, A. Roberts, K. Lee, S. Narang, M. Matena, Y. Zhou, W. Li, P. J. Liu // Journal of Machine Learning Research. – 2020. – Vol. 21, № 140. – P. 1–67
3. Vaswani, A. Attention is All You Need / A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, L. Kaiser, I. Polosukhin // Advances in Neural Information Processing Systems. – 2017. – Vol. 30. – P. 5998–6008
4. Kakhorov A., Yodgorova D., Khayrullayev M. “AI-DRIVEN ENVIRONMENTAL COMMUNICATION: TRANSLATING SUSTAINABILITY REPORTS INTO UZBEK FOR GLOBAL AWARENESS” №6(121)-1. –P.292-300
5. Devlin, J. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding / J. Devlin, M.-W. Chang, K. Lee, K. Toutanova // Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. – 2019. – P. 4171–4186
6. Camacho-Collados, J. From Word to Sense Embeddings: A Survey on Vector Representations of Meaning / J. Camacho-Collados, M. T. Pilehvar // Computational Linguistics. – 2023. – Vol. 49, № 2. – P. 431–486
7. Sharipov, M. Creating a Morphological and Syntactic Tagged Corpus for the Uzbek Language / M. Sharipov, U. Salaev, S. Matlatipov, E. Kuriyozov // CEUR Workshop Proceedings. – 2023. – Vol. 3315. – P. 107–117
8. Allaberganova Nasiba Muradovna, Abdrimova Feruza Kamiljanovna. “His-tuyg‘ularni tahlil qilish usullari”, Scientific journal “Golden Brain”. Vol. 1, No 13. Uzbekistan – 2023. – B.260-267
9. Boltayevich, Mo‘minov Bahodir, Allaberganova Nasiba Muradovna, and Shermatov Boburjon Inoyat O‘g‘li. "NLPDA PYTHON DASTURLASH TILIDAGI BA’ZI JARAYONLAR". PROSPECTS A ND MAIN TRENDS IN MODERN SCIENCE 1.12 (2024): – B.88-97
11. Allaberganova Nasiba Muradovna, Asqarova Dildora Ulug‘bekovna. “Semantik tahlil” International scientific journal “Interpretation and researches”. Volume 1, Issue 10, 2023. ISSN: 2181-4163. – B.189-193
12. Allaberganova Nasiba Muradovna “Transformer avlodidagi modellar orqali o‘zbek tili uchun lemmatizatsiya va named entity recognition muammolarining yechimi”, “Sun’iy intellekt nazariyasi va amaliyoti: tajriba, muammolar va istiqbollar” mavzusidagi II Respublika ilmiy-amaliy anjumani materiallar to‘plami.
Toshkent – 2025. – B.37-39
Downloads
Published
Issue
Section
License
Copyright (c) 2025 Mo‘minov Bahodir Boltayevich, Allaberganova Nasiba Muradovna
This work is licensed under a Creative Commons Attribution 4.0 International License.
