基于Word2vec的哈薩克文詞向量化模型的實現(xiàn)

打開文本圖片集

關(guān)鍵詞：哈薩克文；Word2vec；詞向量；相似度分析

doi：10.3969/J.ISSN.1672-7274.2025.05.050

中圖分類號：TP31 文獻標(biāo)志碼：B 文章編碼：1672-7274（2025）05-0148-03

Abstract： The word vector embedding technology is a crucial step in the study of natural language processing， which is digitized through vectorization so that natural language can be recognized by computers and relevant processing calculations.The implementation of Kazakh language vectorization based on Word2vec is important to support the research in the feldof Kazakh language machine translation，text clasificationand recognition.In the article，the open-source iFLYTEK Kazakh corpus dataset is used as a corpus，and after cleaning，tokenization and other steps，vectorization is implemented to convert each Kazakh word intoan independentK-bit wordvector byusing Word2vc tol.Through thecomputation ofthese word vectors，the discoveryof thecontextual semantic patterns contained intheKazakhtext，the extractionofthe textual keywords，andthecomputation of the similar wordscan be achieved.

Keywords：Kazakh language;Word2vec;word vector;analysis

0 引言

隨著“一帶一路”倡議的不斷深入。（剩余2828字）