Chu, Z. 2025. Application of Pre-training Model in Natural Language Processing. Transactions on Computer Science and Intelligent Systems Research. 9, (Jul. 2025), 16–23. DOI:https://doi.org/10.62051/8wsmzk54.