arXiv12501.09223v1 2cs.CL3 16 Jan 2025

Apuntes

arXiv:2501.09223v1 [cs.CL] 16 Jan 2025 Foundations of Large Language Models Tong Xiao and Jingbo Zhu January 17, 2025 NLP Lab, Northeastern University & NiuTrans Research Copyright © 2021-2025 Tong Xiao and Jingbo Zhu N ATURAL L ANGUAGE P ROCESSING L AB , N ORTHEASTERN U NIVERSITY & N IU T RANS R ESEARCH Licensed under the Creative Commons Attribution-NonCommercial 4.0 Unported License (the “License”). You may not use this file except in compliance with the License. You may ob- tain a copy of the License at http://creativecommons.org/licenses/by-nc/4.0 . Unless required by applicable law or agreed to in writing, software distributed under the License is dis- tributed on an “ AS IS ” BASIS , WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND , either express or implied. See the License for the specific language governing permissions and limita- tions under the License. January 17, 2025 Preface Large language models originated from natural language processing, but they have undoubtedly become one of the most revolutionary technological advancements in the field of artificial intelli- gence in recent years. An important insight brought by large language models is that k...