touvron2023-llama
arXiv: 2302.13971
TLDR (English)
Meta implements "small but precise + massive tokens" Chinchilla recipe and opens weights. LLaMA 1 directly catalyzed open-source LLM explosion (Alpaca/Vicuna/Mistral/Qwen all benefited).
TLDR(中文)
Meta 把"小而精 + 大规模 token"的 Chinchilla 配方实操出来,并开放权重。LLaMA 1 直接催生了开源 LLM 大爆炸(Alpaca / Vicuna / Mistral / Qwen 全部受益)。