Skip to content
LLM Primer

LLaMA: Open and Efficient Foundation Language Models

Authors: Hugo Touvron, Thibaut Lavril, Gautier Izacard, Xavier Martinet, Marie-Anne Lachaux, Timothée Lacroix, Baptiste Rozière, Naman Goyal, Eric Hambro, Faisal Azhar, Aurelien Rodriguez, Armand Joulin, Edouard Grave, Guillaume Lample (2023)

arXiv: 2302.13971

Domains

Pretraining

TLDR (English)

Meta implements "small but precise + massive tokens" Chinchilla recipe and opens weights. LLaMA 1 directly catalyzed open-source LLM explosion (Alpaca/Vicuna/Mistral/Qwen all benefited).

TLDR（中文）

Meta 把"小而精 + 大规模 token"的 Chinchilla 配方实操出来，并开放权重。LLaMA 1 直接催生了开源 LLM 大爆炸（Alpaca / Vicuna / Mistral / Qwen 全部受益）。

Related Papers

Other papers in the same domain