Yi: Open Foundation Models by 01.AI

作者： 01. AI, :, Alex Young, Bei Chen, Chao Li, Chengen Huang, Ge Zhang, Guanwei Zhang, Guoyin Wang, Heng Li, Jiangcheng Zhu, Jianqun Chen, Jing Chang, Kaidong Yu, Peng Liu, Qiang Liu, Shawn Yue, Senbin Yang, Shiming Yang, Wen Xie, Wenhao Huang, Xiaohui Hu, Xiaoyi Ren, Xinyao Niu, Pengcheng Nie, Yanpeng Li, Yuchi Xu, Yudong Liu, Yue Wang, Yuxuan Cai, Zhenyu Gu, Zhiyuan Liu, Zonghong Dai (2024)

arXiv： 2403.04652

领域

预训练

TLDR（中文）

李开复 01.AI 的全栈技术报告，强调"小而强 + 数据质量"。Yi-34B 长期是开源中英 LLM 第一梯队，也是 200K 上下文开源模型早期代表。

TLDR (English)

Kai-Fu Lee's 01.AI full-stack technical report, emphasizing "small but strong + data quality". Yi-34B long-term first-tier open-source Chinese-English LLM, also early representative of 200K context open-source models.

相关论文

同一领域的其他论文

• Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone Microsoft (2024)
  预训练
• The Llama 3 Herd of Models Meta AI (2024)
  预训练
• Qwen2.5 Technical Report Qwen et al. (2024)
  预训练
• Qwen Technical Report Jinze Bai et al. (2023)
  预训练
• Gemini: A Family of Highly Capable Multimodal Models Gemini Team et al. (2023)
  预训练多模态
• Textbooks Are All You Need Suriya Gunasekar et al. (2023)
  预训练