Convolutional Neural Networks for Sentence Classification

Authors: Yoon Kim (2014)

arXiv: 1408.5882

Domains

Architecture

TLDR (English)

Uses CNN with pre-trained word vectors for text classification, proving "pre-trained embedding + simple architecture" beats hand-crafted features. An early sign of pre-training paradigm entering NLP.

TLDR（中文）

用 CNN + 预训练词向量做文本分类，证明"预训练 embedding + 简单架构"能打过手工特征工程，是预训练范式渗入 NLP 的早期标志。

Appears in These Articles

• Embeddings：把离散符号放进连续空间
• Embeddings: Putting Discrete Symbols into Continuous Space

Co-cited Papers

These papers appear in the same articles as this one

• ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators Kevin Clark et al. (2020)
• Distributed Representations of Words and Phrases and their Compositionality Tomas Mikolov et al. (2013)
• Efficient Estimation of Word Representations in Vector Space Tomas Mikolov et al. (2013)
• GloVe: Global Vectors for Word Representation Jeffrey Pennington et al. (2014)

Related Papers

Other papers in the same domain

• DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model DeepSeek-AI (2024)
  ArchitectureInference
• DeepSeek-V3 Technical Report DeepSeek-AI (2024)
  ArchitectureMixture of Experts
• Mixtral of Experts Albert Q. Jiang et al. (2024)
  Mixture of ExpertsArchitecture
• GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints Joshua Ainslie et al. (2023)
  InferenceArchitecture
• GLM-130B: An Open Bilingual Pre-trained Model Aohan Zeng et al. (2022)
  Architecture
• Train Short, Test Long: Attention with Linear Biases Enables Input Length Extrapolation Ofir Press et al. (2021)
  ArchitectureLong Context