Timeline

Every summarized paper grouped by publication year. Tap a row to open the summary; the bullet dot lights up once you mark it read.

2026

436 papers

2025

613 papers

2024

375 papers

2023

248 papers

2022

65 papers

2021

64 papers

2020

54 papers

2019

44 papers

DecDeep Double Descent: Where Bigger Models and More Data HurtScaling Laws1912.02292149 citesDec 4, 2019~131 min
DecPEGASUS: Pre-training with Extracted Gap-sentences for Abstractive SummarizationPretraining1912.08777Google ResearchDec 18, 2019~84 min
DecPyTorch: An Imperative Style, High-Performance Deep Learning LibraryArchitecture1912.01703Dec 3, 2019~105 min
NovCompressive TransformerArchitecture1911.05507Nov 13, 2019~112 min
NovGeneralization through Memorization: Nearest Neighbor Language ModelsRetrieval1911.00172Nov 1, 2019~114 min
NovMomentum Contrast for Unsupervised Visual Representation LearningVision1911.05722Nov 13, 2019~111 min
NovMuZero (Mastering Atari, Go, Chess and Shogi by Planning with a Learned Model)RL Training1911.082651,088 citesNov 19, 2019~123 min
NovUnsupervised Cross-lingual Representation Learning at ScalePretraining1911.02116Microsoft Research539 citesNov 5, 2019~92 min
OctBART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and ComprehensionTraining Methods1910.13461Meta AI / FAIROct 29, 2019~102 min
OctExploring the Limits of Transfer Learning with a Unified Text-to-Text TransformerTraining Methods1910.10683Allen Institute for AIOct 23, 2019~132 min
OctLearning Classifiers on Positive and Unlabeled Data with Policy GradientTraining Methods1910.06535Oct 15, 2019~118 min
OctLudwig v0.3 Introduces Hyperparameter Optimization, Transformers and TensorFlow 2 supportPretraining1910.01108UberOct 2, 2019~108 min
OctMLQA: Evaluating Cross-lingual Extractive Question AnsweringEvaluation1910.07475Microsoft ResearchOct 16, 2019~121 min
OctQ8BERT: Quantized 8Bit BERTInference Optimization1910.06188Oct 14, 2019~91 min
OctQuantifying the Carbon Emissions of Machine LearningTraining Methods1910.09700Meta AI / FAIROct 21, 2019~87 min
OctZeRO: Memory Optimizations Toward Training Trillion Parameter ModelsDistributed Training1910.02054Stability AIOct 4, 2019~105 min
SepALBERT: A Lite BERT for Self-supervised Learning of Language RepresentationsArchitecture1909.11942984 citesSep 26, 2019~104 min
SepControlling Text Generation with Plug and Play Language ModelsRL Training1909.08593UberSep 18, 2019~120 min
SepLanguage Models as Knowledge Bases?Evaluation1909.01066Sep 3, 2019~114 min
SepMegatron-LM: Training Multi-Billion Parameter Language Models Using Model ParallelismDistributed Training1909.08053Sep 17, 2019~105 min
SepQ-BERT: Hessian Based Ultra Low Precision Quantization of BERTInference Optimization1909.05840Sep 12, 2019~112 min
SepTinyBERT: Distilling BERT for Natural Language UnderstandingTraining Methods1909.10351Sep 23, 2019~106 min
SepUNITER: Learning Universal Image-Text RepresentationsMultimodal1909.11740184 citesSep 25, 2019~113 min
AugLXMERT: Learning Cross-Modality Encoder Representations from TransformersMultimodal1908.07490Aug 20, 2019~111 min
AugSentence-BERT: Sentence Embeddings using Siamese BERT-NetworksArchitecture1908.10084MozillaAug 27, 2019~110 min
AugViLBERT: Pretraining Task-Agnostic Visiolinguistic RepresentationsMultimodal1908.02265Aug 6, 2019~109 min
AugVisualBERT: A Simple and Performant Baseline for Vision and LanguageMultimodal1908.03557Aug 9, 2019~119 min
JulRoBERTa: A Robustly Optimized BERT Pretraining ApproachPretraining1907.11692Meta AI / FAIRJul 26, 2019~113 min
JulSpanBERT: Improving Pre-training by Representing and Predicting SpansPretraining1907.10529179 citesJul 24, 2019~119 min
JunLatent Retrieval for Weakly Supervised Open Domain Question AnsweringRetrieval1906.0030067 citesJun 1, 2019~102 min
JunXLNet: Generalized Autoregressive Pretraining for Language UnderstandingPretraining1906.08237Stitch FixJun 19, 2019~118 min
MayAdaptive Attention Span in TransformersTraining Methods1905.07799May 19, 2019~109 min
MayEfficientNet: Rethinking Model Scaling for Convolutional Neural NetworksArchitecture1905.11946Google Research5,013 citesMay 28, 2019~109 min
MayHellaSwag: Can a Machine Really Finish Your Sentence?Evaluation1905.07830MistralMay 19, 2019~119 min
MayInterpreting and improving natural-language processing (in machines) with natural language-processing (in the brain)Uncategorized1905.11833May 28, 2019~126 min
MaySuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding SystemsEvaluation1905.00537991 citesMay 2, 2019~114 min
AprERNIE: Enhanced Representation through Knowledge IntegrationPretraining1904.09223770 citesApr 19, 2019~100 min
AprGenerating Long Sequences with Sparse TransformersArchitecture1904.10509Apr 23, 2019~125 min
AprHAWQ: Hessian Aware Quantization of Neural NetworksLow Precision1905.03696Apr 29, 2019~102 min
AprHOList: An Environment for Machine Learning of Higher-Order Theorem ProvingAgents1904.0324120 citesApr 5, 2019~116 min
FebLanguage Models are Unsupervised Multitask LearnersTraining Methods1902.01313Feb 4, 2019~107 min
FebParameter-Efficient Transfer Learning for NLPTraining Methods1902.00751144 citesFeb 2, 2019~115 min
JanNatural Questions: A Benchmark for Question Answering ResearchRL Training1901.04473Jan 12, 2019~127 min
JanTransformer-XL: Attentive Language Models Beyond a Fixed-Length ContextArchitecture1901.02860Jan 9, 2019~110 min

2018

35 papers

2017

28 papers

2016

32 papers

2015

36 papers

2014

29 papers

2013

12 papers

2012

6 papers

2000

77 papers