Scaling laws
17 papers in this thread, across 8 domains.
Progress0 of 12
- 2026Train-to-Test (T2) Scaling Laws: Integrating Pretraining and Test-Time ComputeScaling Laws2604.01411University of Wisconsin-MadisonApr 1, 2026score 9~122 minScaling Laws
- 2026Principled Synthetic Data Enables the First Scaling Laws for LLMs in RecommendationLLM Systems2602.07298AI at MetaFeb 7, 2026score 4~120 minLLM Systems
- 2025Scaling Laws Meet Model Architecture: Toward Inference-Efficient LLMsScaling Laws2510.18245Oct 21, 2025~103 minScaling Laws
- 2025Parallel Scaling Law for Language ModelsScaling Laws2505.10475May 15, 2025~87 minScaling Laws
- 2025DataDecide: How to Predict Best Pretraining Data with Small ExperimentsData2504.11393Apr 15, 2025~133 minData
- 2025Can 1B LLM Surpass 405B LLM? Rethinking Compute-Optimal Test-Time ScalingInference Optimization2502.06703Feb 10, 2025score 9~110 minInference Optimization
- 2023Beyond Chinchilla-Optimal: Accounting for Inference in Language Model Scaling LawsScaling Laws2401.00448Dec 31, 2023score 9~99 minScaling Laws
- 2023Scaling Laws for Sparsely-Connected Foundation ModelsScaling Laws2309.08520Sep 15, 2023score 9~115 minScaling Laws
- 2023Universal Scaling Laws of Absorbing Phase Transitions in Artificial Deep Neural Networksno summary yetstat ml2307.02284Sony0 citesJul 5, 2023stat ml
- 2022Training Compute-Optimal Large Language ModelsScaling Laws2203.15556Mar 29, 2022~111 minScaling Laws
- 2021Scaling Law for Recommendation Models: Towards General-purpose User RepresentationsScaling Laws2111.11294Nov 15, 2021~105 minScaling Laws
- 2021Scaling Laws for Neural Machine Translationno summary yetcs lg2109.07740Google Research19 citesSep 16, 2021cs lg
- 2021Scaling Laws for Acoustic Modelsno summary yeteess as2106.09488Amazon1 citesJun 11, 2021eess as
- 2021Explaining Neural Scaling Lawsno summary yetcs lg2102.06701Google Research119 citesFeb 12, 2021cs lg
- 2020Scaling Laws for Autoregressive Generative ModelingScaling Laws2010.14701Oct 28, 2020~128 minScaling Laws
- 2020KAPLAN: A 3D Point Descriptor for Shape Completionno summary yetcs cv2008.00096Microsoft Research2 citesJul 31, 2020cs cv
- 20202028: Two scenarios for global AI leadershipScaling Laws2001.08361Anthropic1,503 citesJan 23, 2020~129 minScaling Laws