Jared Kaplan - Thoughts on Neural Scaling Laws

Abstract

I’ll discuss empirical work on neural scaling laws, emphasizing their apparent precision, universality, and ubiquity. Along the way I’ll talk about some lessons one might draw from them. If there’s time, I’ll discuss some theoretical ideas that might provide the beginnings of an explanation for scaling laws.

Date
Event