The Scaling Laws of Artificial Intelligence: Why neural networks continue to grow?

One of the most reliable methods for improving model performance is to increase the model and dataset size. This talk will open with a deep dive into the scaling laws that govern the above relationship. Throughout the talk we will discuss the challenges related to the use of large models and costs associated with large datasets. We will conclude by discussing how those approaches have enabled some of the biggest breakthroughs in Natural Language Processing and Computer Vision.