47 min listen
Cutting-Edge Gradient Descent Variants with Levente Szabados - 004
Cutting-Edge Gradient Descent Variants with Levente Szabados - 004
ratings:
Length:
37 minutes
Released:
Dec 19, 2019
Format:
Podcast episode
Description
In this episode, we are focusing on Deep Learning Optimizers, the different Gradient Descent Variants from vanilla GD to RAdam and Ranger. Levente tells us the story of GD from the simplest ones to the newest ones. This is part 1. Levente's Linkedin URL: https://www.linkedin.com/in/levente-szabados-76334728/ An overview of gradient descent optimization algorithms: https://arxiv.org/pdf/1609.04747.pdf Lookahead optimizer algorithm: https://arxiv.org/pdf/1907.08610.pdf Ranger optimizer by Less Wright: https://medium.com/@lessw/new-deep-learning-optimizer-ranger-synergistic-combination-of-radam-lookahead-for-the-best-of-2dc83f79a48d ---Copyright Info--- Music is from https://filmmusic.io, intro first part is by Miklos Toth and some free garage band loops. :) intro second part: "Aces High" by Kevin MacLeod, outro "Acid Trumpet" by Kevin MacLeod (https://incompetech.com), License: CC BY (http://creativecommons.org/licenses/by/4.0/)
Released:
Dec 19, 2019
Format:
Podcast episode
Titles in the series (16)
Progressively Growing GANs & Style GANs with Alexandr Honchar - 001: In this episode, we talked about the idea behind GANs in general and two special types of GANs: Progressively Growing GANs and Style GANs. LinkedIn URL of Alexandr Honchar: https://www.linkedin.com/in/alexandr-honchar-4423b962/ Companies where Alex... by Machine Learning Cafe