47 min listen
A New Deep Learning Optimizer called Ranger with Less Wright - 005
A New Deep Learning Optimizer called Ranger with Less Wright - 005
ratings:
Length:
37 minutes
Released:
Jan 7, 2020
Format:
Podcast episode
Description
In this episode, we interview Less Wright, who has set 13 records on the fast.ai leaderboard, and we talk about one of his tricks is using cutting-edge optimizers, he also developed one, which is called Ranger. He talks also about different strategies of using Deep Learning optimizers, it is worth to take those into consideration. We also tested Ranger and in our case, it also outperformed Adam/RAdam variants. Co-host is Levente Szabados. Less' LinkedIn: https://www.linkedin.com/in/less-wright-22b59017/ Ranger's article: https://medium.com/@lessw/how-we-beat-the-fastai-leaderboard-score-by-19-77-a-cbb2338fab5c Less' medium articles: https://medium.com/@lessw His article about Mixnet he mentions: https://medium.com/@lessw/meet-mixnet-google-brains-new-state-of-the-art-mobile-ai-architecture-bd6c37abfa3a His Github: https://github.com/lessw2020 Co-Host: Levente Szabados https://www.linkedin.com/in/levente-szabados-76334728/ ---General Info--- Podcast's Website: http://machinelearningcafe.org/ Host's LinkedIn: https://www.linkedin.com/in/miklostoth/ Email of the host: miklos@machinelearningcafe.org ---Copyright Info--- Music is from https://filmmusic.io, intro first part is by Miklos Toth and some free garage band loops. :) intro second part: "Aces High" by Kevin MacLeod, outro "Acid Trumpet" by Kevin MacLeod (https://incompetech.com), License: CC BY (http://creativecommons.org/licenses/by/4.0/)
Released:
Jan 7, 2020
Format:
Podcast episode
Titles in the series (16)
Progressively Growing GANs & Style GANs with Alexandr Honchar - 001: In this episode, we talked about the idea behind GANs in general and two special types of GANs: Progressively Growing GANs and Style GANs. LinkedIn URL of Alexandr Honchar: https://www.linkedin.com/in/alexandr-honchar-4423b962/ Companies where Alex... by Machine Learning Cafe