Discover this podcast and so much more

Podcasts are free to enjoy without a subscription. We also offer ebooks, audiobooks, and so much more for just $11.99/month.

? ThursdAI Nov 30 // ChatGPT 1 year celebration special episode // covering the past 1 year in LLM/OSS AI ?

? ThursdAI Nov 30 // ChatGPT 1 year celebration special episode // covering the past 1 year in LLM/OSS AI ?

FromThursdAI - The top AI news from the past week


? ThursdAI Nov 30 // ChatGPT 1 year celebration special episode // covering the past 1 year in LLM/OSS AI ?

FromThursdAI - The top AI news from the past week

ratings:
Length:
85 minutes
Released:
Nov 30, 2023
Format:
Podcast episode

Description

? Happy birthday to you, happy birthday to you, happy birthday chat GPT-eeeeeeee, happy birthday to you. Hey everyone, welcome to this special edition of ThursdAI where you're probably gonna have two emails and two podcast episodes today and you can choose which one you want to but we actually recorded both of them live it just they went a little long. ThursdAI - The only podcast that brings you yearly recaps since chatGPT was released (?) This one is the more celebratory one, today is one year from the release of chat GPT and we (and by we I mean I, Alex) decided to celebrate it by recapping not just the last week in AI but the last year (full timeline posted at the bottom of this newsletter)Going month by month with a swoosh sound in the editing and covering the most important thing that happened in LLM and open source LLMs since chatGPT was released and imagination unlocked the capability for everyone! We also covered Meta stepping in with Lama and then everything that happened since then in the multi modality and vector databases and agents and everything everything everything, it was a one hell of an hour and a half, we had almost 1K audience members! and so I recommend you listen to this one first and then the week updates later because there were some incredible releases this week as well! (as there are every week)I think it's important to do like a Spotify wrapped type thing for AI, for something like a one year for chat GPT and I think we'll be doing this every year so hopefully in the year we'll see you here on November 30th covering the next year in AI.And hopefully the next year in AI system will actually help me summarize all this because it's a lot of work but with that I will just leave you with the timeline and no notes and you should listen to everything because we talked about everything live! I hope you enjoy this special birthday celebration! (OpenAI sure did, check out this incredibly cute little celebration video they just posted) Here’s the full timeline with everything important that happened month by month that we’ve covered:* December 2022 - ChatGPT becomes the fastest growing product in history* GPT3.5 with 4K context window, instruction finetuning and conversational RLHF * January* Microsoft invests additional $10B into OpenAI (Jan 23, Blog)* February * LLaMa 1 - Biggest Open Source LLM (February 24 - Blog)* No commercial license* 30% MMLU* No instruction fine-tuninig (RL;HF)* ChatGPT unofficial APIs exist* March (the month of LLM superpowers)* ChatGPT API (March 1, announcement)* Developers can now build chatGPT powered apps* All clones so far were completion based and not conversation based* LLama.cpp from ggerganov + Quantization (March 10, Blog)* Stanford - Alpaca 7B - Finetune on self-instruct GPT3.5 dataset (March 13, Blog)* GPT4 release + chatGPT upgrade (March 14 - GPT-4 demo)* 67.0% HumanEval | 86.4% MMLU* 8K (and 32K) context windows* Anthropic announces Claude + Claude instant (March 14 - Blog)* 56.0% HumanEval * Folks previously form OAI leave to open Anthropic as research, then pivot from research into commercial* LMSYS Vicuna 13B - Finetuned based on shareg.pt exports (March 30, Blog)* April (Embedings & Agents)* AutoGPT becomes the fastest github starred project + writes it's own code (April 1, Blog)* Agents start to pop up like mushrooms after the rain* LLaVa - Multimodality open source begins (April 18, Blog)* CLIP + Vicuna smushed together to get LLMs eyes* Bard improvements * May (Context windows)* Mosaic MPT-7B with 64K context, 1T parameters, commercial license (May 5, Blog) * Anthropic updates Claude with 100K context window (May 11, Blog)* LLongBoi summer begins (Context windows are being stretched)* Nvidia shows Voyager agents that play Minecraft + Memory stored in Vector DB (May 27, Blog)* June* GPT-3.5-turbo + functions API (June 6, Blog)* GPT3.5 and 4 got a boost in capabilities and steer-ability * Price reduction on models + 75% reduction on ada embeddings model* LLaMa
Released:
Nov 30, 2023
Format:
Podcast episode

Titles in the series (50)

Every ThursdAI, Alex Volkov hosts a panel of experts, ai engineers, data scientists and prompt spellcasters on twitter spaces, as we discuss everything major and important that happened in the world of AI for the past week. Topics include LLMs, Open source, New capabilities, OpenAI, competitors in AI space, new LLM models, AI art and diffusion aspects and much more. sub.thursdai.news