In this episode, we're diving into the fascinating world of at-home AI with a ready-to-deploy project harnessing Bumblebee and Fly GPUs, unraveling the tale of how an Xz backdoor catastrophe was narrowly sidestepped, and highlighting the power of customizing your Elixir IEx environment. We'll also touch upon the eager anticipation for ElixirConf EU, taking place in Lisbon, where innovations in vehicular tech meet Elixir, and the upcoming NervesConf US - a prime event for embedded systems enthusiasts. Tune in for these buzzworthy topics and more!
Show Notes online - http://podcast.thinkingelixir.com/197 (http://podcast.thinkingelixir.com/197)
Elixir Community News
- https://twitter.com/brainlid/status/1775148526621827548 (https://twitter.com/brainlid/status/1775148526621827548?utm_source=thinkingelixir&utm_medium=shownotes) – Tweet about an easy at-home AI project using Bumblebee and Fly GPUs.
- https://fly.io/phoenix-files/easy-at-home-ai-with-bumblebee-and-fly-gpus/ (https://fly.io/phoenix-files/easy-at-home-ai-with-bumblebee-and-fly-gpus/?utm_source=thinkingelixir&utm_medium=shownotes) – Blog post detailing the easy deployment of LLM models on Fly.io machines with GPUs.
- https://github.com/fly-apps/bumblebee-model-harness (https://github.com/fly-apps/bumblebee-model-harness?utm_source=thinkingelixir&utm_medium=shownotes) – GitHub repository for deploying Llama 2 7B, Mistral 7B, and Zephyr 7B LLMs with Bumblebee.
- https://twitter.com/fr0gger_/status/1774342248437813525 (https://twitter.com/fr0gger_/status/1774342248437813525?utm_source=thinkingelixir&utm_medium=shownotes) – Tweet about the mostly avoided disaster of the Xz backdoor.
- https://xkcd.com/2347/ (https://xkcd.com/2347/?utm_source=thinkingelixir&utm_medium=shownotes) – Related XKCD comic regarding the pressure on open-source developers.
- https://en.wikipedia.org/wiki/XZUtilsbackdoor (https://en.wikipedia.org/wiki/XZ_Utils_backdoor?utm_source=thinkingelixir&utm_medium=shownotes) – Wikipedia article on the XZ Utils backdoor incident.
- https://www.wired.com/story/xz-backdoor-everything-you-need-to-know/ (https://www.wired.com/story/xz-backdoor-everything-you-need-to-know/?utm_source=thinkingelixir&utm_medium=shownotes) – Wired article providing an overview of the Xz backdoor event.
- https://diff.hex.pm/ (https://diff.hex.pm/?utm_source=thinkingelixir&utm_medium=shownotes) – A resource for Elixir developers to inspect changes between published versions of Hex packages.
- https://gist.github.com/brainlid/5cc4944509de87289fb1a1680da22911 (https://gist.github.com/brainlid/5cc4944509de87289fb1a1680da22911?utm_source=thinkingelixir&utm_medium=shownotes) – Gist showing an example of an .iex.exs file for customizing IEx behavior.
- https://hexdocs.pm/iex/IEx.html#module-the-iex-exs-file (https://hexdocs.pm/iex/IEx.html#module-the-iex-exs-file?utm_source=thinkingelixir&utm_medium=shownotes) – HexDocs documentation on the .iex.exs file.
- https://www.elixirconf.eu/ (https://www.elixirconf.eu/?utm_source=thinkingelixir&utm_medium=shownotes) – Website for ElixirConf EU, Europe's largest Elixir Conference.
- https://twitter.com/mlainez/status/1773679346328195334 (https://twitter.com/mlainez/status/1773679346328195334?utm_source=thinkingelixir&utm_medium=shownotes) – Tweet teasing a talk about retrofitting a Nissan leaf engine into VWGroup body and using Elixir.
- https://twitter.com/NervesConfUS/status/1774473097426370744 (https://twitter.com/NervesConfUS/status/1774473097426370744?utm_source=thinkingelixir&utm_medium=shownotes) – Tweet announcing NervesConf US, a one-day single-track conference.
- https://nervesconf.us/ (https://nervesconf.us/?utm_source=thinkingelixir&utm_medium=shownotes) – The official site for NervesConf US with the date and venue information.
- https://www.gigcityelixir.com/ (https://www.gigcityelixir.com/?utm_source=thinkingelixir&utm_medium=shownotes) – The official site for GigCityElixir with dates and speaker announcements.
- https://2024.elixirconf