Maximum PC

Running a “ChatGPT-lite” on your own PC

Much like Stable Diffusion last year, research in large language models (LLMs) means that you can now run your very own chatbot on your local PC. (https://tinyurl.com/local-chatbot) Caveats apply.

This isn’t ChatGPT. You’ll also want a GPU with as much VRAM as possible, and plenty of system memory—32GB is a realistic minimum. Nvidia GPUs are vastly preferable as well,

You’re reading a preview, subscribe to read more.

More from Maximum PC

Maximum PC3 min read
Iiyama GCB3480WQSU-B1 Red Eagle
WE’VE SEEN ultrawide monitors before, but they never fail to impress. This model from Iiyama offers a good-sized 34-inch IPS screen that’s about as big as one and a half 28-inch widescreen displays, boasts nearly 5 million pixels, and brings with it
Maximum PC1 min read
Retroarch Teardown
RetroArch serves as a frontend to multiple emulators. While running, you can download multiple ‘cores’ to run titles from various systems. These will then be accessible via the main menu. When ‘content’, i.e. a game, is loaded, it will play automatic
Maximum PC1 min read
Manage Vitals Using Xbox Game Bar
This element determines the CPU usage of the game in question. By default, the Xbox Game Bar also displays this in a line graph to the right. The GPU metric naturally measures how much video processing power it is using (if any). VRAM simply represen

Related