

Unfortunately these chips had voltage issues on launch. Whenever I do a new build I manually tweak my CPU in the bios while also testing my configuration using stress / torture tests on prime95 (mprime). They have since released bios updates that address the voltage issue. My understanding is the chips do not “degrade” over time, but instead could experience “damage” when used on a unpatched bios. More so when using the advanced overclock settings.
that could be your problem and there’s nothing you can really do about it since the CPU itself is flawed.
I don’t think so. This is a Linux bug. This bug doesn’t exist when booting into Windows.
Install LocalAI and ensure it’s using acceleration. It’s one of the best solutions we have at the moment.
Are you sure you’re not running these small models off of CPU and no acceleration? Because I’m running these small models pretty quickly. Nearly instant responses using a NVIDIA titanXP from a gaming rig I built in 2017 ish.