Bosgame M4 Neo: Running 35B Local LLMs on a $970 Mini PC
Why I bought a Mini PC - Bosgame M4 Neo (64GB RAM) - to run 35b-class local LLMs on Linux. Benchmarks, thermals, Vulkan vs ROCm, and power draw vs a discrete-GPU desktop.
Why I bought a Mini PC - Bosgame M4 Neo (64GB RAM) - to run 35b-class local LLMs on Linux. Benchmarks, thermals, Vulkan vs ROCm, and power draw vs a discrete-GPU desktop.