Llama-modchip: 284B DeepSeek on 64GB RAM, no GPU

A GitHub project called llama-modchip enables running a 284B-parameter DeepSeek model on 64GB of RAM without a GPU. It appears to use a modified llama.cpp approach to make large-model inference feasible on CPU-only, memo

Read full story at hackernews →