AIUpdated 2h ago

A homelabber runs Kimi K3 on CPU and Optane.

Reddit user IndividualSurvival shared the experiment; the reported setup pairs Moonshot AI’s Kimi K3 with a 40-core, third-generation Intel Xeon Scalable processor and no GPU acceleration. The capacity comes from discontinued, second-generation Optane persistent memory, giving a CPU-only server room for a model this large. Kimi K3 has 2.8 trillion parameters overall, but activates about 104 billion per token. That distinction matters: the system isn’t activating every parameter for every token. The interesting turn is that memory capacity, rather than GPU acceleration, made this reported run possible.

2 publishers2 reports

Coverage started November 8