K3Flight

K3Flight is a project that enables running Kimi K3 locally on CPU with approximately 55GB of runtime RAM. It is a single-file Linux inference server powered by cPilot Runtime. The project aims to provide a solution for running large models like Kimi K3, which has 2.8T parameters, on local machines without requiring massive amounts of memory. The model does not fit in memory, but it does not need to, as cPilot Runtime manages the weights and runtime state needed for the current execution path. The project provides a preliminary maintainer run with measurements of runtime memory, backend, and performance.