EXPERIMENTAL Local AI

Deltafin

Run full Kimi K3 on a single device with an OpenAI-compatible API server for local chat and coding agents.

Why it matters now: Run full Kimi K3 on a single device

Editor's take

Deltafin is a single native binary that runs full Kimi K3, a 2.8-trillion-parameter model, on consumer hardware as fast as possible. It keeps all 16 experts and the full K3 target as the sole authority for every single token. The goal is to squeeze out every last drop of efficiency possible without reducing model quality. Deltafin is an experiment in pushing consumer hardware to its limits and learning from the experience. It aims to make frontier models usable on a home setup, rather than requiring large-scale infrastructure.

Who is it for

  • Those who want to run full Kimi K3 on a single device

Requirements

Consumer hardware, such as an M1 Max laptop