RISING ↑ Local AI

Kimi K3 in C

A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM, portable C99 with no dependencies.

Why it matters now: Run a 2.78-trillion-parameter model on a single CPU with minimal memory requirements

Editor's take

Kimi K3 in C is a lightweight implementation of the Kimi K3 model, designed to run on a single CPU with minimal memory requirements. The project uses portable C99 and has no dependencies on external frameworks or libraries. The model can run in as little as 8.24 GB of RAM and produces byte-identical output at various budgets. The code is open-source and licensed under Apache-2.0.

Who is it for

  • Developers and researchers looking for a lightweight and portable implementation of the Kimi K3 model

Requirements

Runs on Linux x86-64 platform