TensorFold
LLM Inference Engine for Metal, CUDA and Vulkan.
REPOWATCH / EXPLORE
Search the full Trending archive by name, purpose, tag or language.
SEARCH RESULTS
LLM Inference Engine for Metal, CUDA and Vulkan.
LLM inference in C/C++
Use Claude Code, Codex, Antigravity, VSCode, Pi, and OpenCode (and 6 other harnesses) for free (1.3B+ free tokens) from your terminal, app, IDE, or phone, and now from the browser with native browser sessions (multi-harness + multi-model) like OpenClaw (voice supported + ToS friendly)
Ruby on Rails
A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.
A hierarchical inference engine for frontier MoE models: hot experts on the GPU (CUDA, Vulkan), warm ones in RAM, cold ones streamed from NVMe. Written in C, runs on the hardware you already own.
Training-free language model modification: Remove censorship, suppress slop, reduce sycophancy, and more
The best ChatGPT that $100 can buy.
FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.
The most powerful and modular diffusion model GUI, api and backend with a graph/nodes interface. The fastest local inference engine in the world.
A high-throughput and memory-efficient inference and serving engine for LLMs
TokenSpeed is a speed-of-light LLM inference engine.