LLM inference in C/C++
Updated 2024-09-11 00:42:26 +02:00
A simple one-file way to run various GGML and GGUF models with a KoboldAI UI
Updated 2024-09-10 10:39:23 +02:00