AI Platforms / KoboldCpp

Local AI / Self-Hosted

KoboldCpp

Lightweight standalone app for running GGUF models locally, especially popular for roleplay/fiction

Visit KoboldCpp → GitHub

Pricing: Free & Open Source

Why KoboldCpp?

→ Best for creative/roleplay AI

→ runs on CPU with limited VRAM

→ built-in web UI

→ zero install

llm local-ai roleplay creative cpu

What is KoboldCpp?

Lightweight standalone app for running GGUF models locally, especially popular for roleplay/fiction with 9,700 GitHub stars.

Why KoboldCpp?

Best for creative/roleplay AI
runs on CPU with limited VRAM
built-in web UI
zero install

Pricing

Free & Open Source — run on your own hardware with zero API costs.

Category

Local AI / Self-Hosted — install and run AI models on your own server or workstation. Full data privacy, no internet required.

Self-Hosted AI Tools That Work With KoboldCpp

These open-source tools can connect to KoboldCpp or serve similar use cases:

20 Self-Hosted AI Tools

Browser Use

Make websites accessible for AI agents — automate browsing, extraction, testing, and monitoring in natural language with Playwright and LLMs.

AnythingLLM

Private, all-in-one AI assistant that lets you chat with your documents using any LLM. Self-hosted ChatGPT with RAG, multi-user workspaces, and zero data leakage.

ai assistants MIT Medium difficulty

Aider

Aider is a terminal-based AI pair programming tool that edits code in your local Git repository using LLMs, with automatic commits and multi-file refactoring.

ai ml Apache-2.0

Agno

Build, run, and manage secure multi-agent systems inside your cloud. The all-in-one agent platform that runs in your cloud.

monitoring Apache-2.0

Activepieces

MIT-licensed, self-hostable Zapier replacement with unlimited runs and a clean UI non-technical teams actually use.

automation MIT Medium difficulty

Bolt.new

Build and scale high-performing websites & apps using your words. Join millions and start building today

Botpress

Build powerful AI agents with Botpress. An intuitive building experience powered by the latest LLMs. Get started for free

Activeloop

Activeloop is a self-hosted databases & data tools tool with support for AI, LLM, vector database.

databases Apache-2.0

5ire

5ire is a TypeScript-based application that provides cross-platform desktop AI assistant supporting multiple providers.

ACI.dev

ACI.dev handles platform for connecting AI agents to 500+ tools as a self-hosted solution.

developer tools Apache-2.0

Agenta

Agenta handles lLMOps platform for prompt management as a self-hosted solution.

Basic Memory

Basic Memory is a self-hosted AI assistants & chatbots tool that provides persistent knowledge store for LLMs.

Beam

Beam is a self-hosted AI & machine learning replacement for Blaxel, Modal, and more.

Apache Cloudberry

Self-hosted database management tool that provides leverage advanced analytics with a modern PostgreSQL kernel. 100% for robust data solutions.

databases Apache-2.0

Amical

Amical handles AI dictation app as a self-hosted solution.

Bacalhau

Bacalhau lets you run platform for fast entirely on your own server.

automation Apache-2.0

Browser Operator

Browser Operator is a self-hosted AI & machine learning replacement for Atlas Browser, Browserbase, and more.

ai ml BSD-3-Clause

Actual AI

Actual AI is a TypeScript-based application that provides categorize transactions in Actual Budget using AI.

0 Finance

0 Finance is a self-hosted finance & budgeting replacement for Bitly, Buffer, and more.

Amurex

Amurex is a Python-based application that provides simple yet powerful AI meeting assistant.

Compare with other local AI platforms

Explore all self-hosted AI inference options to find the best fit for your hardware and use case.

View all AI platforms →