:robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more. Features: Generate Text, MCP, Audio, Video, Images, Voice Cloning, Distributed, P2P and decentralized inference
COMMITS
/ backend/cpp/llama-cpp/grpc-server.cpp July 18, 2025
E
feat: do not bundle llama-cpp anymore (#5790)
Ettore Di Giacinto committed