:robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more. Features: Generate Text, MCP, Audio, Video, Images, Voice Cloning, Distributed, P2P and decentralized inference
COMMITS
/ docs/content/features/quantization.md March 25, 2026
R
fix(docs): Use notice instead of alert (#9134)
Richard Palethorpe committed
March 21, 2026
E
feat(quantization): add quantization backend (#9096)
Ettore Di Giacinto committed