:robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more. Features: Generate Text, MCP, Audio, Video, Images, Voice Cloning, Distributed, P2P and decentralized inference
COMMITS
/ backend/python/mlx/backend.py March 29, 2026
E
feat: add distributed mode (#9124)
Ettore Di Giacinto committed
December 16, 2025
B
feat(mlx): add thread-safe LRU prompt cache and min_p/top_k sampling (#7556)
blightbow committed
September 19, 2025
E
fix(python): make option check uniform across backends (#6314)
Ettore Di Giacinto committed
August 28, 2025
E
feat(diffusers): add support for wan2.2 (#6153)
Ettore Di Giacinto committed
August 22, 2025
E
feat(mlx): add mlx backend (#6049)
Ettore Di Giacinto committed