:robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more. Features: Generate Text, MCP, Audio, Video, Images, Voice Cloning, Distributed, P2P and decentralized inference
COMMITS
/ Makefile May 13, 2025
L
L
May 12, 2025
L
L
May 11, 2025
L
May 10, 2025
E
feat(whisper.cpp): gpu support (#5344)
Ettore Di Giacinto committed
L
E
fix(whisper): add vulkan flag
Ettore Di Giacinto committed
May 9, 2025
E
Update Makefile
Ettore Di Giacinto committed
E
chore(Makefile): small cleanups, disable openmp on whisper
Ettore Di Giacinto committed
E
fix(whisper/sycl): disable
Ettore Di Giacinto committed
E
fix(whisper/sycl): use icx when running go build
Ettore Di Giacinto committed
E
feat(whisper): link vulkan, hipblas and sycl
Ettore Di Giacinto committed
E
fix: specify icx and icpx only on whisper.cpp
Ettore Di Giacinto committed
E
fix: this is not needed
Ettore Di Giacinto committed
E
feat: Add sycl support for whisper.cpp (#5341)
Ettore Di Giacinto committed
E
chore(deps): bump whisper.cpp (#5338)
Ettore Di Giacinto committed
May 8, 2025
L
L
May 6, 2025
L
E
chore(deps): bump llama.cpp to `b34c859146630dff136943abc9852ca173a7c9d6` (#5323)
Ettore Di Giacinto committed
May 4, 2025
May 3, 2025
E
chore(deps): bump llama.cpp to '1d36b3670b285e69e58b9d687c770a2a0a192194 (#5307)
Ettore Di Giacinto committed
May 2, 2025
L
May 1, 2025
L
April 30, 2025
W
fix: vllm missing logprobs (#5279)
Wyatt Neal committed
April 29, 2025
L
L
April 27, 2025
L
L
April 25, 2025
L
L
April 24, 2025
R
fix(stablediffusion-ggml): Build with DSD CUDA, HIP and Metal flags (#5236)
Richard Palethorpe committed
L
April 23, 2025
L
April 22, 2025
L
April 20, 2025
L
April 19, 2025
L
E
chore(autogptq): drop archived backend (#5214)
Ettore Di Giacinto committed
April 18, 2025
L
April 17, 2025
L
L
April 15, 2025
L
R
fix(stablediffusion): Pass ROCM LD CGO flags through to recursive make (#5179)
Richard Palethorpe committed
April 14, 2025
L
R
fix(stablediffusion): Avoid GGML commit which causes CUDA compile error (#5170)
Richard Palethorpe committed
April 13, 2025
L