Deliver LLMs of GGUF format via Dockerfile.
☆16Oct 24, 2024Updated last year
Alternatives and similar repositories for gguf-packer-go
Users that are interested in gguf-packer-go are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Provides a unified interface to detect GPU resources and manages GPU workloads.☆17Updated this week
- ☆95Updated this week
- Collection of Dockerfiles to build images for various inference services across different accelerated backends.☆16Updated this week
- A text-to-speech and speech-to-text server compatible with the OpenAI API, supporting Whisper, FunASR, Bark, and CosyVoice backends.☆217Jul 17, 2026Updated 2 months ago
- ☆22Sep 29, 2025Updated 11 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- LM inference server implementation based on *.cpp.