trzy / llava-cpp-server
LLaVA server (llama.cpp).
☆178Updated last year
Alternatives and similar repositories for llava-cpp-server:
Users that are interested in llava-cpp-server are comparing it to the libraries listed below
- Inference of Large Multimodal Models in C/C++. LLaVA and others☆46Updated last year
- Demo python script app to interact with llama.cpp server using whisper API, microphone and webcam devices.☆46Updated last year
- Port of Microsoft's BioGPT in C/C++ using ggml☆87Updated last year
- Extend the original llama.cpp repo to support redpajama model.☆117Updated 6 months ago
- Port of Suno AI's Bark in C/C++ for fast inference☆53Updated 10 months ago
- run paligemma in real time☆131Updated 9 months ago
- Scripts to create your own moe models using mlx☆89Updated last year
- Full finetuning of large language models without large memory requirements☆93Updated last year
- Command-line script for inferencing from models such as MPT-7B-Chat☆101Updated last year
- WebGPU LLM inference tuned by hand☆149Updated last year
- Local ML voice chat using high-end models.☆161Updated this week
- Video+code lecture on building nanoGPT from scratch☆65Updated 8 months ago
- Maybe the new state of the art vision model? we'll see 🤷♂️☆161Updated last year
- Run GGML models with Kubernetes.☆174Updated last year
- Port of Suno's Bark TTS transformer in Apple's MLX Framework☆75Updated last year
- CLIP inference in plain C/C++ with no extra dependencies☆485Updated 6 months ago
- ☆38Updated last year
- Mistral7B playing DOOM☆130Updated 7 months ago
- an implementation of Self-Extend, to expand the context window via grouped attention☆118Updated last year
- run embeddings in MLX☆82Updated 5 months ago
- ☆39Updated last year
- Inference Vision Transformer (ViT) in plain C/C++ with ggml☆30Updated last year
- Cerule - A Tiny Mighty Vision Model☆67Updated 6 months ago
- Python bindings for ggml☆140Updated 6 months ago
- Command-line script for inferencing from models such as falcon-7b-instruct☆76Updated last year
- inference code for mixtral-8x7b-32kseqlen☆99Updated last year
- GRDN.AI app for garden optimization☆70Updated last year
- ☆112Updated last year
- Automated prompting and scoring framework to evaluate LLMs using updated human knowledge prompts☆111Updated last year
- Tune MPTs☆84Updated last year