monatis / lmm.cppLinks
Inference of Large Multimodal Models in C/C++. LLaVA and others
☆48Updated 2 years ago
Alternatives and similar repositories for lmm.cpp
Users that are interested in lmm.cpp are comparing it to the libraries listed below
Sorting:
- LLaVA server (llama.cpp).☆183Updated 2 years ago
- Scripts to create your own moe models using mlx☆90Updated last year
- Local ML voice chat using high-end models.☆182Updated last month
- Port of Suno AI's Bark in C/C++ for fast inference☆54Updated last year
- Port of Microsoft's BioGPT in C/C++ using ggml☆85Updated last year
- Embeddings focused small version of Llama NLP model☆107Updated 2 years ago
- Demo python script app to interact with llama.cpp server using whisper API, microphone and webcam devices.☆46Updated 2 years ago
- Video+code lecture on building nanoGPT from scratch☆68Updated last year
- GGML implementation of BERT model with Python bindings and quantization.☆58Updated last year
- A pipeline parallel training script for LLMs.☆166Updated 9 months ago
- Something similar to Apple Intelligence?☆60Updated last year
- Experiments with BitNet inference on CPU☆55Updated last year
- Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA☆124Updated 2 years ago
- Gradio based tool to run opensource LLM models directly from Huggingface☆96Updated last year
- Embed arbitrary modalities (images, audio, documents, etc) into large language models.☆189Updated last year
- Python bindings for ggml☆147Updated last year
- An OpenAI API compatible LLM inference server based on ExLlamaV2.☆25Updated last year
- A ggml (C++) re-implementation of tortoise-tts☆193Updated last year
- Falcon LLM ggml framework with CPU and GPU support☆249Updated 2 years ago
- Gradio UI for a Cog API☆70Updated last year
- WebGPU LLM inference tuned by hand☆151Updated 2 years ago
- Minimal, clean code implementation of RAG with mlx using gguf model weights☆53Updated last year
- GPT-2 small trained on phi-like data☆68Updated last year
- An OpenAI-like LLaMA inference API☆113Updated 2 years ago
- GRDN.AI app for garden optimization☆69Updated 2 months ago
- Tune MPTs☆84Updated 2 years ago
- automatically quant GGUF models☆219Updated last month
- Phi-3.5 for Mac: Locally-run Vision and Language Models for Apple Silicon☆273Updated 2 months ago
- Semantic Search demo featuring UForm, USearch, UCall, and StreamLit, to visual and retrieve from image datasets, similar to "CLIP Retriev…☆53Updated 2 years ago
- Cog wrapper for collabora/WhisperSpeech☆25Updated last year