PABannier / biogpt.cppLinks
Port of Microsoft's BioGPT in C/C++ using ggml
☆86Updated last year
Alternatives and similar repositories for biogpt.cpp
Users that are interested in biogpt.cpp are comparing it to the libraries listed below
Sorting:
- GGML implementation of BERT model with Python bindings and quantization.☆58Updated last year
- LLaVA server (llama.cpp).☆183Updated 2 years ago
- Python bindings for ggml☆147Updated last year
- Inference of Large Multimodal Models in C/C++. LLaVA and others☆48Updated 2 years ago
- Python bindings for llama.cpp☆198Updated 2 years ago
- Experiments with BitNet inference on CPU☆55Updated last year
- Demo python script app to interact with llama.cpp server using whisper API, microphone and webcam devices.☆46Updated 2 years ago
- Web browser version of StarCoder.cpp☆46Updated 2 years ago
- Inference of Mamba and Mamba2 models in pure C☆196Updated 3 weeks ago
- tinygrad port of the RWKV large language model.☆45Updated 11 months ago
- Embeddings focused small version of Llama NLP model☆107Updated 2 years ago
- Port of Meta's Encodec in C/C++☆227Updated last year
- LLM-based code completion engine☆190Updated last year
- Port of Suno AI's Bark in C/C++ for fast inference☆54Updated last year
- SoTA Transformers with C-backend for fast inference on your CPU.☆311Updated 2 years ago
- A ggml (C++) re-implementation of tortoise-tts☆193Updated last year
- Trying to deconstruct RWKV in understandable terms☆14Updated 2 years ago
- Command-line script for inferencing from models such as MPT-7B-Chat☆100Updated 2 years ago
- Fast inference of Instruct tuned LLaMa on your personal devices.☆23Updated 2 years ago
- ☆26Updated 2 years ago
- Unofficial python bindings for the rust llm library. 🐍❤️🦀☆76Updated 2 years ago
- Thin wrapper around GGML to make life easier☆42Updated 3 months ago
- Falcon LLM ggml framework with CPU and GPU support☆249Updated 2 years ago
- ☆40Updated 2 years ago
- ggml implementation of BERT☆498Updated last year
- iterate quickly with llama.cpp hot reloading. use the llama.cpp bindings with bun.sh☆50Updated 2 years ago
- ggml implementation of embedding models including SentenceTransformer and BGE☆63Updated 2 years ago
- GGUF implementation in C as a library and a tools CLI program☆303Updated 5 months ago
- General purpose GPU compute framework built on Vulkan to support 1000s of cross vendor graphics cards (AMD, Qualcomm, NVIDIA & friends). …☆51Updated 11 months ago
- Drop in replacement for OpenAI, but with Open models.☆156Updated 2 years ago