gotzmann / boosterLinks
Booster - open accelerator for LLM models. Better inference and debugging for AI hackers
☆158Updated 10 months ago
Alternatives and similar repositories for booster
Users that are interested in booster are comparing it to the libraries listed below
Sorting:
- Binding to transformers in ggml☆62Updated last month
- Port of Facebook's LLaMA (Large Language Model Meta AI) in Golang with embedded C/C++☆167Updated 2 years ago
- A simple vector database: Text encoding, semantic search, document storage☆90Updated last year
- RightHand - A GPT4 powered assistive tool.☆112Updated 5 months ago
- FastTensors - 100% Go framework for Neural Nets☆58Updated 9 months ago
- LLaMA Server combines the power of LLaMA C++ with the beauty of Chatbot UI.☆126Updated 2 years ago
- Llama 2 inference in one file of pure Go☆105Updated last year
- An OpenAI-like LLaMA inference API☆112Updated last year
- DSPy Go implementation☆42Updated this week
- A go wrapper around the rwkv.cpp library☆20Updated last year
- Deploy your GGML models to HuggingFace Spaces with Docker and gradio☆37Updated 2 years ago
- The one who calls upon functions - Function-Calling Language Model☆36Updated last year
- Unofficial python bindings for the rust llm library. 🐍❤️🦀☆75Updated last year
- Inference Llama 2 in Go☆39Updated last year
- GPT-2 small trained on phi-like data☆66Updated last year
- A simple GUI utility for gathering LIMA-like chat data.☆23Updated 3 months ago
- Inference Llama 2 in one file of pure go☆16Updated last year
- ☆16Updated last year
- NLP transformers written in Go☆233Updated 2 years ago
- Experimental adventure game with AI-generated content☆111Updated 2 months ago
- Neural Language Model for Go☆60Updated last year
- ☆55Updated 2 years ago
- Go bindings for HuggingFace Tokenizer☆149Updated 2 weeks ago
- A fast batching API to serve LLM models☆183Updated last year
- LLaVA server (llama.cpp).☆180Updated last year
- Merge Transformers language models by use of gradient parameters.☆206Updated 10 months ago
- ggml implementation of BERT Embedding☆25Updated last year
- ☆31Updated last year
- pure go for stable-diffusion and support cross-platform.☆57Updated last year
- Go client for txtai☆79Updated 2 weeks ago