gotzmann / boosterLinks
Booster - open accelerator for LLM models. Better inference and debugging for AI hackers
☆167Updated last year
Alternatives and similar repositories for booster
Users that are interested in booster are comparing it to the libraries listed below
Sorting:
- Binding to transformers in ggml☆64Updated last week
- Port of Facebook's LLaMA (Large Language Model Meta AI) in Golang with embedded C/C++☆169Updated 2 years ago
- A simple vector database: Text encoding, semantic search, document storage☆90Updated 2 years ago
- ☆17Updated last year
- Llama 2 inference in one file of pure Go☆110Updated 2 years ago
- Inference Llama 2 in one file of pure go☆16Updated 2 years ago
- 🐦 A open blazing-fast simple model gateway for rapid development of production GenAI apps☆153Updated last year
- ZenModel is a framework for building LLM applications with agentic workflow☆74Updated last year
- Production grade LLM-ops in Golang☆58Updated last week
- RightHand - A GPT4 powered assistive tool.☆113Updated last year
- Inference Llama 2 in Go☆39Updated 2 years ago
- A go wrapper around the rwkv.cpp library☆20Updated last year
- Extracts structured data from unstructured input. Programming language agnostic. Uses llama.cpp☆45Updated last year
- NLP transformers written in Go☆253Updated 2 years ago
- Go client for txtai☆80Updated 3 weeks ago
- Agency: Robust LLM Agent Management with Go☆69Updated last year
- ☆38Updated last year
- Turn natual language into commands. Your CLI tasks, now as easy as a conversation. Run it 100% offline, or use OpenAI's models.☆63Updated last year
- Falcon LLM ggml framework with CPU and GPU support☆249Updated last year
- pure go for stable-diffusion and support cross-platform.☆62Updated last year
- Neural Language Model for Go☆61Updated 2 years ago
- Web UI for working with large language models☆38Updated last year
- Inference Hub for AI at Scale☆68Updated this week
- Conveniently download files, models, tokenizers from HuggingFace Hub☆46Updated 2 months ago
- An OpenAI-like LLaMA inference API☆113Updated 2 years ago
- DSPy Go implementation☆144Updated last week
- Go bindings for Tiktoken & HuggingFace Tokenizer☆196Updated 2 months ago
- LLaMA Server combines the power of LLaMA C++ with the beauty of Chatbot UI.☆130Updated 2 years ago
- Convenient wrapper for fine-tuning and inference of Large Language Models (LLMs) with several quantization techniques (GTPQ, bitsandbytes…☆146Updated 2 years ago
- Local LLaMAs/Models in VSCode☆54Updated 2 years ago