gotzmann / boosterLinks
Booster - open accelerator for LLM models. Better inference and debugging for AI hackers
☆162Updated last year
Alternatives and similar repositories for booster
Users that are interested in booster are comparing it to the libraries listed below
Sorting:
- Binding to transformers in ggml☆63Updated last week
- Port of Facebook's LLaMA (Large Language Model Meta AI) in Golang with embedded C/C++☆168Updated 2 years ago
- A simple vector database: Text encoding, semantic search, document storage☆90Updated 2 years ago
- Llama 2 inference in one file of pure Go☆107Updated 2 years ago
- ☆17Updated last year
- Inference Llama 2 in one file of pure go☆16Updated 2 years ago
- A go wrapper around the rwkv.cpp library☆19Updated last year
- RightHand - A GPT4 powered assistive tool.☆112Updated 8 months ago
- 🐦 A open blazing-fast simple model gateway for rapid development of production GenAI apps☆151Updated last year
- Go client for txtai☆79Updated last month
- Inference Llama 2 in Go☆39Updated 2 years ago
- pure go for stable-diffusion and support cross-platform.☆57Updated last year
- ZenModel is a framework for building LLM applications with agentic workflow☆74Updated 11 months ago
- Neural Language Model for Go☆61Updated 2 years ago
- AutoGPT and other GPT and AI tools written in Golang☆73Updated last year
- DSPy Go implementation☆110Updated this week
- Production grade LLM-ops in Golang☆57Updated this week
- An OpenAI-like LLaMA inference API☆113Updated 2 years ago
- Manage and use multiple Ollama instances with automatic offline detection/failover and model availability tracking☆89Updated 8 months ago
- LLaMA-2 in native Go☆194Updated 10 months ago
- Conveniently download files, models, tokenizers from HuggingFace Hub☆35Updated 3 months ago
- ☆38Updated last year
- Go bindings for Tiktoken & HuggingFace Tokenizer☆175Updated 3 weeks ago
- GGML implementation of BERT model with Python bindings and quantization.☆55Updated last year
- NLP transformers written in Go☆242Updated 2 years ago
- Agency: Robust LLM Agent Management with Go☆67Updated last year
- Extracts structured data from unstructured input. Programming language agnostic. Uses llama.cpp☆44Updated last year
- A simple GUI utility for gathering LIMA-like chat data.☆22Updated this week
- Visual Studio Code extension for WizardCoder☆148Updated 2 years ago
- The one who calls upon functions - Function-Calling Language Model☆36Updated 2 years ago