gotzmann / boosterLinks
Booster - open accelerator for LLM models. Better inference and debugging for AI hackers
☆160Updated last year
Alternatives and similar repositories for booster
Users that are interested in booster are comparing it to the libraries listed below
Sorting:
- Binding to transformers in ggml☆63Updated this week
- ☆16Updated last year
- Port of Facebook's LLaMA (Large Language Model Meta AI) in Golang with embedded C/C++☆168Updated 2 years ago
- A simple vector database: Text encoding, semantic search, document storage☆91Updated 2 years ago
- Inference Llama 2 in one file of pure go☆16Updated 2 years ago
- A go wrapper around the rwkv.cpp library☆20Updated last year
- DSPy Go implementation☆89Updated this week
- Llama 2 inference in one file of pure Go☆106Updated 2 years ago
- ZenModel is a framework for building LLM applications with agentic workflow☆71Updated 10 months ago
- Inference Llama 2 in Go☆39Updated 2 years ago
- RightHand - A GPT4 powered assistive tool.☆114Updated 7 months ago
- Go client for txtai☆78Updated this week
- pure go for stable-diffusion and support cross-platform.☆58Updated last year
- Local LLaMAs/Models in VSCode☆53Updated 2 years ago
- LLaMA Server combines the power of LLaMA C++ with the beauty of Chatbot UI.☆129Updated 2 years ago
- 🐦 A open blazing-fast simple model gateway for rapid development of production GenAI apps☆151Updated last year
- NLP transformers written in Go☆237Updated 2 years ago
- A Javascript library (with Typescript types) to parse metadata of GGML based GGUF files.☆50Updated last year
- Production grade LLM-ops in Golang☆56Updated 2 weeks ago
- ☆38Updated last year
- An OpenAI-like LLaMA inference API☆113Updated last year
- LLaMA-2 in native Go☆194Updated 9 months ago
- AutoGPT and other GPT and AI tools written in Golang☆73Updated last year
- Neural Language Model for Go☆61Updated 2 years ago
- Visual Studio Code extension for WizardCoder☆149Updated 2 years ago
- Go bindings for Tiktoken & HuggingFace Tokenizer☆163Updated last month
- Embeddings focused small version of Llama NLP model☆104Updated 2 years ago
- Golang web client for Ollama, fast and easy to use.☆29Updated last month
- Extracts structured data from unstructured input. Programming language agnostic. Uses llama.cpp☆45Updated last year
- Multi-Node LLM Processing Framework☆19Updated 10 months ago