gotzmann / boosterLinks
Booster - open accelerator for LLM models. Better inference and debugging for AI hackers
☆157Updated 9 months ago
Alternatives and similar repositories for booster
Users that are interested in booster are comparing it to the libraries listed below
Sorting:
- Binding to transformers in ggml☆62Updated 3 weeks ago
- Llama 2 inference in one file of pure Go☆105Updated last year
- Port of Facebook's LLaMA (Large Language Model Meta AI) in Golang with embedded C/C++☆167Updated 2 years ago
- ☆16Updated last year
- ☆30Updated last year
- Conveniently download files, models, tokenizers from HuggingFace Hub☆25Updated last month
- Inference Llama 2 in Go☆39Updated last year
- Go bindings for HuggingFace Tokenizer☆140Updated 2 months ago
- Extend the original llama.cpp repo to support redpajama model.☆117Updated 9 months ago
- A go wrapper around the rwkv.cpp library☆19Updated last year
- A simple vector database: Text encoding, semantic search, document storage☆90Updated last year
- FastTensors - 100% Go framework for Neural Nets☆55Updated 8 months ago
- ZenModel is a framework for building LLM applications with agentic workflow☆68Updated 7 months ago
- A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.☆63Updated last year
- Inference Llama 2 in one file of pure go☆16Updated last year
- Falcon LLM ggml framework with CPU and GPU support☆245Updated last year
- Visual Studio Code extension for WizardCoder☆147Updated last year
- RightHand - A GPT4 powered assistive tool.☆110Updated 4 months ago
- NLP transformers written in Go☆232Updated 2 years ago
- Local LLaMAs/Models in VSCode☆53Updated last year
- Go client for txtai☆79Updated last month
- LLaMA Server combines the power of LLaMA C++ with the beauty of Chatbot UI.☆123Updated last year
- The one who calls upon functions - Function-Calling Language Model☆36Updated last year
- 4 bits quantization of SantaCoder using GPTQ☆50Updated last year
- Memory is a long term memory for your own llm model☆17Updated last year
- Embeddings focused small version of Llama NLP model☆104Updated 2 years ago
- LLaMA-2 in native Go☆194Updated 6 months ago
- GPT-2 small trained on phi-like data☆66Updated last year
- Download models from the Ollama library, without Ollama☆84Updated 6 months ago
- pure go for stable-diffusion and support cross-platform.☆57Updated last year