gotzmann / boosterLinks
Booster - open accelerator for LLM models. Better inference and debugging for AI hackers
☆160Updated 11 months ago
Alternatives and similar repositories for booster
Users that are interested in booster are comparing it to the libraries listed below
Sorting:
- Binding to transformers in ggml☆63Updated 2 weeks ago
- Port of Facebook's LLaMA (Large Language Model Meta AI) in Golang with embedded C/C++☆168Updated 2 years ago
- ☆16Updated last year
- A simple vector database: Text encoding, semantic search, document storage☆91Updated 2 years ago
- ZenModel is a framework for building LLM applications with agentic workflow☆72Updated 9 months ago
- Visual Studio Code extension for WizardCoder☆149Updated 2 years ago
- RightHand - A GPT4 powered assistive tool.☆114Updated 6 months ago
- Inference Llama 2 in one file of pure go☆16Updated 2 years ago
- Llama 2 inference in one file of pure Go☆105Updated 2 years ago
- Local LLaMAs/Models in VSCode☆53Updated 2 years ago
- A go wrapper around the rwkv.cpp library☆20Updated last year
- GPT-2 small trained on phi-like data☆67Updated last year
- LLaMA Server combines the power of LLaMA C++ with the beauty of Chatbot UI.☆128Updated 2 years ago
- Inference Llama 2 in Go☆39Updated 2 years ago
- 🐦 A open blazing-fast simple model gateway for rapid development of production GenAI apps☆151Updated 11 months ago
- Experimental adventure game with AI-generated content☆111Updated 3 months ago
- GGML implementation of BERT model with Python bindings and quantization.☆57Updated last year
- The one who calls upon functions - Function-Calling Language Model☆36Updated last year
- Falcon LLM ggml framework with CPU and GPU support☆246Updated last year
- Extend the original llama.cpp repo to support redpajama model.☆118Updated 11 months ago
- Extracts structured data from unstructured input. Programming language agnostic. Uses llama.cpp☆45Updated last year
- An OpenAI-like LLaMA inference API☆112Updated last year
- Something similar to Apple Intelligence?☆61Updated last year
- Embeddings focused small version of Llama NLP model☆103Updated 2 years ago
- A collection of prompts for Llama☆100Updated 2 years ago
- pure go for stable-diffusion and support cross-platform.☆58Updated last year
- Thin wrapper around OpenAI Whisper API with streaming support☆89Updated 6 months ago
- A simple GUI utility for gathering LIMA-like chat data.☆23Updated 5 months ago
- Turn natual language into commands. Your CLI tasks, now as easy as a conversation. Run it 100% offline, or use OpenAI's models.☆60Updated last year
- Convenient wrapper for fine-tuning and inference of Large Language Models (LLMs) with several quantization techniques (GTPQ, bitsandbytes…☆146Updated last year