Booster - open accelerator for LLM models. Better inference and debugging for AI hackers
☆169Aug 15, 2024Updated last year
Alternatives and similar repositories for booster
Users that are interested in booster are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- FastTensors - 100% Go framework for Neural Nets☆70Sep 20, 2024Updated last year
- llama.go is like llama.cpp in pure Golang!☆1,403Sep 20, 2024Updated last year
- Yet another frontend for LLM, written using .NET and WinUI 3☆11Sep 14, 2025Updated 8 months ago
- ☆14May 25, 2023Updated 3 years ago
- HJ212-protocol☆13Jun 29, 2020Updated 5 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- The one who calls upon functions - Function-Calling Language Model☆36Oct 2, 2023Updated 2 years ago
- The Elm Architecture in Go☆13Oct 17, 2016Updated 9 years ago
- Inference Llama 2 in Go☆38Jul 31, 2023Updated 2 years ago
- Interact privately with your documents using the power of GPT, 100% privately, no data leaks☆10May 22, 2023Updated 3 years ago
- Llama cute voice assistant☆28Sep 10, 2023Updated 2 years ago
- This is an LLM interface that you can use to analyze and get insight into diary entries or other documents completely offline.☆16Dec 31, 2023Updated 2 years ago
- Unified Go interface for Language Model (LLM) providers. Simplifies LLM integration with flexible prompt management and common task funct…☆659Mar 21, 2026Updated 2 months ago
- PipeInfer: Accelerating LLM Inference using Asynchronous Pipelined Speculation☆32Nov 16, 2024Updated last year
- LLama.cpp golang bindings☆897May 18, 2026Updated last week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Go bindings for LLama.cpp☆14Apr 11, 2023Updated 3 years ago
- LLaMA-2 in native Go☆193Nov 30, 2024Updated last year
- float16 provides IEEE 754 half-precision format (binary16) with correct conversions to/from float32☆92May 18, 2026Updated last week
- ☆49May 27, 2024Updated 2 years ago
- Tutorial on building a YouTube summarization app with Gemini and deploying it with Google Cloud Run☆15May 19, 2025Updated last year
- GPT-2 small trained on phi-like data☆68Feb 18, 2024Updated 2 years ago
- Modified Beam Search with periodical restart☆12Sep 12, 2024Updated last year
- Easily create LLM automation/agent workflows☆60Feb 13, 2024Updated 2 years ago
- ☆24Jan 22, 2025Updated last year
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- JacQues is a Dash-based interactive web application that facilitates real-time chat and document management.☆23Jan 5, 2026Updated 4 months ago
- Running Microsoft's BitNet via Electron, React & Astro☆63Sep 26, 2025Updated 8 months ago
- Desktop application for instant AI-powered text transformation. Translate, correct, summarize, and change the tone of any text, anywhere,…☆33Dec 29, 2025Updated 5 months ago
- ☆30Dec 12, 2025Updated 5 months ago
- Loader extension for tabbyAPI in SillyTavern☆26Jun 30, 2025Updated 10 months ago
- FMS Model Optimizer is a framework for developing reduced precision neural network models.☆21May 18, 2026Updated last week
- Your universal AI text processor, powered by local and cloud LLMs. Edit, refactor, and transform text in any application on Windows, macO…☆72Nov 9, 2025Updated 6 months ago
- Top-k Approximate String Matching.☆68Dec 16, 2021Updated 4 years ago
- A new second practical assignment for Huawei's NLP course☆20Mar 20, 2024Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- a port of smolagents library in Go☆26Mar 13, 2025Updated last year
- Attend - to what matters.☆17Feb 22, 2025Updated last year
- ☆60Dec 17, 2025Updated 5 months ago
- 🪿 LinGoose is a Go framework for building awesome AI/LLM applications.☆832Mar 15, 2026Updated 2 months ago
- 国家统计局中国省市县乡村5级地址抓取，http://www.stats.gov.cn/tjsj/tjbz/tjyqhdmhcxhfdm/2018/index.html☆12Jan 8, 2020Updated 6 years ago
- Language modeling and instruction tuning for Russian☆462Aug 20, 2024Updated last year
- run ollama & gguf easily with a single command☆52May 15, 2024Updated 2 years ago