Alternatives and similar repositories for booster:

Users that are interested in booster are comparing it to the libraries listed below

• go-skynet / go-ggml-transformers.cpp
  Binding to transformers in ggml
  ☆60Updated 3 weeks ago
• tmc / righthand
  RightHand - A GPT4 powered assistive tool.
  ☆108Updated last month
• mudler / go-stable-diffusion
  ☆15Updated 9 months ago
• IlyaGusev / saiga
  ☆39Updated last month
• nuance1979 / llama-server
  LLaMA Server combines the power of LLaMA C++ with the beauty of Chatbot UI.
  ☆117Updated last year
• Maximilian-Winter / llama_cpp_function_calling
  ☆31Updated last year
• mzbac / mlx-lora
  ☆38Updated 11 months ago
• tmc / go-llama2
  Llama 2 inference in one file of pure Go
  ☆103Updated last year
• jeffrey-fong / Invoker
  The one who calls upon functions - Function-Calling Language Model
  ☆36Updated last year
• LLukas22 / llm-rs-python
  Unofficial python bindings for the rust llm library. 🐍❤️🦀
  ☆74Updated last year
• mzbac / AutoGPTQ-API
  Host the GPTQ model using AutoGPTQ as an API that is compatible with text generation UI API.
  ☆91Updated last year
• ChuloAI / oasis
  Local LLaMAs/Models in VSCode
  ☆52Updated last year
• beratcmn / local-intelligence
  Something similar to Apple Intelligence?
  ☆59Updated 7 months ago
• zenmodel / zenmodel
  ZenModel is a framework for building LLM applications with agentic workflow
  ☆63Updated 3 months ago
• daulet / tokenizers
  Go bindings for HuggingFace Tokenizer
  ☆108Updated 3 months ago
• EinStack / glide
  🐦 A open blazing-fast simple model gateway for rapid development of production GenAI apps
  ☆141Updated 6 months ago
• mzbac / wizardCoder-vsc
  Visual Studio Code extension for WizardCoder
  ☆145Updated last year
• VatsaDev / NanoPhi-alpha
  GPT-2 small trained on phi-like data
  ☆65Updated 11 months ago
• ahoylabs / gguf.js
  A Javascript library (with Typescript types) to parse metadata of GGML based GGUF files.
  ☆46Updated 6 months ago
• gotzmann / fast
  FastTensors - 100% Go framework for Neural Nets
  ☆45Updated 4 months ago
• acheong08 / vectordb
  A simple vector database: Text encoding, semantic search, document storage
  ☆87Updated last year
• cmp-nct / ggllm.cpp
  Falcon LLM ggml framework with CPU and GPU support
  ☆246Updated last year
• cp3249 / splaa
  SPLAA is an AI assistant framework that utilizes voice recognition, text-to-speech, and tool-calling capabilities to provide a conversati…
  ☆23Updated last month
• taprosoft / llm_finetuning
  Convenient wrapper for fine-tuning and inference of Large Language Models (LLMs) with several quantization techniques (GTPQ, bitsandbytes…
  ☆147Updated last year
• nicholasyager / llama-cpp-guidance
  A guidance compatibility layer for llama-cpp-python
  ☆34Updated last year
• Urist-Mc-Urist / DoppeLLaMA
  Discord chatbot interface to train an LLM on user message history
  ☆27Updated last year
• iamlemec / bert.cpp
  GGML implementation of BERT model with Python bindings and quantization.
  ☆53Updated 11 months ago
• oKatanaaa / lima-gui
  A simple GUI utility for gathering LIMA-like chat data.
  ☆22Updated 3 months ago
• perk11 / large-model-proxy
  Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…
  ☆52Updated this week
• plaggy / fast-whisper-server
  ASR + diarization model server with speculative decoding
  ☆54Updated 8 months ago