Alternatives and similar repositories for booster:

Users that are interested in booster are comparing it to the libraries listed below

• go-skynet / go-ggml-transformers.cpp
  Binding to transformers in ggml
  ☆60Updated this week
• cornelk / llama-go
  Port of Facebook's LLaMA (Large Language Model Meta AI) in Golang with embedded C/C++
  ☆167Updated last year
• tmc / go-llama2
  Llama 2 inference in one file of pure Go
  ☆104Updated last year
• gotzmann / fast
  FastTensors - 100% Go framework for Neural Nets
  ☆49Updated 6 months ago
• sugarme / transformer
  NLP transformers written in Go
  ☆227Updated 2 years ago
• tmc / righthand
  RightHand - A GPT4 powered assistive tool.
  ☆109Updated 2 months ago
• mudler / go-stable-diffusion
  ☆16Updated 10 months ago
• zenmodel / zenmodel
  ZenModel is a framework for building LLM applications with agentic workflow
  ☆65Updated 5 months ago
• daulet / tokenizers
  Go bindings for HuggingFace Tokenizer
  ☆126Updated this week
• togethercomputer / redpajama.cpp
  Extend the original llama.cpp repo to support redpajama model.
  ☆117Updated 6 months ago
• saracen / llama2.go
  Inference Llama 2 in Go
  ☆39Updated last year
• neuml / txtai.go
  Go client for txtai
  ☆76Updated 2 weeks ago
• nlpodyssey / verbaflow
  Neural Language Model for Go
  ☆59Updated last year
• oKatanaaa / lima-gui
  A simple GUI utility for gathering LIMA-like chat data.
  ☆23Updated 3 weeks ago
• mzbac / wizardCoder-vsc
  Visual Studio Code extension for WizardCoder
  ☆147Updated last year
• acheong08 / vectordb
  A simple vector database: Text encoding, semantic search, document storage
  ☆88Updated last year
• mayank31398 / GPTQ-for-SantaCoder
  4 bits quantization of SantaCoder using GPTQ
  ☆51Updated last year
• mzbac / mlx-lora
  ☆38Updated last year
• nuance1979 / llama-server
  LLaMA Server combines the power of LLaMA C++ with the beauty of Chatbot UI.
  ☆122Updated last year
• pluja / maestro
  Turn natual language into commands. Your CLI tasks, now as easy as a conversation. Run it 100% offline, or use OpenAI's models.
  ☆56Updated 9 months ago
• cmp-nct / ggllm.cpp
  Falcon LLM ggml framework with CPU and GPU support
  ☆246Updated last year
• stillmatic / gollum
  Production grade LLM-ops in Golang
  ☆55Updated this week
• EinStack / glide
  🐦 A open blazing-fast simple model gateway for rapid development of production GenAI apps
  ☆142Updated 7 months ago
• perk11 / large-model-proxy
  Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…
  ☆55Updated last month
• VatsaDev / NanoPhi-alpha
  GPT-2 small trained on phi-like data
  ☆65Updated last year
• jllllll / exllama
  A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.
  ☆65Updated last year
• gomlx / go-huggingface
  Conveniently download files, models, tokenizers from HuggingFace Hub
  ☆18Updated last month
• distantmagic / structured
  Extracts structured data from unstructured input. Programming language agnostic. Uses llama.cpp
  ☆44Updated 10 months ago
• XiaoConstantine / dspy-go
  DSPy Go implementation
  ☆27Updated this week
• taprosoft / llm_finetuning
  Convenient wrapper for fine-tuning and inference of Large Language Models (LLMs) with several quantization techniques (GTPQ, bitsandbytes…
  ☆147Updated last year