Alternatives and similar repositories for booster:

Users that are interested in booster are comparing it to the libraries listed below

• go-skynet / go-ggml-transformers.cpp
  Binding to transformers in ggml
  ☆60Updated 2 weeks ago
• mudler / go-stable-diffusion
  ☆16Updated 9 months ago
• cornelk / llama-go
  Port of Facebook's LLaMA (Large Language Model Meta AI) in Golang with embedded C/C++
  ☆163Updated last year
• epolewski / EricLLM
  A fast batching API to serve LLM models
  ☆180Updated 9 months ago
• jeffrey-fong / Invoker
  The one who calls upon functions - Function-Calling Language Model
  ☆36Updated last year
• nicholasyager / llama-cpp-guidance
  A guidance compatibility layer for llama-cpp-python
  ☆34Updated last year
• beratcmn / local-intelligence
  Something similar to Apple Intelligence?
  ☆58Updated 6 months ago
• EinStack / glide
  🐦 A open blazing-fast simple model gateway for rapid development of production GenAI apps
  ☆140Updated 5 months ago
• nlpodyssey / verbaflow
  Neural Language Model for Go
  ☆58Updated last year
• rodrigobaron / anthill
  ☆25Updated last week
• haormj / llama2.go
  Inference Llama 2 in one file of pure go
  ☆16Updated last year
• mzbac / mlx-lora
  ☆38Updated 10 months ago
• acheong08 / vectordb
  A simple vector database: Text encoding, semantic search, document storage
  ☆87Updated last year
• VatsaDev / NanoPhi-alpha
  GPT-2 small trained on phi-like data
  ☆65Updated 11 months ago
• donomii / go-rwkv.cpp
  A go wrapper around the rwkv.cpp library
  ☆20Updated 10 months ago
• gotzmann / fast
  FastTensors - 100% Go framework for Neural Nets
  ☆44Updated 4 months ago
• tmc / righthand
  RightHand - A GPT4 powered assistive tool.
  ☆107Updated 2 weeks ago
• mayank31398 / GPTQ-for-SantaCoder
  4 bits quantization of SantaCoder using GPTQ
  ☆53Updated last year
• LLukas22 / llm-rs-python
  Unofficial python bindings for the rust llm library. 🐍❤️🦀
  ☆74Updated last year
• oKatanaaa / lima-gui
  A simple GUI utility for gathering LIMA-like chat data.
  ☆22Updated 2 months ago
• perk11 / large-model-proxy
  Large Model Proxy is designed to make it easy to run multiple resource-heavy Large Models (LM) on the same machine with limited amount of…
  ☆49Updated 3 months ago
• gpustack / gguf-parser-go
  Review/Check GGUF files and estimate the memory usage and maximum tokens per second.
  ☆76Updated this week
• iamlemec / bert.cpp
  GGML implementation of BERT model with Python bindings and quantization.
  ☆53Updated 11 months ago
• milosgajdos / go-embeddings
  Go module for fetching embeddings from embeddings providers
  ☆43Updated last month
• asg017 / sqlite-rembed
  A SQLite extension for generating text embeddings from remote APIs (OpenAI, Nomic, Ollama, llamafile...)
  ☆103Updated 2 months ago
• av / klmbr
  klmbr - a prompt pre-processing technique to break through the barrier of entropy while generating text with LLMs
  ☆67Updated 4 months ago
• tmc / go-llama2
  Llama 2 inference in one file of pure Go
  ☆105Updated last year
• IlyaGusev / saiga
  ☆36Updated last month
• tolitius / towel
  "a towel is about the most massively useful thing an interstellar AI hitchhiker can have"
  ☆48Updated 3 months ago
• mzbac / mlx_sharding
  Distributed Inference for mlx LLm
  ☆79Updated 5 months ago