Alternatives and similar repositories for booster:

Users that are interested in booster are comparing it to the libraries listed below

• go-skynet / go-ggml-transformers.cpp
  Binding to transformers in ggml
  ☆60Updated 2 weeks ago
• mudler / go-stable-diffusion
  ☆16Updated 11 months ago
• mayank31398 / GPTQ-for-SantaCoder
  4 bits quantization of SantaCoder using GPTQ
  ☆51Updated last year
• acheong08 / vectordb
  A simple vector database: Text encoding, semantic search, document storage
  ☆89Updated last year
• tmc / go-llama2
  Llama 2 inference in one file of pure Go
  ☆104Updated last year
• wangcx18 / llm-vscode-inference-server
  An endpoint server for efficiently serving quantized open-source LLMs for code.
  ☆54Updated last year
• nicholasyager / llama-cpp-guidance
  A guidance compatibility layer for llama-cpp-python
  ☆34Updated last year
• donomii / go-rwkv.cpp
  A go wrapper around the rwkv.cpp library
  ☆20Updated last year
• cornelk / llama-go
  Port of Facebook's LLaMA (Large Language Model Meta AI) in Golang with embedded C/C++
  ☆167Updated last year
• OpenAccess-AI-Collective / servereless-runpod-ggml
  ☆55Updated last year
• tmc / righthand
  RightHand - A GPT4 powered assistive tool.
  ☆109Updated 3 months ago
• mzbac / mlx-lora
  ☆38Updated last year
• VatsaDev / NanoPhi-alpha
  GPT-2 small trained on phi-like data
  ☆66Updated last year
• distantmagic / structured
  Extracts structured data from unstructured input. Programming language agnostic. Uses llama.cpp
  ☆45Updated 11 months ago
• OpenAccess-AI-Collective / ggml-webui
  Deploy your GGML models to HuggingFace Spaces with Docker and gradio
  ☆36Updated last year
• saracen / llama2.go
  Inference Llama 2 in Go
  ☆39Updated last year
• oKatanaaa / lima-gui
  A simple GUI utility for gathering LIMA-like chat data.
  ☆23Updated last month
• IntrinsicLabsAI / gbnfgen
  TypeScript generator for llama.cpp Grammar directly from TypeScript interfaces
  ☆135Updated 9 months ago
• cmp-nct / ggllm.cpp
  Falcon LLM ggml framework with CPU and GPU support
  ☆246Updated last year
• Maximilian-Winter / llama_cpp_function_calling
  ☆31Updated last year
• nath1295 / MLX-Textgen
  A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.
  ☆76Updated 4 months ago
• haormj / llama2.go
  Inference Llama 2 in one file of pure go
  ☆16Updated last year
• EinStack / glide
  🐦 A open blazing-fast simple model gateway for rapid development of production GenAI apps
  ☆144Updated 8 months ago
• ChuloAI / oasis
  Local LLaMAs/Models in VSCode
  ☆53Updated last year
• neuml / txtai.go
  Go client for txtai
  ☆78Updated this week
• sedwards2009 / llm-multitool
  Web UI for working with large language models
  ☆32Updated 10 months ago
• epolewski / EricLLM
  A fast batching API to serve LLM models
  ☆182Updated 11 months ago
• togethercomputer / redpajama.cpp
  Extend the original llama.cpp repo to support redpajama model.
  ☆117Updated 7 months ago
• rodrigobaron / anthill
  ☆24Updated 2 months ago
• jllllll / exllama
  A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.
  ☆64Updated last year