Alternatives and similar repositories for llama-cpp-server-python

Users that are interested in llama-cpp-server-python are comparing it to the libraries listed below

• huseinzol05 / transformers-continuous-batching
  Lightweight continuous batching OpenAI compatibility using HuggingFace Transformers include T5 and Whisper.
  ☆29Updated 8 months ago
• nyunAI / PruneGPT
  ☆51Updated last year
• l4b4r4b4b4 / AIDocks
  LLM-Training-API: Including Embeddings & ReRankers, mergekit, LaserRMT
  ☆27Updated last year
• nivibilla / build-nanogpt
  Video+code lecture on building nanoGPT from scratch
  ☆68Updated last year
• tdrussell / qlora-pipe
  A pipeline parallel training script for LLMs.
  ☆163Updated 6 months ago
• substratusai / stapi
  Sentence Transformers API: An OpenAI compatible embedding API server
  ☆68Updated last year
• autogenai / easy-problems-that-llms-get-wrong
  ☆48Updated last year
• QuixiAI / spectrum
  ☆138Updated 3 months ago
• fairydreaming / llama.cpp
  LLM inference in C/C++
  ☆21Updated 8 months ago
• embeddings-benchmark / arena
  Code for the MTEB Arena
  ☆24Updated 4 months ago
• EduardTalianu / EntropixLab
  entropix style sampling + GUI
  ☆27Updated last year
• agokrani / distillKitPlus
  Easy to use, High Performant Knowledge Distillation for LLMs
  ☆95Updated 6 months ago
• thomasgauthier / LoRD
  Low-Rank adapter extraction for fine-tuned transformers models
  ☆179Updated last year
• ComposioHQ / Composio-Function-Calling-Benchmark
  Function Calling Benchmark & Testing
  ☆92Updated last year
• louisbrulenaudet / ragoon
  High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡
  ☆68Updated this week
• golololologol / LLM-Distillery
  A pipeline for LLM knowledge distillation
  ☆110Updated 7 months ago
• Pleias / Various-Finetuning
  Set of scripts to finetune LLMs
  ☆38Updated last year
• chigkim / Ollama-MMLU-Pro
  ☆106Updated 3 months ago
• QuixiAI / grokadamw
  ☆136Updated last year
• Locutusque / TPU-Alignment
  Fully fine-tune large models like Mistral, Llama-2-13B, or Qwen-14B completely for free
  ☆231Updated last year
• flowaicom / flow-judge
  Code for evaluating with Flow-Judge-v0.1 - an open-source, lightweight (3.8B) language model optimized for LLM system evaluations. Crafte…
  ☆78Updated last year
• rkuo2000 / GenAI
  ☆10Updated last week
• ddh0 / easy-llama
  Python package wrapping llama.cpp for on-device LLM inference
  ☆94Updated last month
• xhedit / quantkit
  cli tool to quantize gguf, gptq, awq, hqq and exl2 models
  ☆76Updated 11 months ago
• teknium1 / ShareGPT-Builder
  ☆116Updated 11 months ago
• beyondExp / B-Llama3-o
  B-Llama3o a llama3 with Vision Audio and Audio understanding as well as text and Audio and Animation Data output.
  ☆26Updated last year
• istupakov / onnx-asr
  Automatic Speech Recognition in Python using ONNX models
  ☆153Updated last month
• umar-mq / chainlit-rag
  ☆30Updated last year
• antonguzun / data-agent
  Work with your business data using natural language
  ☆18Updated last year
• the-crypt-keeper / tcurtsni
  Tcurtsni: Reverse Instruction Chat, ever wonder what your LLM wants to ask you?
  ☆23Updated last year