Alternatives and similar repositories for llama-zip:

Users that are interested in llama-zip are comparing it to the libraries listed below

• sam-paech / antislop-sampler
  ☆268Updated 3 weeks ago
• pinokiocomputer / llamanet
  Replace OpenAI with Llama.cpp Automagically.
  ☆308Updated 8 months ago
• turboderp-org / exui
  Web UI for ExLlamaV2
  ☆480Updated 2 weeks ago
• avarayr / suaveui
  Open source LLM UI, compatible with all local LLM providers.
  ☆171Updated 5 months ago
• distantmagic / paddler
  Stateful load balancer custom-tailored for llama.cpp 🏓🦙
  ☆706Updated last month
• TC-Zheng / ActuosusAI
  AI management tool
  ☆112Updated 3 months ago
• matt-c1 / llama-3-quant-comparison
  Comparison of the output quality of quantization methods, using Llama 3, transformers, GGUF, EXL2.
  ☆146Updated 9 months ago
• IntrinsicLabsAI / gbnfgen
  TypeScript generator for llama.cpp Grammar directly from TypeScript interfaces
  ☆134Updated 7 months ago
• Mihaiii / backtrack_sampler
  An easy-to-understand framework for LLM samplers that rewind and revise generated tokens
  ☆130Updated this week
• thomasgauthier / LoRD
  Low-Rank adapter extraction for fine-tuned transformers models
  ☆169Updated 9 months ago
• cognitivecomputations / OpenChatML
  ☆152Updated 7 months ago
• epolewski / EricLLM
  A fast batching API to serve LLM models
  ☆180Updated 9 months ago
• umuthopeyildirim / DOOM-Mistral
  Mistral7B playing DOOM
  ☆127Updated 7 months ago
• pranavjad / tinyllama-bitnet
  Train your own small bitnet model
  ☆64Updated 4 months ago
• av / klmbr
  klmbr - a prompt pre-processing technique to break through the barrier of entropy while generating text with LLMs
  ☆68Updated 4 months ago
• ejones / llama-journey
  Experimental adventure game with AI-generated content
  ☆109Updated last year
• galatolofederico / microchain
  function calling-based LLM agents
  ☆283Updated 5 months ago
• SicariusSicariiStuff / SLOP_Detector
  SLOP Detector and analyzer based on dictionary for shareGPT JSON and text
  ☆61Updated 3 months ago
• kolinko / effort
  An implementation of bucketMul LLM inference
  ☆215Updated 7 months ago
• rafacelente / bllama
  1.58-bit LLaMa model
  ☆82Updated 10 months ago
• VITA-Group / Q-GaLore
  Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.
  ☆191Updated 7 months ago
• EGjoni / DRUGS
  Stop messing around with finicky sampling parameters and just use DRµGS!
  ☆343Updated 8 months ago
• astramind-ai / BitMat
  An efficent implementation of the method proposed in "The Era of 1-bit LLMs"
  ☆154Updated 4 months ago
• ikawrakow / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆155Updated this week
• Sebby37 / Dead-Internet
  Y'all thought the dead internet theory wasn't real, but HERE IT IS
  ☆179Updated 9 months ago
• itsme2417 / PolyMind
  A multimodal, function calling powered LLM webui.
  ☆214Updated 4 months ago
• cognitivecomputations / laserRMT
  This is our own implementation of 'Layer Selective Rank Reduction'
  ☆233Updated 8 months ago
• Maximilian-Winter / llama-cpp-agent
  The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM …
  ☆530Updated this week
• moritztng / fltr
  Like grep but for natural language questions. Based on Mistral 7B or Mixtral 8x7B.
  ☆380Updated 11 months ago
• mobiusml / hqq
  Official implementation of Half-Quadratic Quantization (HQQ)
  ☆748Updated this week