Alternatives and similar repositories for llama-3-quant-comparison:

Users that are interested in llama-3-quant-comparison are comparing it to the libraries listed below

• epolewski / EricLLM
  A fast batching API to serve LLM models
  ☆182Updated last year
• rafacelente / bllama
  1.58-bit LLaMa model
  ☆81Updated last year
• chigkim / Ollama-MMLU-Pro
  ☆89Updated 4 months ago
• thomasgauthier / LoRD
  Low-Rank adapter extraction for fine-tuned transformers models
  ☆173Updated last year
• sam-paech / antislop-sampler
  ☆288Updated last month
• LostRuins / datasetexplorer
  Easily view and modify JSON datasets for large language models
  ☆75Updated 2 months ago
• statchamber / ebook-to-chatml-conversion
  idea: https://github.com/nyxkrage/ebook-groupchat/
  ☆86Updated 8 months ago
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆170Updated last week
• severian42 / Vodalus-Expert-LLM-Forge
  Dataset Crafting w/ RAG/Wikipedia ground truth and Efficient Fine-Tuning Using MLX and Unsloth. Includes configurable dataset annotation …
  ☆181Updated 9 months ago
• theroyallab / YALS
  ☆66Updated this week
• TheProxyCompany / proxy-structuring-engine
  Guaranteed Structured Output from any Language Model via Hierarchical State Machines
  ☆125Updated last week
• SicariusSicariiStuff / SLOP_Detector
  SLOP Detector and analyzer based on dictionary for shareGPT JSON and text
  ☆67Updated 6 months ago
• TC-Zheng / ActuosusAI
  AI management tool
  ☆115Updated 5 months ago
• jd-3d / SOLOBench
  ☆51Updated this week
• the-crypt-keeper / LLooM
  Experimental LLM Inference UX to aid in creative writing
  ☆116Updated 4 months ago
• itsme2417 / PolyMind
  A multimodal, function calling powered LLM webui.
  ☆214Updated 7 months ago
• ikawrakow / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆400Updated this week
• cognitivecomputations / laserRMT
  This is our own implementation of 'Layer Selective Rank Reduction'
  ☆237Updated 11 months ago
• Gryphe / MergeMonster
  An unsupervised model merging algorithm for Transformers-based language models.
  ☆105Updated last year
• willccbb / mlx_parallm
  Fast parallel LLM inference for MLX
  ☆186Updated 10 months ago
• turboderp-org / exllamav3
  An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs
  ☆335Updated this week
• av / klmbr
  klmbr - a prompt pre-processing technique to break through the barrier of entropy while generating text with LLMs
  ☆71Updated 7 months ago
• mzbac / mlx_sharding
  Distributed Inference for mlx LLm
  ☆89Updated 9 months ago
• cognitivecomputations / OpenChatML
  ☆154Updated 9 months ago
• arcee-ai / PruneMe
  Automated Identification of Redundant Layer Blocks for Pruning in Large Language Models
  ☆236Updated last year
• turboderp-org / exui
  Web UI for ExLlamaV2
  ☆493Updated 3 months ago
• migtissera / Sensei
  Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAI
  ☆223Updated last year
• Orion-zhen / abliteration
  Make abliterated models with transformers, easy and fast
  ☆68Updated 2 weeks ago
• Mihaiii / backtrack_sampler
  An easy-to-understand framework for LLM samplers that rewind and revise generated tokens
  ☆139Updated 2 months ago
• matatonic / openedai-vision
  An OpenAI API compatible API for chat with image input and questions about the images. aka Multimodal.
  ☆251Updated 2 months ago