Alternatives and similar repositories for llama-zip:

Users that are interested in llama-zip are comparing it to the libraries listed below

• ikawrakow / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆217Updated this week
• matt-c1 / llama-3-quant-comparison
  Comparison of the output quality of quantization methods, using Llama 3, transformers, GGUF, EXL2.
  ☆148Updated 10 months ago
• TheProxyCompany / proxy-structuring-engine
  Dynamically structure language models to produce outputs that adhere to specific requirements without sacrificing their creative capabili…
  ☆119Updated this week
• chigkim / Ollama-MMLU-Pro
  ☆81Updated 3 months ago
• cmp-nct / ggllm.cpp
  Falcon LLM ggml framework with CPU and GPU support
  ☆246Updated last year
• epolewski / EricLLM
  A fast batching API to serve LLM models
  ☆182Updated 10 months ago
• exo-explore / mlx-bitnet
  1.58 Bit LLM on Apple Silicon using MLX
  ☆192Updated 10 months ago
• trzy / llava-cpp-server
  LLaVA server (llama.cpp).
  ☆178Updated last year
• ejones / llama-journey
  Experimental adventure game with AI-generated content
  ☆109Updated last year
• willccbb / mlx_parallm
  Fast parallel LLM inference for MLX
  ☆174Updated 8 months ago
• sam-paech / antislop-sampler
  ☆273Updated last month
• turboderp-org / exui
  Web UI for ExLlamaV2
  ☆487Updated last month
• ggml-org / p1
  LLM-based code completion engine
  ☆181Updated 2 months ago
• cognitivecomputations / laserRMT
  This is our own implementation of 'Layer Selective Rank Reduction'
  ☆233Updated 9 months ago
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆163Updated this week
• cognitivecomputations / OpenChatML
  ☆152Updated 8 months ago
• migtissera / Sensei
  Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAI
  ☆224Updated 10 months ago
• kolinko / effort
  An implementation of bucketMul LLM inference
  ☆215Updated 8 months ago
• av / klmbr
  klmbr - a prompt pre-processing technique to break through the barrier of entropy while generating text with LLMs
  ☆71Updated 6 months ago
• fairydreaming / farel-bench
  Testing LLM reasoning abilities with family relationship quizzes.
  ☆62Updated last month
• thomasgauthier / LoRD
  Low-Rank adapter extraction for fine-tuned transformers models
  ☆171Updated 10 months ago
• umuthopeyildirim / DOOM-Mistral
  Mistral7B playing DOOM
  ☆130Updated 8 months ago
• abetlen / ggml-python
  Python bindings for ggml
  ☆140Updated 6 months ago
• kroggen / mamba.c
  Inference of Mamba models in pure C
  ☆186Updated last year
• itsme2417 / PolyMind
  A multimodal, function calling powered LLM webui.
  ☆215Updated 6 months ago
• pranavjad / tinyllama-bitnet
  Train your own small bitnet model
  ☆65Updated 5 months ago
• VatsaDev / NanoPhi-alpha
  GPT-2 small trained on phi-like data
  ☆65Updated last year
• matatonic / openedai-vision
  An OpenAI API compatible API for chat with image input and questions about the images. aka Multimodal.
  ☆237Updated 2 weeks ago
• moritztng / fltr
  Like grep but for natural language questions. Based on Mistral 7B or Mixtral 8x7B.
  ☆380Updated last year
• abgulati / kosmos-2_5-containerized
  Kosmos-2.5 is a cutting-edge Multimodal-LLM (MLLM) specializing in image OCR. However, its stringent software requirements & Python-scrip…
  ☆59Updated 8 months ago