Alternatives and similar repositories for llama-cpu

Users that are interested in llama-cpu are comparing it to the libraries listed below

• modular-ml / wrapyfi-examples_llama
  Inference code for facebook LLaMA models with Wrapyfi support
  ☆129Updated 2 years ago
• aigoopy / llm-jeopardy
  Automated prompting and scoring framework to evaluate LLMs using updated human knowledge prompts
  ☆110Updated last year
• nuance1979 / llama-server
  LLaMA Server combines the power of LLaMA C++ with the beauty of Chatbot UI.
  ☆126Updated 2 years ago
• Gryphe / BlockMerge_Gradient
  Merge Transformers language models by use of gradient parameters.
  ☆206Updated 10 months ago
• cmp-nct / ggllm.cpp
  Falcon LLM ggml framework with CPU and GPU support
  ☆246Updated last year
• EmbeddedLLM / vllm
  vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆87Updated this week
• huggingface / optimum-amd
  AMD related optimizations for transformer models
  ☆79Updated 7 months ago
• shawwn / llama
  Inference code for LLaMA models
  ☆188Updated 2 years ago
• mayank31398 / GPTQ-for-SantaCoder
  4 bits quantization of SantaCoder using GPTQ
  ☆51Updated 2 years ago
• rafacelente / bllama
  1.58-bit LLaMa model
  ☆81Updated last year
• oobabooga / GPTQ-for-LLaMa
  4 bits quantization of LLaMa using GPTQ
  ☆129Updated 2 years ago
• eugenepentland / landmark-attention-qlora
  Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA
  ☆123Updated 2 years ago
• AlpinDale / sparsegpt-for-LLaMA
  Code for the paper "SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shot" with LLaMA implementation.
  ☆71Updated 2 years ago
• abetlen / ggml-python
  Python bindings for ggml
  ☆141Updated 9 months ago
• taprosoft / llm_finetuning
  Convenient wrapper for fine-tuning and inference of Large Language Models (LLMs) with several quantization techniques (GTPQ, bitsandbytes…
  ☆147Updated last year
• NolanoOrg / cformers
  SoTA Transformers with C-backend for fast inference on your CPU.
  ☆309Updated last year
• qwopqwop200 / gptqlora
  GPTQLoRA: Efficient Finetuning of Quantized LLMs with GPTQ
  ☆103Updated 2 years ago
• clcarwin / alpaca-weight
  Train llama with lora on one 4090 and merge weight of lora to work as stanford alpaca.
  ☆51Updated 2 years ago
• LambdaLabsML / llama
  Inference code for LLaMA models
  ☆42Updated 2 years ago
• galatolofederico / vanilla-llama
  Plain pytorch implementation of LLaMA
  ☆188Updated 2 years ago
• LucienShui / huggingface-vscode-endpoint-server
  starcoder server for huggingface-vscdoe custom endpoint
  ☆172Updated last year
• jquesnelle / transformers-openai-api
  An OpenAI Completions API compatible server for NLP transformers models
  ☆65Updated last year
• lxe / cerebras-lora-alpaca
  LoRA weights for Cerebras-GPT-2.7b finetuned on Alpaca dataset with shorter prompt
  ☆63Updated 2 years ago
• fpgaminer / GPTQ-triton
  GPTQ inference Triton kernel
  ☆302Updated 2 years ago
• mzbac / wizardCoder-vsc
  Visual Studio Code extension for WizardCoder
  ☆148Updated last year
• rmihaylov / mpttune
  Tune MPTs
  ☆84Updated 2 years ago
• AlpinDale / RPTQ-for-LLaMA
  Efficient 3bit/4bit quantization of LLaMA models
  ☆19Updated 2 years ago
• Gryphe / MergeMonster
  An unsupervised model merging algorithm for Transformers-based language models.
  ☆105Updated last year
• cognitivecomputations / OpenChatML
  ☆157Updated 11 months ago
• TheBlokeAI / AIScripts
  Some simple scripts that I use day-to-day when working with LLMs and Huggingface Hub
  ☆162Updated last year