Alternatives and similar repositories for alpaca.cpp

Users that are interested in alpaca.cpp are comparing it to the libraries listed below

• euclaise / SlimTrainer
  Full finetuning of large language models without large memory requirements
  ☆94Updated last year
• s4rduk4r / alpaca_lora_4bit_readme
  Just a simple HowTo for https://github.com/johnsmith0031/alpaca_lora_4bit
  ☆31Updated 2 years ago
• eugenepentland / landmark-attention-qlora
  Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA
  ☆123Updated last year
• cmp-nct / ggllm.cpp
  Falcon LLM ggml framework with CPU and GPU support
  ☆246Updated last year
• c0sogi / llama-api
  An OpenAI-like LLaMA inference API
  ☆112Updated last year
• AlpinDale / sparsegpt-for-LLaMA
  Code for the paper "SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shot" with LLaMA implementation.
  ☆71Updated 2 years ago
• aspctu / alpaca-lora
  Instruct-tuning LLaMA on consumer hardware
  ☆66Updated 2 years ago
• Artefact2 / llm-eval
  A super simple web interface to perform blind tests on LLM outputs.
  ☆28Updated last year
• NolanoOrg / cformers
  SoTA Transformers with C-backend for fast inference on your CPU.
  ☆309Updated last year
• lastmile-ai / llama-retrieval-plugin
  LLaMa retrieval plugin script using OpenAI's retrieval plugin
  ☆324Updated 2 years ago
• serp-ai / unsloth
  5X faster 60% less memory QLoRA finetuning
  ☆21Updated last year
• Gryphe / MergeMonster
  An unsupervised model merging algorithm for Transformers-based language models.
  ☆105Updated last year
• thomasantony / llamacpp-python
  Python bindings for llama.cpp
  ☆197Updated 2 years ago
• DavG25 / text-generation-webui-code_syntax_highlight
  An extension for oobabooga's text-generation-webui that adds syntax highlighting to code snippets
  ☆68Updated last year
• jploski / ggml
  Falcon7B + Falcon40B support - in branch falcon40b. Now all good and working. But main action now in https://github.com/cmp-nct/ggllm.cpp
  ☆11Updated last year
• IntrinsicLabsAI / grammar-builder
  Generates grammer files from typescript for LLM generation
  ☆38Updated last year
• ragnarkar / reddit_imitator
  ☆16Updated last year
• ggml-org / p1
  LLM-based code completion engine
  ☆188Updated 4 months ago
• lachlansneff / sparsellama
  ☆40Updated 2 years ago
• alasdairforsythe / capcode
  Lossless normalization of uppercase characters
  ☆11Updated last year
• ChobPT / oobaboogas-webui-langchain_agent
  Creates an Langchain Agent which uses the WebUI's API and Wikipedia to work
  ☆74Updated last year
• LLukas22 / llm-rs-python
  Unofficial python bindings for the rust llm library. 🐍❤️🦀
  ☆75Updated last year
• TheBloke / AutoGPTQ
  An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.
  ☆37Updated last year
• nathankot / bashi
  Extensible AI assistant platform that bridges LLMs to tasks and actions
  ☆38Updated 2 years ago
• abetlen / program-constrained-language-model-sampling
  ☆35Updated 2 years ago
• PygmalionAI / training-code
  The code we currently use to fine-tune models.
  ☆114Updated last year
• shinomakoi / magi_llm_gui
  A Qt GUI for large language models
  ☆43Updated last year
• AblateIt / finetune-study
  Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.
  ☆82Updated last year
• harrisonvanderbyl / rwkv_chatbot
  rwkv_chatbot
  ☆62Updated 2 years ago
• nicholasyager / llama-cpp-guidance
  A guidance compatibility layer for llama-cpp-python
  ☆34Updated last year