Alternatives and similar repositories for ggml

Users that are interested in ggml are comparing it to the libraries listed below

• eugenepentland / landmark-attention-qlora
  Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA
  ☆125Updated 2 years ago
• wawawario2 / long_term_memory
  A gradio web UI for running Large Language Models like GPT-J 6B, OPT, GALACTICA, LLaMA, and Pygmalion.
  ☆310Updated 2 years ago
• cmp-nct / ggllm.cpp
  Falcon LLM ggml framework with CPU and GPU support
  ☆249Updated 2 years ago
• johnsmith0031 / alpaca_lora_4bit
  ☆535Updated 2 years ago
• oobabooga / GPTQ-for-LLaMa
  4 bits quantization of LLaMa using GPTQ
  ☆131Updated 2 years ago
• PotatoSpudowski / fastLLaMa
  fastLLaMa: An experimental high-performance framework for running Decoder-only LLMs with 4-bit quantization in Python using a C/C++ backe…
  ☆412Updated 2 years ago
• NolanoOrg / cformers
  SoTA Transformers with C-backend for fast inference on your CPU.
  ☆311Updated 2 years ago
• Digitous / ModelREVOLVER
  Model REVOLVER, a human in the loop model mixing system.
  ☆33Updated 2 years ago
• AlpinDale / sparsegpt-for-LLaMA
  Code for the paper "SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shot" with LLaMA implementation.
  ☆71Updated 2 years ago
• aigoopy / llm-jeopardy
  Automated prompting and scoring framework to evaluate LLMs using updated human knowledge prompts
  ☆109Updated 2 years ago
• Maximilian-Winter / guidance
  A guidance language for controlling large language models.
  ☆45Updated 2 years ago
• kaiokendev / superbig
  A prompt/context management system
  ☆168Updated 2 years ago
• pointnetwork / point-alpaca
  ☆404Updated 2 years ago
• melodysdreamj / WizardVicunaLM
  LLM that combines the principles of wizardLM and vicunaLM
  ☆716Updated 2 years ago
• rmihaylov / falcontune
  Tune any FALCON in 4-bit
  ☆463Updated 2 years ago
• Gryphe / BlockMerge_Gradient
  Merge Transformers language models by use of gradient parameters.
  ☆213Updated last year
• ChuloAI / BrainChulo
  Harnessing the Memory Power of the Camelids
  ☆147Updated 2 years ago
• jondurbin / qlora
  QLoRA: Efficient Finetuning of Quantized LLMs
  ☆79Updated last year
• togethercomputer / redpajama.cpp
  Extend the original llama.cpp repo to support redpajama model.
  ☆118Updated last year
• keldenl / gpt-llama.cpp
  A llama.cpp drop-in replacement for OpenAI's GPT endpoints, allowing GPT-powered apps to run off local llama.cpp models instead of OpenAI…
  ☆597Updated 2 years ago
• QuixiAI / laserRMT
  This is our own implementation of 'Layer Selective Rank Reduction'
  ☆240Updated last year
• lastmile-ai / llama-retrieval-plugin
  LLaMa retrieval plugin script using OpenAI's retrieval plugin
  ☆323Updated 2 years ago
• PygmalionAI / training-code
  The code we currently use to fine-tune models.
  ☆117Updated last year
• bigcode-project / starcoder.cpp
  C++ implementation for 💫StarCoder
  ☆459Updated 2 years ago
• mzbac / qlora-fine-tune
  ☆167Updated 2 years ago
• Dhaladom / TALIS
  Simple and fast server for GPTQ-quantized LLaMA inference
  ☆24Updated 2 years ago
• theubie / complex_memory
  A KoboldAI-like memory extension for oobabooga's text-generation-webui
  ☆108Updated last year
• aspctu / alpaca-lora
  Instruct-tuning LLaMA on consumer hardware
  ☆66Updated 2 years ago
• Gryphe / MergeMonster
  An unsupervised model merging algorithm for Transformers-based language models.
  ☆108Updated last year
• harrisonvanderbyl / rwkv-cpp-accelerated
  A torchless, c++ rwkv implementation using 8bit quantization, written in cuda/hip/vulkan for maximum compatibility and minimum dependenci…
  ☆313Updated 2 years ago