Alternatives and similar repositories for ggml:

Users that are interested in ggml are comparing it to the libraries listed below

• s4rduk4r / alpaca_lora_4bit_readme
  Just a simple HowTo for https://github.com/johnsmith0031/alpaca_lora_4bit
  ☆31Updated last year
• eugenepentland / landmark-attention-qlora
  Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA
  ☆123Updated last year
• aigoopy / llm-jeopardy
  Automated prompting and scoring framework to evaluate LLMs using updated human knowledge prompts
  ☆111Updated last year
• VatsaDev / NanoPhi-alpha
  GPT-2 small trained on phi-like data
  ☆65Updated last year
• Maximilian-Winter / llama_cpp_function_calling
  ☆31Updated last year
• OpenAccess-AI-Collective / ggml-webui
  Deploy your GGML models to HuggingFace Spaces with Docker and gradio
  ☆36Updated last year
• PygmalionAI / training-code
  The code we currently use to fine-tune models.
  ☆113Updated 9 months ago
• Digitous / ModelREVOLVER
  Model REVOLVER, a human in the loop model mixing system.
  ☆33Updated last year
• AlpinDale / sparsegpt-for-LLaMA
  Code for the paper "SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shot" with LLaMA implementation.
  ☆71Updated last year
• teknium1 / alpaca-discord
  A Simple Discord Bot for the Alpaca LLM
  ☆101Updated last year
• cmp-nct / ggllm.cpp
  Falcon LLM ggml framework with CPU and GPU support
  ☆246Updated last year
• theubie / complex_memory
  A KoboldAI-like memory extension for oobabooga's text-generation-webui
  ☆108Updated 3 months ago
• OpenAccess-AI-Collective / servereless-runpod-ggml
  ☆55Updated last year
• lachlansneff / sparsellama
  ☆40Updated last year
• Aspartame-e951 / apiserver.py
  A small standalone flask python server for llama.cpp that acts like a KoboldAI api.
  ☆14Updated last year
• YenRaven / annoy_ltm
  annoy long term memory experiment for oobabooga/text-generation-webui
  ☆31Updated last year
• shinomakoi / magi_llm_gui
  A Qt GUI for large language models
  ☆41Updated last year
• Birch-san / mpt-play
  Command-line script for inferencing from models such as MPT-7B-Chat
  ☆101Updated last year
• Dhaladom / TALIS
  Simple and fast server for GPTQ-quantized LLaMA inference
  ☆24Updated last year
• jllllll / exllama
  A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.
  ☆65Updated last year
• serp-ai / unsloth
  5X faster 60% less memory QLoRA finetuning
  ☆21Updated 8 months ago
• ChuloAI / BrainChulo
  Harnessing the Memory Power of the Camelids
  ☆146Updated last year
• aspctu / alpaca-lora
  Instruct-tuning LLaMA on consumer hardware
  ☆66Updated last year
• absadiki / pyllamacpp
  Python bindings for llama.cpp
  ☆65Updated 11 months ago
• resloved / RWKV-notebooks
  📖 — Notebooks related to RWKV
  ☆59Updated last year
• wozeparrot / tinyrwkv
  tinygrad port of the RWKV large language model.
  ☆44Updated 8 months ago
• the-crypt-keeper / the-muse
  Experimental sampler to make LLMs more creative
  ☆30Updated last year
• ChobPT / oobaboogas-webui-langchain_agent
  Creates an Langchain Agent which uses the WebUI's API and Wikipedia to work
  ☆73Updated last year
• TheBloke / AutoGPTQ
  An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.
  ☆37Updated last year
• togethercomputer / redpajama.cpp
  Extend the original llama.cpp repo to support redpajama model.
  ☆117Updated 5 months ago