Alternatives and similar repositories for ggml

Users that are interested in ggml are comparing it to the libraries listed below

• eugenepentland / landmark-attention-qlora
  Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA
  ☆124Updated 2 years ago
• wawawario2 / long_term_memory
  A gradio web UI for running Large Language Models like GPT-J 6B, OPT, GALACTICA, LLaMA, and Pygmalion.
  ☆309Updated 2 years ago
• cmp-nct / ggllm.cpp
  Falcon LLM ggml framework with CPU and GPU support
  ☆247Updated last year
• AlpinDale / sparsegpt-for-LLaMA
  Code for the paper "SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shot" with LLaMA implementation.
  ☆71Updated 2 years ago
• Digitous / ModelREVOLVER
  Model REVOLVER, a human in the loop model mixing system.
  ☆33Updated 2 years ago
• kaiokendev / superbig
  A prompt/context management system
  ☆170Updated 2 years ago
• mzbac / qlora-fine-tune
  ☆168Updated 2 years ago
• johnsmith0031 / alpaca_lora_4bit
  ☆535Updated last year
• theubie / complex_memory
  A KoboldAI-like memory extension for oobabooga's text-generation-webui
  ☆108Updated 10 months ago
• Dhaladom / TALIS
  Simple and fast server for GPTQ-quantized LLaMA inference
  ☆24Updated 2 years ago
• flurb18 / AgentOoba
  An autonomous AI agent extension for Oobabooga's web ui
  ☆176Updated 2 years ago
• ChuloAI / BrainChulo
  Harnessing the Memory Power of the Camelids
  ☆146Updated last year
• PygmalionAI / training-code
  The code we currently use to fine-tune models.
  ☆117Updated last year
• aigoopy / llm-jeopardy
  Automated prompting and scoring framework to evaluate LLMs using updated human knowledge prompts
  ☆110Updated 2 years ago
• NolanoOrg / cformers
  SoTA Transformers with C-backend for fast inference on your CPU.
  ☆309Updated last year
• PotatoSpudowski / fastLLaMa
  fastLLaMa: An experimental high-performance framework for running Decoder-only LLMs with 4-bit quantization in Python using a C/C++ backe…
  ☆413Updated 2 years ago
• Maximilian-Winter / guidance
  A guidance language for controlling large language models.
  ☆45Updated 2 years ago
• togethercomputer / redpajama.cpp
  Extend the original llama.cpp repo to support redpajama model.
  ☆118Updated last year
• teknium1 / alpaca-roleplay-discordbot
  A discord bot that roleplays!
  ☆149Updated last year
• s4rduk4r / alpaca_lora_4bit_readme
  Just a simple HowTo for https://github.com/johnsmith0031/alpaca_lora_4bit
  ☆32Updated 2 years ago
• aspctu / alpaca-lora
  Instruct-tuning LLaMA on consumer hardware
  ☆66Updated 2 years ago
• FartyPants / Playground
  Text WebUI extension to add clever Notebooks to Chat mode
  ☆144Updated last month
• sebaxzero / LangChain_PDFChat_Oobabooga
  oobaboga -text-generation-webui implementation of wafflecomposite - langchain-ask-pdf-local
  ☆71Updated 2 years ago
• flurb18 / babyagi4all-api
  BabyAGI to run with locally hosted models using the API from https://github.com/oobabooga/text-generation-webui
  ☆88Updated 2 years ago
• abacaj / replit-3B-inference
  Run inference on replit-3B code instruct model using CPU
  ☆158Updated 2 years ago
• wsippel / bark_tts
  Oobabooga extension for Bark TTS
  ☆118Updated last year
• bigcode-project / starcoder.cpp
  C++ implementation for 💫StarCoder
  ☆456Updated 2 years ago
• 0cc4m / KoboldAI
  ☆158Updated last year
• chrisociepa / allamo
  Simple, hackable and fast implementation for training/finetuning medium-sized LLaMA-based models
  ☆179Updated 2 weeks ago
• oobabooga / GPTQ-for-LLaMa
  4 bits quantization of LLaMa using GPTQ
  ☆130Updated 2 years ago