jllllll / GPTQ-for-LLaMa-CUDA

Related projects ⓘ

Alternatives and complementary repositories for GPTQ-for-LLaMa-CUDA

• ThereforeGames / echoproof
  Simple extension for text-generation-webui that injects recent conversation history into the negative prompt with the goal of minimizing …
  ☆33Updated last year
• oobabooga / llama-cpp-python-cuBLAS-wheels
  Wheels for llama-cpp-python compiled with cuBLAS support
  ☆18Updated last month
• theubie / complex_memory
  A KoboldAI-like memory extension for oobabooga's text-generation-webui
  ☆107Updated 3 weeks ago
• zarakiquemparte / zaraki-tools
  ☆27Updated last year
• jllllll / flash-attention
  Fast and memory-efficient exact attention - Windows wheels
  ☆31Updated 8 months ago
• p-e-w / chatbot_clinic
  Science-driven chatbot development
  ☆55Updated 6 months ago
• CharlesMod / quantizeHFmodel
  Accepts a Hugging Face model URL, automatically downloads and quantizes it using Bits and Bytes.
  ☆38Updated 8 months ago
• shinomakoi / magi_llm_gui
  A Qt GUI for large language models
  ☆40Updated last year
• dibrale / webui_autonomics
  Dynamic parameter modulation for oobabooga's text-generation-webui that adjusts generation parameters to better mirror user affect.
  ☆34Updated last year
• YenRaven / annoy_ltm
  annoy long term memory experiment for oobabooga/text-generation-webui
  ☆31Updated last year
• theubie / simple_memory
  An extension to Oobabooga to add a simple memory function for chat
  ☆23Updated last year
• HabermannR / Fantasy-Tribe-Game
  LLM backed Fantasy Tribe Game
  ☆18Updated this week
• the-crypt-keeper / the-muse
  Experimental sampler to make LLMs more creative
  ☆30Updated last year
• FartyPants / the_muse
  oobabooga extension - Experimental sampler to make LLMs more creative
  ☆23Updated last year
• theroyallab / llm-prompt-templates
  Prompt Jinja2 templates for LLMs
  ☆27Updated 2 months ago
• s4rduk4r / alpaca_lora_4bit_readme
  Just a simple HowTo for https://github.com/johnsmith0031/alpaca_lora_4bit
  ☆31Updated last year
• danikhan632 / guidance_api
  An Extension for oobabooga/text-generation-webui
  ☆36Updated last year
• RandomInternetPreson / LucidWebSearch
  A web search extension for Oobabooga's text-generation-webui (now with nougat)
  ☆64Updated 4 months ago
• the-crypt-keeper / ggml-downloader
  Simple, Fast, Parallel Huggingface GGML model downloader written in python
  ☆24Updated last year
• DataBassGit / BabyBoogaAGI
  Porting BabyAGI to Oobabooba.
  ☆33Updated last year
• theroyallab / ST-tabbyAPI-loader
  Loader extension for tabbyAPI in SillyTavern
  ☆22Updated 3 months ago
• Hellisotherpeople / llm_steer-oobabooga
  Steer LLM outputs towards a certain topic/subject and enhance response capabilities using activation engineering by adding steering vecto…
  ☆42Updated 8 months ago
• henk717 / koboldcpp
  Port of Facebook's LLaMA model in C/C++
  ☆15Updated this week
• stringandstickytape / MaxsAiStudio
  A Windows tool to query various LLM AIs. Supports branched conversations, history and summaries among others.
  ☆28Updated 2 weeks ago
• nexusflowai / NexusBench
  Nexusflow function call, tool use, and agent benchmarks.
  ☆14Updated this week
• Digitous / ModelREVOLVER
  Model REVOLVER, a human in the loop model mixing system.
  ☆33Updated last year
• j-webtek / LLM-Learning
  A repository to store helpful information and emerging insights in regard to LLMs
  ☆20Updated last year
• arthurwolf / llmi
  Large-Language-Model to Machine Interface project.
  ☆17Updated 11 months ago
• Maximilian-Winter / llama_cpp_function_calling
  ☆31Updated 10 months ago