jllllll / llama-cpp-python-cuBLAS-wheels

Related projects ⓘ

Alternatives and complementary repositories for llama-cpp-python-cuBLAS-wheels

• Gryphe / MergeMonster
  An unsupervised model merging algorithm for Transformers-based language models.
  ☆100Updated 6 months ago
• aigoopy / llm-jeopardy
  Automated prompting and scoring framework to evaluate LLMs using updated human knowledge prompts
  ☆111Updated last year
• kaiokendev / superbig
  A prompt/context management system
  ☆165Updated last year
• p-e-w / chatbot_clinic
  Science-driven chatbot development
  ☆55Updated 6 months ago
• Digitous / ModelREVOLVER
  Model REVOLVER, a human in the loop model mixing system.
  ☆33Updated last year
• oobabooga / GPTQ-for-LLaMa
  4 bits quantization of LLaMa using GPTQ
  ☆130Updated last year
• FartyPants / Playground
  Text WebUI extension to add clever Notebooks to Chat mode
  ☆133Updated 10 months ago
• theubie / complex_memory
  A KoboldAI-like memory extension for oobabooga's text-generation-webui
  ☆107Updated 3 weeks ago
• eugenepentland / landmark-attention-qlora
  Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA
  ☆124Updated last year
• s4rduk4r / alpaca_lora_4bit_readme
  Just a simple HowTo for https://github.com/johnsmith0031/alpaca_lora_4bit
  ☆31Updated last year
• danikhan632 / guidance_api
  An Extension for oobabooga/text-generation-webui
  ☆36Updated last year
• simbake / web_search
  web search extension for text-generation-webui
  ☆94Updated 8 months ago
• 0cc4m / GPTQ-for-LLaMa
  4 bits quantization of LLMs using GPTQ
  ☆47Updated last year
• the-crypt-keeper / the-muse
  Experimental sampler to make LLMs more creative
  ☆30Updated last year
• jllllll / exllama
  A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.
  ☆66Updated last year
• Gryphe / BlockMerge_Gradient
  Merge Transformers language models by use of gradient parameters.
  ☆201Updated 3 months ago
• thomasgauthier / LoRD
  Low-Rank adapter extraction for fine-tuned transformers model
  ☆162Updated 6 months ago
• 0cc4m / KoboldAI
  ☆150Updated last year
• taprosoft / llm_finetuning
  Convenient wrapper for fine-tuning and inference of Large Language Models (LLMs) with several quantization techniques (GTPQ, bitsandbytes…
  ☆145Updated last year
• turboderp / exui
  Web UI for ExLlamaV2
  ☆445Updated last month
• DavG25 / text-generation-webui-code_syntax_highlight
  An extension for oobabooga's text-generation-webui that adds syntax highlighting to code snippets
  ☆64Updated 5 months ago
• mounta11n / plusplus-camall
  After my server ui improvements were successfully merged, consider this repo a playground for experimenting, tinkering and hacking around…
  ☆56Updated 3 months ago
• mamei16 / LLM_Web_search
  An extension for oobabooga/text-generation-webui that enables the LLM to search the web using DuckDuckGo
  ☆173Updated this week
• OpenAccess-AI-Collective / ggml-webui
  Deploy your GGML models to HuggingFace Spaces with Docker and gradio
  ☆35Updated last year
• brucepro / Memoir
  Memoir+ a persona extension for Text Gen Web UI. That includes memory, emotions, command handling and more.
  ☆171Updated last month
• oobabooga / llama-cpp-python-cuBLAS-wheels
  Wheels for llama-cpp-python compiled with cuBLAS support
  ☆18Updated last month
• Trojaner / text-generation-webui-stable_diffusion
  Integrate image generation capabilities to text-generation-webui using Stable Diffusion.
  ☆51Updated 6 months ago
• Keith-Hon / bitsandbytes-windows
  8-bit CUDA functions for PyTorch in Windows 10
  ☆71Updated last year
• TheBlokeAI / AIScripts
  Some simple scripts that I use day-to-day when working with LLMs and Huggingface Hub
  ☆155Updated last year