Alternatives and similar repositories for GPTQ-for-LLaMa-API:

Users that are interested in GPTQ-for-LLaMa-API are comparing it to the libraries listed below

• ChuloAI / BrainChulo
  Harnessing the Memory Power of the Camelids
  ☆146Updated last year
• sebaxzero / LangChain_PDFChat_Oobabooga
  oobaboga -text-generation-webui implementation of wafflecomposite - langchain-ask-pdf-local
  ☆70Updated last year
• ChobPT / oobaboogas-webui-langchain_agent
  Creates an Langchain Agent which uses the WebUI's API and Wikipedia to work
  ☆74Updated last year
• mzbac / AutoGPTQ-API
  Host the GPTQ model using AutoGPTQ as an API that is compatible with text generation UI API.
  ☆91Updated last year
• VatsaDev / NanoPhi-alpha
  GPT-2 small trained on phi-like data
  ☆66Updated last year
• Dhaladom / TALIS
  Simple and fast server for GPTQ-quantized LLaMA inference
  ☆24Updated last year
• DataBassGit / BabyBoogaAGI
  Porting BabyAGI to Oobabooba.
  ☆33Updated last year
• Ordinath / tool_juggler
  ☆41Updated last year
• flurb18 / AgentOoba
  An autonomous AI agent extension for Oobabooga's web ui
  ☆175Updated last year
• OoriData / OgbujiPT
  Client-side toolkit for using large language models, including where self-hosted
  ☆107Updated 4 months ago
• gkamradt / FineTuningClone
  ☆37Updated last year
• ChuloAI / oasis
  Local LLaMAs/Models in VSCode
  ☆53Updated last year
• venuv / LangSynth
  Conduct consumer interviews with synthetic focus groups using LLMs and LangChain
  ☆43Updated last year
• nicholasyager / llama-cpp-guidance
  A guidance compatibility layer for llama-cpp-python
  ☆34Updated last year
• alexanderatallah / openrouter-streamlit
  Example of calling OpenRouter from a Streamit app
  ☆94Updated last year
• eugenepentland / landmark-attention-qlora
  Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA
  ☆123Updated last year
• QuangBK / localLLM_guidance
  Local LLM ReAct Agent with Guidance
  ☆158Updated last year
• PromptEngineer48 / LLM_Selector
  This code implements a Local LLM Selector from the list of Local Installed Ollama LLMs for your specific user Query
  ☆102Updated last year
• Seraphaious / SMS-AI
  A Personalised AI Assistant Inspired by 'Diamond Age, Powered by SMS
  ☆92Updated last year
• mayank31398 / GPTQ-for-SantaCoder
  4 bits quantization of SantaCoder using GPTQ
  ☆51Updated last year
• thooton / muse
  Let's create synthetic textbooks together :)
  ☆74Updated last year
• Div99 / InternetOfAgents
  Build your Swarm of Internet Agents using MultiOn 🚀
  ☆78Updated last year
• OpenAccess-AI-Collective / ggml-webui
  Deploy your GGML models to HuggingFace Spaces with Docker and gradio
  ☆36Updated last year
• RichardAragon / MultiAgentLLM
  ☆53Updated last year
• nikvdp / agentgrunt
  ☆63Updated 4 months ago
• taprosoft / llm_finetuning
  Convenient wrapper for fine-tuning and inference of Large Language Models (LLMs) with several quantization techniques (GTPQ, bitsandbytes…
  ☆147Updated last year
• Aemon-Algiz / qlora
  QLoRA: Efficient Finetuning of Quantized LLMs
  ☆11Updated last year
• iwalton3 / mpt-lora-patch
  Patch for MPT-7B which allows using and training a LoRA
  ☆58Updated last year
• OpenAgentLLM / OpenAgent
  🔓 The open-source autonomous agent LLM initiative 🔓
  ☆91Updated last year
• Itachi-Uchiha581 / Auto-Data
  Auto Data is a library designed for quick and effortless creation of datasets tailored for fine-tuning Large Language Models (LLMs).
  ☆99Updated 5 months ago