Alternatives and similar repositories for AutoGPTQ-API:

Users that are interested in AutoGPTQ-API are comparing it to the libraries listed below

• mzbac / wizardCoder-vsc
  Visual Studio Code extension for WizardCoder
  ☆149Updated last year
• aigoopy / llm-jeopardy
  Automated prompting and scoring framework to evaluate LLMs using updated human knowledge prompts
  ☆112Updated last year
• ausboss / Local-LLM-Langchain
  Load local LLMs effortlessly in a Jupyter notebook for testing purposes alongside Langchain or other agents. Contains Oobagooga and Kobol…
  ☆213Updated last year
• marella / gpt4all-j
  Python bindings for the C++ port of GPT4All-J model.
  ☆38Updated last year
• OpenAccess-AI-Collective / ggml-webui
  Deploy your GGML models to HuggingFace Spaces with Docker and gradio
  ☆36Updated last year
• MxDkl / AutoWiki
  An auto generated wiki.
  ☆21Updated last year
• itsPreto / baby-code
  100% Private & Simple. OSS 🐍 Code Interpreter for LLMs 🦙
  ☆35Updated last year
• OpenAccess-AI-Collective / servereless-runpod-ggml
  ☆54Updated last year
• nuance1979 / llama-server
  LLaMA Server combines the power of LLaMA C++ with the beauty of Chatbot UI.
  ☆122Updated last year
• Maximilian-Winter / llama_cpp_function_calling
  ☆31Updated last year
• ChobPT / oobaboogas-webui-langchain_agent
  Creates an Langchain Agent which uses the WebUI's API and Wikipedia to work
  ☆74Updated last year
• DataBassGit / BabyBoogaAGI
  Porting BabyAGI to Oobabooba.
  ☆33Updated last year
• SLAM-group / newhope
  ☆22Updated last year
• nvms / wingman
  Your pair programming wingman. Supports OpenAI, Anthropic, or any LLM on your local inference server.
  ☆70Updated 10 months ago
• eugenepentland / landmark-attention-qlora
  Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA
  ☆123Updated last year
• Seraphaious / SMS-AI
  A Personalised AI Assistant Inspired by 'Diamond Age, Powered by SMS
  ☆92Updated last year
• TheBloke / AutoGPTQ
  An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.
  ☆37Updated last year
• emrgnt-cmplxty / zero-shot-replication
  ☆73Updated last year
• mayank31398 / GPTQ-for-SantaCoder
  4 bits quantization of SantaCoder using GPTQ
  ☆51Updated last year
• teleprint-me / py.gpt.prompt
  PyGPTPrompt: A CLI tool that manages context windows for AI models, facilitating user interaction and data ingestion for optimized long-t…
  ☆29Updated 11 months ago
• flurb18 / AgentOoba
  An autonomous AI agent extension for Oobabooga's web ui
  ☆175Updated last year
• ChuloAI / BrainChulo
  Harnessing the Memory Power of the Camelids
  ☆146Updated last year
• the-crypt-keeper / tiny_starcoder
  Python examples using the bigcode/tiny_starcoder_py 159M model to generate code
  ☆44Updated last year
• teknium1 / character-cards
  A collection of character cards for use in AI Roleplaying
  ☆84Updated 2 years ago
• Dhaladom / TALIS
  Simple and fast server for GPTQ-quantized LLaMA inference
  ☆24Updated last year
• c0sogi / llama-api
  An OpenAI-like LLaMA inference API
  ☆112Updated last year
• flurb18 / babyagi4all-api
  BabyAGI to run with locally hosted models using the API from https://github.com/oobabooga/text-generation-webui
  ☆88Updated 2 years ago
• adamcohenhillel / LLMitlessAPI
  ☆86Updated 2 years ago
• Lisoveliy / StarCoderEx
  Extension for using alternative GitHub Copilot (StarCoder API) in VSCode
  ☆100Updated last year
• Fus3n / TwoAI
  A simple experiment on letting two local LLM have a conversation about anything!
  ☆109Updated 10 months ago