Alternatives and similar repositories for gptq-gptj

Users that are interested in gptq-gptj are comparing it to the libraries listed below

• bjj / exllamav2-openai-server
  An OpenAI API compatible LLM inference server based on ExLlamaV2.
  ☆25Updated last year
• teknium1 / LLM-Logbook
  Public reports detailing responses to sets of prompts by Large Language Models.
  ☆30Updated 5 months ago
• mayank31398 / GPTQ-for-SantaCoder
  4 bits quantization of SantaCoder using GPTQ
  ☆51Updated 2 years ago
• Birch-san / llama-play
  Command-line script for inferencing from models such as LLaMA, in a chat scenario, with LoRA adaptations
  ☆33Updated 2 years ago
• 1rgs / tokenwiz
  A clone of OpenAI's Tokenizer page for HuggingFace Models
  ☆45Updated last year
• emrgnt-cmplxty / zero-shot-replication
  ☆73Updated last year
• the-crypt-keeper / ggml-downloader
  Simple, Fast, Parallel Huggingface GGML model downloader written in python
  ☆24Updated last year
• finetunej / transformers
  🤗Transformers: State-of-the-art Natural Language Processing for Pytorch and TensorFlow 2.0.
  ☆56Updated 3 years ago
• donaldafeith / Pytorch_Merge
  Merge LLM that are split in to parts
  ☆26Updated last year
• NolanoOrg / sparse_quant_llms
  SparseGPT + GPTQ Compression of LLMs like LLaMa, OPT, Pythia
  ☆41Updated 2 years ago
• Contextualist / lone-arena
  Self-hosted LLM chatbot arena, with yourself as the only judge
  ☆41Updated last year
• official-elinas / zeus-llm-trainer
  Zeus LLM Trainer is a rewrite of Stanford Alpaca aiming to be the trainer for all Large Language Models
  ☆69Updated last year
• lachlansneff / sparsellama
  ☆40Updated 2 years ago
• CarperAI / squeakily
  A library for squeakily cleaning and filtering language datasets.
  ☆47Updated last year
• cwhy / rwkv-decon
  Trying to deconstruct RWKV in understandable terms
  ☆14Updated 2 years ago
• deep-diver / gradio-chat
  HuggingChat like UI in Gradio
  ☆71Updated 2 years ago
• the-crypt-keeper / the-muse
  Experimental sampler to make LLMs more creative
  ☆31Updated last year
• Birch-san / booru-embed
  [WIP] Transformer to embed Danbooru labelsets
  ☆13Updated last year
• CarperAI / decontamination
  This repository contains code for cleaning your training data of benchmark data to help combat data snooping.
  ☆25Updated 2 years ago
• mzbac / qlora-inference-multi-gpu
  ☆12Updated 2 years ago
• iwalton3 / mpt-lora-patch
  Patch for MPT-7B which allows using and training a LoRA
  ☆58Updated 2 years ago
• AUTOMATIC1111 / llm-political-compass
  Web page with political compass quiz results for open LLMs
  ☆37Updated last year
• cloneofsimo / fim-llama-deepspeed
  ☆31Updated last year
• AXKuhta / rwkv-onnx-dml
  Run ONNX RWKV-v4 models with GPU acceleration using DirectML [Windows], or just on CPU [Windows AND Linux]; Limited to 430M model at this…
  ☆21Updated 2 years ago
• 3outeille / GPTQ-for-RWKV
  ☆13Updated 2 years ago
• zarakiquemparte / zaraki-tools
  ☆27Updated last year
• KohakuBlueleaf / guanaco-lora
  Instruct-tune LLaMA on consumer hardware
  ☆74Updated 2 years ago
• cg123 / rathe
  Tools for formatting large language model prompts.
  ☆13Updated last year
• nateraw / replicate-examples
  ☆74Updated last year
• argilla-io / distilabel-spin-dibt
  Repository containing the SPIN experiments on the DIBT 10k ranked prompts
  ☆24Updated last year