Alternatives and similar repositories for gptq-gptj:

Users that are interested in gptq-gptj are comparing it to the libraries listed below

• ChrisHayduk / qlora-multi-gpu
  QLoRA with Enhanced Multi GPU Support
  ☆36Updated last year
• zarakiquemparte / zaraki-tools
  ☆27Updated last year
• teknium1 / LLM-Logbook
  Public reports detailing responses to sets of prompts by Large Language Models.
  ☆30Updated 2 months ago
• mayank31398 / GPTQ-for-SantaCoder
  4 bits quantization of SantaCoder using GPTQ
  ☆51Updated last year
• the-crypt-keeper / the-muse
  Experimental sampler to make LLMs more creative
  ☆30Updated last year
• bjj / exllamav2-openai-server
  An OpenAI API compatible LLM inference server based on ExLlamaV2.
  ☆25Updated last year
• emrgnt-cmplxty / zero-shot-replication
  ☆73Updated last year
• Birch-san / booru-embed
  [WIP] Transformer to embed Danbooru labelsets
  ☆13Updated 11 months ago
• lucyknada / detective-needle-llm
  ☆12Updated 6 months ago
• lachlansneff / sparsellama
  ☆40Updated 2 years ago
• zphang / transformers
  Code and models for BERT on STILTs
  ☆53Updated 2 years ago
• VikParuchuri / classified
  Score LLM pretraining data with classifiers
  ☆54Updated last year
• NolanoOrg / sparse_quant_llms
  SparseGPT + GPTQ Compression of LLMs like LLaMa, OPT, Pythia
  ☆41Updated 2 years ago
• arthurwolf / llmi
  Large-Language-Model to Machine Interface project.
  ☆18Updated last year
• euclaise / supertrainer2000
  ☆49Updated last year
• waefrebeorn / KAN-WuBu-Memory
  An AI character interaction system with emotional modeling and advanced memory management
  ☆15Updated 5 months ago
• FreedomIntelligence / GPT-API-Accelerate
  The "GPT-API-Accelerate" project provides a set of Python classes for accelerating the process of generating responses to prompts using t…
  ☆23Updated 5 months ago
• elgatopanzon / gatogpt
  Local LLM inference & management server with built-in OpenAI API
  ☆31Updated 11 months ago
• sdan / selfextend
  an implementation of Self-Extend, to expand the context window via grouped attention
  ☆118Updated last year
• official-elinas / zeus-llm-trainer
  Zeus LLM Trainer is a rewrite of Stanford Alpaca aiming to be the trainer for all Large Language Models
  ☆69Updated last year
• sfcompute / tinynarrations
  A synthetic story narration dataset to study small audio LMs.
  ☆32Updated last year
• LLM360 / crystalcoder-data-prep
  Data preparation code for CrystalCoder 7B LLM
  ☆44Updated 10 months ago
• kaiokendev / cutoff-len-is-context-len
  Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit
  ☆63Updated last year
• CarperAI / treasure_trove
  ☆22Updated last year
• cwhy / rwkv-decon
  Trying to deconstruct RWKV in understandable terms
  ☆14Updated last year
• cg123 / rathe
  Tools for formatting large language model prompts.
  ☆12Updated last year
• nyunAI / PruneGPT
  ☆53Updated 9 months ago
• cloneofsimo / auto_llm_codebase_analysis
  ☆26Updated last year
• AlpinDale / QuIP-for-Llama
  Code for paper: "QuIP: 2-Bit Quantization of Large Language Models With Guarantees" adapted for Llama models
  ☆36Updated last year
• austinsilveria / tricksy
  Fast approximate inference on a single GPU with sparsity aware offloading
  ☆38Updated last year