AlpinDale / gptq-gptj

Related projects ⓘ

Alternatives and complementary repositories for gptq-gptj

• the-crypt-keeper / the-muse
  Experimental sampler to make LLMs more creative
  ☆30Updated last year
• zarakiquemparte / zaraki-tools
  ☆27Updated last year
• NolanoOrg / llama-int4-quant
  ☆26Updated last year
• 1rgs / tokenwiz
  A clone of OpenAI's Tokenizer page for HuggingFace Models
  ☆44Updated last year
• cwhy / rwkv-decon
  Trying to deconstruct RWKV in understandable terms
  ☆14Updated last year
• euclaise / supertrainer2000
  ☆49Updated 8 months ago
• VikParuchuri / classified
  Score LLM pretraining data with classifiers
  ☆54Updated last year
• kaiokendev / cutoff-len-is-context-len
  Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit
  ☆63Updated last year
• NolanoOrg / sparse_quant_llms
  SparseGPT + GPTQ Compression of LLMs like LLaMa, OPT, Pythia
  ☆41Updated last year
• bjj / exllamav2-openai-server
  An OpenAI API compatible LLM inference server based on ExLlamaV2.
  ☆22Updated 9 months ago
• NousResearch / StripedHyenaTrainer
  ☆57Updated 11 months ago
• lucataco / cog-whisperspeech
  Cog wrapper for collabora/WhisperSpeech
  ☆25Updated 8 months ago
• sdan / selfextend
  an implementation of Self-Extend, to expand the context window via grouped attention
  ☆118Updated 10 months ago
• austinsilveria / tricksy
  Fast approximate inference on a single GPU with sparsity aware offloading
  ☆38Updated 10 months ago
• desik1998 / MathWithLLMs
  ☆48Updated 5 months ago
• AlpinDale / sparsegpt-for-LLaMA
  Code for the paper "SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shot" with LLaMA implementation.
  ☆70Updated last year
• clcarwin / alpaca-weight
  Train llama with lora on one 4090 and merge weight of lora to work as stanford alpaca.
  ☆50Updated last year
• Birch-san / llama-play
  Command-line script for inferencing from models such as LLaMA, in a chat scenario, with LoRA adaptations
  ☆33Updated last year
• vikhyat / mixtral-inference
  inference code for mixtral-8x7b-32kseqlen
  ☆98Updated 11 months ago
• cloneofsimo / fim-llama-deepspeed
  ☆31Updated 10 months ago
• lachlansneff / sparsellama
  ☆40Updated last year
• teknium1 / LLM-Logbook
  Public reports detailing responses to sets of prompts by Large Language Models.
  ☆26Updated last year
• official-elinas / zeus-llm-trainer
  Zeus LLM Trainer is a rewrite of Stanford Alpaca aiming to be the trainer for all Large Language Models
  ☆69Updated last year
• jondurbin / qlora
  QLoRA: Efficient Finetuning of Quantized LLMs
  ☆77Updated 7 months ago
• emrgnt-cmplxty / zero-shot-replication
  ☆72Updated last year
• mzbac / qlora-inference-multi-gpu
  ☆12Updated last year
• catid / oaillama3
  Simple setup to self-host LLaMA3-70B model with an OpenAI API
  ☆18Updated 6 months ago
• sanjibnarzary / awesome-llm
  Curated list of open source and openly accessible large language models
  ☆24Updated last year
• ChrisHayduk / qlora-multi-gpu
  QLoRA with Enhanced Multi GPU Support
  ☆36Updated last year