Alternatives and similar repositories for llama-int8

Users that are interested in llama-int8 are comparing it to the libraries listed below

• kir-gadjello / zipslicer
  A library for incremental loading of large PyTorch checkpoints
  ☆56Updated 2 years ago
• AlpinDale / LLM-Shearing
  Preprint: Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning
  ☆28Updated last year
• cwhy / rwkv-decon
  Trying to deconstruct RWKV in understandable terms
  ☆14Updated 2 years ago
• shawwn / scrap
  Nearly a thousand bash and python scripts I've written over the years.
  ☆124Updated 7 months ago
• bjj / exllamav2-openai-server
  An OpenAI API compatible LLM inference server based on ExLlamaV2.
  ☆25Updated last year
• lachlansneff / sparsellama
  ☆40Updated 2 years ago
• ahmed-moubtahij / TokenHealer
  ☆23Updated last year
• Birch-san / falcon-play
  Command-line script for inferencing from models such as falcon-7b-instruct
  ☆75Updated 2 years ago
• jllllll / exllama
  A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.
  ☆64Updated last year
• skeskinen / llama-lite
  Embeddings focused small version of Llama NLP model
  ☆104Updated 2 years ago
• zarakiquemparte / zaraki-tools
  ☆27Updated 2 years ago
• Hellisotherpeople / llm_steer-oobabooga
  Steer LLM outputs towards a certain topic/subject and enhance response capabilities using activation engineering by adding steering vecto…
  ☆43Updated last year
• finetunej / transformers
  🤗Transformers: State-of-the-art Natural Language Processing for Pytorch and TensorFlow 2.0.
  ☆56Updated 3 years ago
• kaiokendev / cutoff-len-is-context-len
  Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit
  ☆63Updated 2 years ago
• Birch-san / mpt-play
  Command-line script for inferencing from models such as MPT-7B-Chat
  ☆100Updated 2 years ago
• closedai-project / closedai
  Drop in replacement for OpenAI, but with Open models.
  ☆152Updated 2 years ago
• remyxai / LocalMentor
  Local Startup Advisor Chatbot
  ☆31Updated last year
• NolanoOrg / llama-int4-quant
  ☆26Updated 2 years ago
• doctor02 / stable-diffusion-google-colab
  Stable diffusion google colab kernel
  ☆10Updated 3 years ago
• harrisonvanderbyl / rwkvstic
  Framework agnostic python runtime for RWKV models
  ☆146Updated 2 years ago
• thisisanshgupta / Senna
  Senna is an advanced AI-powered search engine designed to provide users with immediate answers to their queries by leveraging natural lan…
  ☆19Updated 11 months ago
• euclaise / supertrainer2000
  ☆49Updated last year
• eugenepentland / landmark-attention-qlora
  Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA
  ☆124Updated 2 years ago
• karim-aloulou / Espitchatbot-RASA-RAVEN
  Chatbot that answers frequently asked questions in French, English, and Tunisian using the Rasa NLU framework and RWKV-4-Raven
  ☆13Updated 2 years ago
• s4rduk4r / alpaca_lora_4bit_readme
  Just a simple HowTo for https://github.com/johnsmith0031/alpaca_lora_4bit
  ☆32Updated 2 years ago
• the-crypt-keeper / the-muse
  Experimental sampler to make LLMs more creative
  ☆31Updated 2 years ago
• aigoopy / llm-jeopardy
  Automated prompting and scoring framework to evaluate LLMs using updated human knowledge prompts
  ☆110Updated 2 years ago
• kayvr / token-hawk
  WebGPU LLM inference tuned by hand
  ☆151Updated 2 years ago
• shawwn / llama
  Inference code for LLaMA models
  ☆189Updated 2 years ago
• euclaise / SlimTrainer
  Full finetuning of large language models without large memory requirements
  ☆94Updated last year