Alternatives and similar repositories for llama-int8

Users that are interested in llama-int8 are comparing it to the libraries listed below

• shawwn / scrap
  Nearly a thousand bash and python scripts I've written over the years.
  ☆123Updated 8 months ago
• kir-gadjello / zipslicer
  A library for incremental loading of large PyTorch checkpoints
  ☆56Updated 2 years ago
• simonw / laion-aesthetic-datasette
  Use Datasette to explore LAION improved_aesthetics_6plus training data used by Stable DIffusion
  ☆57Updated last year
• doctor02 / stable-diffusion-google-colab
  Stable diffusion google colab kernel
  ☆10Updated 3 years ago
• cwhy / rwkv-decon
  Trying to deconstruct RWKV in understandable terms
  ☆14Updated 2 years ago
• zarakiquemparte / zaraki-tools
  ☆26Updated 2 years ago
• finetunej / transformers
  🤗Transformers: State-of-the-art Natural Language Processing for Pytorch and TensorFlow 2.0.
  ☆55Updated 3 years ago
• silphendio / sliced_llama
  Simple LLM inference server
  ☆20Updated last year
• geov-ai / geov
  The GeoV model is a large langauge model designed by Georges Harik and uses Rotary Positional Embeddings with Relative distances (RoPER).…
  ☆121Updated 2 years ago
• lachlansneff / sparsellama
  ☆40Updated 2 years ago
• Hellisotherpeople / llm_steer-oobabooga
  Steer LLM outputs towards a certain topic/subject and enhance response capabilities using activation engineering by adding steering vecto…
  ☆42Updated last year
• bjj / exllamav2-openai-server
  An OpenAI API compatible LLM inference server based on ExLlamaV2.
  ☆25Updated last year
• eugenepentland / landmark-attention-qlora
  Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA
  ☆123Updated 2 years ago
• AlpinDale / LLM-Shearing
  Preprint: Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning
  ☆28Updated last year
• jllllll / exllama
  A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.
  ☆63Updated 2 years ago
• NolanoOrg / smol-gpt
  Smol but mighty language model
  ☆62Updated 2 years ago
• kafischer / AIMindFlow
  The first AI artist
  ☆32Updated 2 years ago
• CharlesMod / quantizeHFmodel
  Accepts a Hugging Face model URL, automatically downloads and quantizes it using Bits and Bytes.
  ☆38Updated last year
• Sharrnah / dreambooth-docker
  This is a Docker Setup for Dreambooth to train personalized stable diffusion models.
  ☆16Updated 3 years ago
• Birch-san / falcon-play
  Command-line script for inferencing from models such as falcon-7b-instruct
  ☆74Updated 2 years ago
• AndrewMead10 / Stable-Diffusion-Image-Manager
  A utility that downloads your Stable Diffusion images from discord and lets you preview them with Streamlit
  ☆15Updated 3 years ago
• mrcolo / longboii
  ☆19Updated 2 years ago
• aicrumb / doohickey
  Doohickey is a stable diffusion tool for technical artists who want to stay up-to-date with the latest developments in the field.
  ☆39Updated 2 years ago
• skeskinen / llama-lite
  Embeddings focused small version of Llama NLP model
  ☆105Updated 2 years ago
• yk / litter
  ☆70Updated last year
• abetlen / program-constrained-language-model-sampling
  ☆35Updated 2 years ago
• LAION-AI / opendream
  Frontend (and soon also midleware and backend) for a new, opensource image generation platform.
  ☆13Updated 2 years ago
• krea-ai / prompt-search
  ☆50Updated 3 years ago
• Birch-san / stable-diffusion
  ☆91Updated 2 years ago
• LeonEricsson / llmcontext
  Pressure testing the context window of open LLMs
  ☆25Updated last year