Alternatives and similar repositories for llama-int8:

Users that are interested in llama-int8 are comparing it to the libraries listed below

• kir-gadjello / zipslicer
  A library for incremental loading of large PyTorch checkpoints
  ☆56Updated 2 years ago
• cwhy / rwkv-decon
  Trying to deconstruct RWKV in understandable terms
  ☆14Updated last year
• NolanoOrg / llama-int4-quant
  ☆26Updated last year
• iamlemec / bert.cpp
  GGML implementation of BERT model with Python bindings and quantization.
  ☆54Updated last year
• kaiokendev / cutoff-len-is-context-len
  Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit
  ☆63Updated last year
• jquesnelle / ctranslate2-rs
  Rust bindings for CTranslate2
  ☆14Updated last year
• AlpinDale / LLM-Shearing
  Preprint: Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning
  ☆28Updated last year
• zarakiquemparte / zaraki-tools
  ☆27Updated last year
• Narsil / bloomserver
  ☆37Updated 2 years ago
• jmward01 / lmplay
  A playground to make it easy to try crazy things
  ☆33Updated this week
• the-crypt-keeper / the-muse
  Experimental sampler to make LLMs more creative
  ☆30Updated last year
• silphendio / sliced_llama
  Simple LLM inference server
  ☆20Updated 8 months ago
• lachlansneff / sparsellama
  ☆40Updated last year
• ahmed-moubtahij / TokenHealer
  ☆22Updated 9 months ago
• bjj / exllamav2-openai-server
  An OpenAI API compatible LLM inference server based on ExLlamaV2.
  ☆25Updated last year
• Netwrck / stable-diffusion-server
  Image Generation API Server - Similar to https://text-generator.io but for images
  ☆50Updated 3 months ago
• ryao / llama3.c
  A fork of llama3.c used to do some R&D on inferencing
  ☆19Updated 2 months ago
• Zyphra / zcookbook
  Training hybrid models for dummies.
  ☆20Updated last month
• Birch-san / falcon-play
  Command-line script for inferencing from models such as falcon-7b-instruct
  ☆76Updated last year
• donaldafeith / Pytorch_Merge
  Merge LLM that are split in to parts
  ☆26Updated last year
• iantbutler01 / ditty
  A library for simplifying fine tuning with multi gpu setups in the Huggingface ecosystem.
  ☆16Updated 4 months ago
• ConiferLabsWA / flan-ul2-alpaca
  ☆32Updated last year
• catid / lllm
  Latent Large Language Models
  ☆17Updated 6 months ago
• AeroScripts / HiddenEngrams
  Hidden Engrams: Long Term Memory for Transformer Model Inference
  ☆35Updated 3 years ago
• finetunej / transformers
  🤗Transformers: State-of-the-art Natural Language Processing for Pytorch and TensorFlow 2.0.
  ☆56Updated 3 years ago
• EleutherAI / tokengrams
  Efficiently computing & storing token n-grams from large corpora
  ☆18Updated 4 months ago
• skeskinen / llama-lite
  Embeddings focused small version of Llama NLP model
  ☆103Updated last year
• Birch-san / llama-play
  Command-line script for inferencing from models such as LLaMA, in a chat scenario, with LoRA adaptations
  ☆33Updated last year
• nostalgebraist / improved-diffusion
  Text-writing denoising diffusion (and much more)
  ☆30Updated last year
• karim-aloulou / Espitchatbot-RASA-RAVEN
  Chatbot that answers frequently asked questions in French, English, and Tunisian using the Rasa NLU framework and RWKV-4-Raven
  ☆13Updated last year