Alternatives and similar repositories for llama-int8

Users that are interested in llama-int8 are comparing it to the libraries listed below

• kir-gadjello / zipslicer
  A library for incremental loading of large PyTorch checkpoints
  ☆56Updated 2 years ago
• bjj / exllamav2-openai-server
  An OpenAI API compatible LLM inference server based on ExLlamaV2.
  ☆25Updated last year
• kaiokendev / cutoff-len-is-context-len
  Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit
  ☆63Updated last year
• ahmed-moubtahij / TokenHealer
  ☆22Updated last year
• cwhy / rwkv-decon
  Trying to deconstruct RWKV in understandable terms
  ☆14Updated 2 years ago
• iantbutler01 / ditty
  A library for simplifying fine tuning with multi gpu setups in the Huggingface ecosystem.
  ☆16Updated 7 months ago
• silphendio / sliced_llama
  Simple LLM inference server
  ☆20Updated 11 months ago
• zarakiquemparte / zaraki-tools
  ☆27Updated last year
• mattneary / colorspace
  assign color hues to a collection of text fragments based on embeddings
  ☆20Updated 11 months ago
• Hellisotherpeople / llm_steer-oobabooga
  Steer LLM outputs towards a certain topic/subject and enhance response capabilities using activation engineering by adding steering vecto…
  ☆43Updated last year
• andrewgcodes / vec2vec
  ☆14Updated last year
• jmward01 / lmplay
  A playground to make it easy to try crazy things
  ☆33Updated last month
• iamlemec / bert.cpp
  GGML implementation of BERT model with Python bindings and quantization.
  ☆55Updated last year
• doctor02 / stable-diffusion-google-colab
  Stable diffusion google colab kernel
  ☆10Updated 2 years ago
• LachlanGray / lmql-tree-of-thoughts
  LMQL implementation of tree of thoughts
  ☆34Updated last year
• mrcolo / longboii
  ☆19Updated 2 years ago
• xaedes / llama.cpp
  Port of Facebook's LLaMA model in C/C++
  ☆21Updated last year
• Netwrck / stable-diffusion-server
  Image Generation API Server - Similar to https://text-generator.io but for images
  ☆50Updated this week
• the-crypt-keeper / the-muse
  Experimental sampler to make LLMs more creative
  ☆31Updated last year
• AlpinDale / LLM-Shearing
  Preprint: Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning
  ☆28Updated last year
• lachlansneff / sparsellama
  ☆40Updated 2 years ago
• the-crypt-keeper / ggml-downloader
  Simple, Fast, Parallel Huggingface GGML model downloader written in python
  ☆24Updated last year
• LAION-AI / watermark-detection
  A repository containing datasets and tools to train a watermark classifier.
  ☆68Updated 2 years ago
• donaldafeith / Pytorch_Merge
  Merge LLM that are split in to parts
  ☆26Updated last year
• ConiferLabsWA / flan-ul2-alpaca
  ☆32Updated 2 years ago
• simonw / laion-aesthetic-datasette
  Use Datasette to explore LAION improved_aesthetics_6plus training data used by Stable DIffusion
  ☆58Updated last year
• Zyphra / zcookbook
  Training hybrid models for dummies.
  ☆21Updated 4 months ago
• slashml / awesome-finetuning
  ☆28Updated 9 months ago
• official-elinas / zeus-llm-trainer
  Zeus LLM Trainer is a rewrite of Stanford Alpaca aiming to be the trainer for all Large Language Models
  ☆69Updated last year
• lucasavila00 / LmScript
  Controllable Language Model Interactions in TypeScript
  ☆9Updated last year