Alternatives and similar repositories for llama-int4-quant:

Users that are interested in llama-int4-quant are comparing it to the libraries listed below

• kaiokendev / cutoff-len-is-context-len
  Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit
  ☆63Updated last year
• Narsil / bloomserver
  ☆37Updated 2 years ago
• Birch-san / mpt-play
  Command-line script for inferencing from models such as MPT-7B-Chat
  ☆101Updated last year
• zarakiquemparte / zaraki-tools
  ☆27Updated last year
• sekstini / basedxl
  ☆16Updated 11 months ago
• donaldafeith / Pytorch_Merge
  Merge LLM that are split in to parts
  ☆26Updated last year
• teknium1 / stanford_alpaca-replit
  Modified Stanford-Alpaca Trainer for Training Replit's Code Model
  ☆40Updated last year
• jquesnelle / ctranslate2-rs
  Rust bindings for CTranslate2
  ☆14Updated last year
• NolanoOrg / InstructLLaMa.cpp
  Fast inference of Instruct tuned LLaMa on your personal devices.
  ☆22Updated last year
• ConiferLabsWA / flan-ul2-alpaca
  ☆32Updated last year
• official-elinas / zeus-llm-trainer
  Zeus LLM Trainer is a rewrite of Stanford Alpaca aiming to be the trainer for all Large Language Models
  ☆69Updated last year
• vikhyat / mixtral-inference
  inference code for mixtral-8x7b-32kseqlen
  ☆99Updated last year
• camenduru / nvidia-llm-colab
  ☆14Updated last year
• CarperAI / squeakily
  A library for squeakily cleaning and filtering language datasets.
  ☆46Updated last year
• iamlemec / bert.cpp
  GGML implementation of BERT model with Python bindings and quantization.
  ☆54Updated last year
• iantbutler01 / ditty
  A library for simplifying fine tuning with multi gpu setups in the Huggingface ecosystem.
  ☆16Updated 4 months ago
• cwhy / rwkv-decon
  Trying to deconstruct RWKV in understandable terms
  ☆14Updated last year
• qnguyen3 / hermes-llava
  ☆54Updated last year
• Birch-san / booru-embed
  [WIP] Transformer to embed Danbooru labelsets
  ☆13Updated 11 months ago
• ElleLeonne / Lightning-ReLoRA
  A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.
  ☆33Updated last year
• Alignment-Lab-AI / datagen
  a pipeline for using api calls to agnostically convert unstructured data into structured training data
  ☆29Updated 5 months ago
• kyegomez / Kosmos-X
  The Next Generation Multi-Modality Superintelligence
  ☆71Updated 6 months ago
• catid / lllm
  Latent Large Language Models
  ☆17Updated 6 months ago
• aspctu / alpaca-lora
  Instruct-tuning LLaMA on consumer hardware
  ☆66Updated last year
• euclaise / supertrainer2000
  ☆49Updated 11 months ago
• rmihaylov / mpttune
  Tune MPTs
  ☆84Updated last year
• geov-ai / geov
  The GeoV model is a large langauge model designed by Georges Harik and uses Rotary Positional Embeddings with Relative distances (RoPER).…
  ☆121Updated last year
• austinsilveria / tricksy
  Fast approximate inference on a single GPU with sparsity aware offloading
  ☆38Updated last year
• CarperAI / decontamination
  This repository contains code for cleaning your training data of benchmark data to help combat data snooping.
  ☆25Updated last year
• codekansas / rwkv
  RWKV model implementation
  ☆37Updated last year