Alternatives and similar repositories for Quantized-LLMs

Users that are interested in Quantized-LLMs are comparing it to the libraries listed below

• joey00072 / ohara
  Collection of autoregressive model implementation
  ☆86Updated 4 months ago
• ariG23498 / quantized-diffusion-inference
  Notebook and Scripts that showcase running quantized diffusion models on consumer GPUs
  ☆38Updated 10 months ago
• sayakpaul / keras-xla-benchmarks
  Presents comprehensive benchmarks of XLA-compatible pre-trained models in Keras.
  ☆37Updated 2 years ago
• fangyuan-ksgk / Mini-LLaVA
  A minimal implementation of LLaVA-style VLM with interleaved image & text & video processing ability.
  ☆96Updated 8 months ago
• Upaya07 / NeurIPS-llm-efficiency-challenge
  Code for NeurIPS LLM Efficiency Challenge
  ☆59Updated last year
• devvrit / matformer
  MatFormer repo
  ☆62Updated 9 months ago
• ariG23498 / fine-tune-paligemma
  Notebooks for fine tuning pali gemma
  ☆116Updated 4 months ago
• rasbt / pytorch-memory-optim
  This code repository contains the code used for my "Optimizing Memory Usage for Training LLMs and Vision Transformers in PyTorch" blog po…
  ☆92Updated 2 years ago
• ariG23498 / mmdp
  ☆27Updated 2 months ago
• rasbt / RAGs
  RAGs: Simple implementations of Retrieval Augmented Generation (RAG) Systems
  ☆125Updated 7 months ago
• SeunghyunSEO / optimized_hf_llama_class_for_training
  ☆48Updated last year
• lessw2020 / transformer_central
  Various transformers for FSDP research
  ☆38Updated 2 years ago
• ariG23498 / timm-wrapper-examples
  Notebooks to demonstrate TimmWrapper
  ☆16Updated 7 months ago
• hkproj / multi-latent-attention
  ☆44Updated 3 months ago
• nyunAI / Faster-LLM-Survey
  ☆42Updated last year
• apple / ml-mofi
  ☆59Updated last year
• huggingface / kernel-builder
  👷 Build compute kernels
  ☆132Updated this week
• ariG23498 / gemma3-object-detection
  Fine tune Gemma 3 on an object detection task
  ☆79Updated last month
• facebookresearch / MultiModalExplorer
  Visualize multi-model embedding spaces. The first goal is to quickly get a lay of the land of any embedding space. Then be able to scroll…
  ☆27Updated last year
• NielsRogge / awesome-huggingface
  Repository containing awesome resources regarding Hugging Face tooling.
  ☆48Updated last year
• apple / ml-hypercloning
  ☆50Updated 10 months ago
• huggingface / competitions
  ☆124Updated 10 months ago
• fangyuan-ksgk / Tiny-GRPO
  minimal GRPO implementation from scratch
  ☆96Updated 5 months ago
• sayakpaul / deploy-hf-tf-vision-models
  This repository shows various ways of deploying a vision model (TensorFlow) from 🤗 Transformers.
  ☆30Updated 3 years ago
• huggingface / chug
  Minimal sharded dataset loaders, decoders, and utils for multi-modal document, image, and text datasets.
  ☆158Updated last year
• lucidrains / mixture-of-attention
  Some personal experiments around routing tokens to different autoregressive attention, akin to mixture-of-experts
  ☆120Updated 10 months ago
• MaxBelitsky / cache-steering
  KV Cache Steering for Inducing Reasoning in Small Language Models
  ☆39Updated last month
• facebookresearch / llm-speedrunner
  The Automated LLM Speedrunning Benchmark measures how well LLM agents can reproduce previous innovations and discover new ones in languag…
  ☆96Updated last month
• kjslag / spacebyte
  A byte-level decoder architecture that matches the performance of tokenized Transformers.
  ☆65Updated last year
• amirzandieh / HyperAttention
  Triton Implementation of HyperAttention Algorithm
  ☆48Updated last year