Alternatives and similar repositories for Quantized-LLMs

Users that are interested in Quantized-LLMs are comparing it to the libraries listed below

• joey00072 / ohara
  Collection of autoregressive model implementation
  ☆86Updated 6 months ago
• nyunAI / Faster-LLM-Survey
  ☆42Updated last year
• fangyuan-ksgk / Mini-LLaVA
  A minimal implementation of LLaVA-style VLM with interleaved image & text & video processing ability.
  ☆96Updated 10 months ago
• huggingface / competitions
  ☆124Updated 11 months ago
• sayakpaul / keras-xla-benchmarks
  Presents comprehensive benchmarks of XLA-compatible pre-trained models in Keras.
  ☆37Updated 2 years ago
• ariG23498 / fine-tune-paligemma
  Notebooks for fine tuning pali gemma
  ☆117Updated 6 months ago
• sayakpaul / deploy-hf-tf-vision-models
  This repository shows various ways of deploying a vision model (TensorFlow) from 🤗 Transformers.
  ☆30Updated 3 years ago
• ariG23498 / quantized-diffusion-inference
  Notebook and Scripts that showcase running quantized diffusion models on consumer GPUs
  ☆38Updated 11 months ago
• hkproj / multi-latent-attention
  ☆45Updated 5 months ago
• SeunghyunSEO / optimized_hf_llama_class_for_training
  ☆48Updated last year
• NielsRogge / awesome-huggingface
  Repository containing awesome resources regarding Hugging Face tooling.
  ☆48Updated last year
• Upaya07 / NeurIPS-llm-efficiency-challenge
  Code for NeurIPS LLM Efficiency Challenge
  ☆59Updated last year
• ThinamXx / Meta-llama
  Complete implementation of Llama2 with/without KV cache & inference 🚀
  ☆48Updated last year
• devvrit / matformer
  MatFormer repo
  ☆64Updated 10 months ago
• google-deepmind / asyncdiloco
  ☆46Updated last year
• samchaineau / llm_slerp_generation
  Repo hosting codes and materials related to speeding LLMs' inference using token merging.
  ☆36Updated 2 weeks ago
• ariG23498 / mmdp
  ☆29Updated 3 months ago
• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆50Updated last year
• apple / ml-mofi
  ☆59Updated last year
• rasbt / pytorch-memory-optim
  This code repository contains the code used for my "Optimizing Memory Usage for Training LLMs and Vision Transformers in PyTorch" blog po…
  ☆92Updated 2 years ago
• apple / ml-hypercloning
  ☆52Updated 11 months ago
• huggingface / optimum-tpu
  Google TPU optimizations for transformers models
  ☆120Updated 9 months ago
• pacman100 / peft-codegen-25
  ☆23Updated 2 years ago
• stas00 / ml-ways
  ML/DL Math and Method notes
  ☆64Updated last year
• ariG23498 / timm-wrapper-examples
  Notebooks to demonstrate TimmWrapper
  ☆16Updated 9 months ago
• cray-lm / cray-lm
  Cray-LM unified training and inference stack.
  ☆22Updated 8 months ago
• adithya-s-k / YoloGemma
  Testing and evaluating the capabilities of Vision-Language models (PaliGemma) in performing computer vision tasks such as object detectio…
  ☆84Updated last year
• UmerHA / quanting-notes
  I learn about and explain quantization
  ☆26Updated last year
• facebookresearch / MultiModalExplorer
  Visualize multi-model embedding spaces. The first goal is to quickly get a lay of the land of any embedding space. Then be able to scroll…
  ☆28Updated last year
• yixiaoer / tpu-training-example
  ☆15Updated last year