Alternatives and similar repositories for Quantized-LLMs

Users that are interested in Quantized-LLMs are comparing it to the libraries listed below

• joey00072 / ohara
  Collection of autoregressive model implementation
  ☆85Updated 2 months ago
• sayakpaul / keras-xla-benchmarks
  Presents comprehensive benchmarks of XLA-compatible pre-trained models in Keras.
  ☆37Updated last year
• ariG23498 / quantized-diffusion-inference
  Notebook and Scripts that showcase running quantized diffusion models on consumer GPUs
  ☆38Updated 8 months ago
• sayakpaul / deploy-hf-tf-vision-models
  This repository shows various ways of deploying a vision model (TensorFlow) from 🤗 Transformers.
  ☆30Updated 2 years ago
• ashishpatel26 / ai-tutor-rag-system
  This is a repository for the course "From Beginner to LLM Developer" by Towards AI.
  ☆11Updated 5 months ago
• LukeWood / reef-net
  ☆24Updated 2 years ago
• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆49Updated 11 months ago
• ThinamXx / Meta-llama
  Complete implementation of Llama2 with/without KV cache & inference 🚀
  ☆47Updated last year
• huggingface / pixparse
  Pixel Parsing. A reproduction of OCR-free end-to-end document understanding models with open data
  ☆21Updated 10 months ago
• hkproj / multi-latent-attention
  ☆39Updated last month
• fangyuan-ksgk / Mini-LLaVA
  A minimal implementation of LLaVA-style VLM with interleaved image & text & video processing ability.
  ☆93Updated 6 months ago
• apple / ml-mofi
  ☆58Updated last year
• aniketmaurya / Agents
  Build Agentic workflows with function calling using open LLMs
  ☆28Updated 3 weeks ago
• ElleLeonne / Lightning-ReLoRA
  A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.
  ☆33Updated last year
• FrancescoSaverioZuppichini / Loading-huge-PyTorch-models-with-linear-memory-consumption
  Little article showing how to load pytorch's models with linear memory consumption
  ☆34Updated 2 years ago
• abheesht17 / whisper-keras
  ☆16Updated 2 years ago
• ThinamXx / build-GPT
  Building GPT ...
  ☆18Updated 6 months ago
• sayakpaul / you-dont-know-tensorflow
  Contains materials for my talk "You don't know TensorFlow".
  ☆9Updated 2 years ago
• samchaineau / llm_slerp_generation
  Repo hosting codes and materials related to speeding LLMs' inference using token merging.
  ☆36Updated last year
• pacman100 / peft-codegen-25
  ☆23Updated last year
• ariG23498 / gemma3-object-detection
  Fine tune Gemma 3 on an object detection task
  ☆57Updated this week
• sayakpaul / big_vision_experiments
  Contains my experiments with the `big_vision` repo to train ViTs on ImageNet-1k.
  ☆22Updated 2 years ago
• ariG23498 / timm-wrapper-examples
  Notebooks to demonstrate TimmWrapper
  ☆16Updated 5 months ago
• tanaymeh / mamba-train
  A single repo with all scripts and utils to train / fine-tune the Mamba model with or without FIM
  ☆55Updated last year
• alexander-moore / vlm
  Composition of Multimodal Language Models From Scratch
  ☆14Updated 10 months ago
• adithya-s-k / YoloGemma
  Testing and evaluating the capabilities of Vision-Language models (PaliGemma) in performing computer vision tasks such as object detectio…
  ☆81Updated last year
• kyegomez / VisionLLaMA
  Implementation of VisionLLaMA from the paper: "VisionLLaMA: A Unified LLaMA Interface for Vision Tasks" in PyTorch and Zeta
  ☆16Updated 7 months ago
• bipul1010 / agents_tutorial
  ☆19Updated 10 months ago
• ThinamXx / cuda-mode
  Making of cuda kernel
  ☆16Updated last month
• tensoic / Cerule
  Cerule - A Tiny Mighty Vision Model
  ☆66Updated 9 months ago