Alternatives and similar repositories for Quantized-LLMs:

Users that are interested in Quantized-LLMs are comparing it to the libraries listed below

• ariG23498 / quantized-diffusion-inference
  Notebook and Scripts that showcase running quantized diffusion models on consumer GPUs
  ☆38Updated 5 months ago
• joey00072 / ohara
  Collection of autoregressive model implementation
  ☆85Updated last month
• ThinamXx / Meta-llama
  Complete implementation of Llama2 with/without KV cache & inference 🚀
  ☆47Updated 10 months ago
• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆49Updated 9 months ago
• LukeWood / reef-net
  ☆24Updated 2 years ago
• sayakpaul / deploy-hf-tf-vision-models
  This repository shows various ways of deploying a vision model (TensorFlow) from 🤗 Transformers.
  ☆30Updated 2 years ago
• pacman100 / peft-codegen-25
  ☆24Updated last year
• ashishpatel26 / ai-tutor-rag-system
  This is a repository for the course "From Beginner to LLM Developer" by Towards AI.
  ☆11Updated 3 months ago
• aniketmaurya / Agents
  Build Agentic workflows with function calling using open LLMs
  ☆26Updated this week
• huggingface / pixparse
  Pixel Parsing. A reproduction of OCR-free end-to-end document understanding models with open data
  ☆21Updated 8 months ago
• NielsRogge / awesome-huggingface
  Repository containing awesome resources regarding Hugging Face tooling.
  ☆46Updated last year
• ariG23498 / fine-tune-paligemma
  Notebooks for fine tuning pali gemma
  ☆98Updated 3 months ago
• rasbt / RAGs
  RAGs: Simple implementations of Retrieval Augmented Generation (RAG) Systems
  ☆100Updated 2 months ago
• facebookresearch / MultiModalExplorer
  Visualize multi-model embedding spaces. The first goal is to quickly get a lay of the land of any embedding space. Then be able to scroll…
  ☆27Updated 10 months ago
• Pleias / Various-Finetuning
  Set of scripts to finetune LLMs
  ☆37Updated last year
• fangyuan-ksgk / Mini-LLaVA
  A minimal implementation of LLaVA-style VLM with interleaved image & text & video processing ability.
  ☆91Updated 3 months ago
• kyegomez / VisionLLaMA
  Implementation of VisionLLaMA from the paper: "VisionLLaMA: A Unified LLaMA Interface for Vision Tasks" in PyTorch and Zeta
  ☆16Updated 5 months ago
• nyunAI / Faster-LLM-Survey
  ☆41Updated 11 months ago
• apple / ml-mofi
  ☆58Updated last year
• LegallyCoder / mamba-hf
  Implementation of the Mamba SSM with hf_integration.
  ☆56Updated 7 months ago
• aniketmaurya / discord-llm-bot
  Fun project: LLM powered RAG Discord Bot that works seamlessly on CPU
  ☆32Updated last year
• google-deepmind / asyncdiloco
  ☆43Updated last year
• Upaya07 / NeurIPS-llm-efficiency-challenge
  Code for NeurIPS LLM Efficiency Challenge
  ☆57Updated last year
• ElleLeonne / Lightning-ReLoRA
  A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.
  ☆33Updated last year
• sayakpaul / keras-xla-benchmarks
  Presents comprehensive benchmarks of XLA-compatible pre-trained models in Keras.
  ☆37Updated last year
• stas00 / ml-ways
  ML/DL Math and Method notes
  ☆60Updated last year
• IlyasMoutawwakil / py-txi
  A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.
  ☆34Updated 3 months ago
• foundation-model-stack / bamba
  Train, tune, and infer Bamba model
  ☆88Updated 2 months ago
• adithya-s-k / YoloGemma
  Testing and evaluating the capabilities of Vision-Language models (PaliGemma) in performing computer vision tasks such as object detectio…
  ☆80Updated 10 months ago
• samchaineau / llm_slerp_generation
  Repo hosting codes and materials related to speeding LLMs' inference using token merging.
  ☆35Updated 11 months ago