Alternatives and similar repositories for Quantized-LLMs:

Users that are interested in Quantized-LLMs are comparing it to the libraries listed below

• ariG23498 / quantized-diffusion-inference
  Notebook and Scripts that showcase running quantized diffusion models on consumer GPUs
  ☆37Updated 3 months ago
• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆48Updated 6 months ago
• nyunAI / Faster-LLM-Survey
  ☆40Updated 9 months ago
• pacman100 / peft-codegen-25
  ☆24Updated last year
• joey00072 / ohara
  Collection of autoregressive model implementation
  ☆77Updated 3 weeks ago
• Pleias / Various-Finetuning
  Set of scripts to finetune LLMs
  ☆36Updated 10 months ago
• anyscale / e2e-llm-workflows
  End-to-End LLM Guide
  ☆99Updated 6 months ago
• rashmimarganiatgithub / LLMS_Library_2023
  LLM_library is a comprehensive repository serves as a one-stop resource hands-on code, insightful summaries.
  ☆68Updated last year
• aniketmaurya / agents
  Build Agentic workflows with function calling
  ☆26Updated 2 weeks ago
• ThinamXx / Meta-llama
  Complete implementation of Llama2 with/without KV cache & inference 🚀
  ☆47Updated 8 months ago
• samchaineau / llm_slerp_generation
  Repo hosting codes and materials related to speeding LLMs' inference using token merging.
  ☆34Updated 8 months ago
• sayakpaul / you-dont-know-tensorflow
  Contains materials for my talk "You don't know TensorFlow".
  ☆9Updated last year
• NielsRogge / awesome-huggingface
  Repository containing awesome resources regarding Hugging Face tooling.
  ☆46Updated last year
• fangyuan-ksgk / Mini-LLaVA
  A minimal implementation of LLaVA-style VLM with interleaved image & text & video processing ability.
  ☆89Updated last month
• Upaya07 / NeurIPS-llm-efficiency-challenge
  Code for NeurIPS LLM Efficiency Challenge
  ☆54Updated 9 months ago
• pacman100 / openhathi_instruct
  This repository contains the code for dataset curation and finetuning of instruct variant of the Bilingual OpenHathi model. The resultin…
  ☆23Updated last year
• IlyasMoutawwakil / py-txi
  A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.
  ☆34Updated last month
• sayakpaul / deploy-hf-tf-vision-models
  This repository shows various ways of deploying a vision model (TensorFlow) from 🤗 Transformers.
  ☆28Updated 2 years ago
• mrmaheshrajput / productionizing-llms
  Code Repository for Blog - How to Productionize Large Language Models (LLMs)
  ☆11Updated 10 months ago
• tcapelle / llm_recipes
  A set of scripts and notebooks on LLM finetunning and dataset creation
  ☆101Updated 4 months ago
• ariG23498 / fine-tune-paligemma
  Notebooks for fine tuning pali gemma
  ☆90Updated last month
• huggingface / pixparse
  Pixel Parsing. A reproduction of OCR-free end-to-end document understanding models with open data
  ☆21Updated 5 months ago
• Delve-ERAV1 / Phi-2-Vision-Language
  Pretraining and finetuning for visual instruction following with Mixture of Experts
  ☆12Updated last year
• ml-gde / jflux
  JAX Implementation of Black Forest Labs' Flux.1 family of models
  ☆27Updated 3 months ago
• rasbt / RAGs
  RAGs: Simple implementations of Retrieval Augmented Generation (RAG) Systems
  ☆88Updated last week
• shivance / minbpe.c
  a Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization in pure C.
  ☆21Updated 6 months ago
• MontrealAI / AGI-Agent-v0
  A minimal yet unstoppable blueprint for multi-agent AI—anchored by the rare, far-reaching “Multi-Agent AI DAO” (2017 Prior Art)—empowerin…
  ☆23Updated 2 weeks ago
• apple / ml-mofi
  ☆58Updated 10 months ago
• euclaise / supertrainer2000
  ☆49Updated 10 months ago
• google-deepmind / asyncdiloco
  ☆41Updated last year