Alternatives and similar repositories for quantization-intro:

Users that are interested in quantization-intro are comparing it to the libraries listed below

• nyunAI / Faster-LLM-Survey
  ☆41Updated last year
• rashmimarganiatgithub / LLMS_Library_2023
  LLM_library is a comprehensive repository serves as a one-stop resource hands-on code, insightful summaries.
  ☆69Updated last year
• pacman100 / openhathi_instruct
  This repository contains the code for dataset curation and finetuning of instruct variant of the Bilingual OpenHathi model. The resultin…
  ☆23Updated last year
• hamelsmu / llama-inference
  experiments with inference on llama
  ☆104Updated 10 months ago
• sabetAI / BLoRA
  batched loras
  ☆341Updated last year
• Upaya07 / NeurIPS-llm-efficiency-challenge
  Code for NeurIPS LLM Efficiency Challenge
  ☆57Updated last year
• ShareChatAI / MACD
  ☆16Updated last year
• hydrallm / llama-moe-v1
  ☆94Updated last year
• llm-efficiency-challenge / neurips_llm_efficiency_challenge
  NeurIPS Large Language Model Efficiency Challenge: 1 LLM + 1GPU + 1Day
  ☆255Updated last year
• kshitij12345 / torchnnprofiler
  Context Manager to profile the forward and backward times of PyTorch's nn.Module
  ☆83Updated last year
• hundredblocks / large-model-parallelism
  Functional local implementations of main model parallelism approaches
  ☆95Updated 2 years ago
• tcapelle / llm_recipes
  A set of scripts and notebooks on LLM finetunning and dataset creation
  ☆106Updated 7 months ago
• AI4Bharat / IndicInstruct
  Code repository for "Introducing Airavata: Hindi Instruction-tuned LLM"
  ☆59Updated 6 months ago
• muellerzr / minimal-trainer-zoo
  Minimal example scripts of the Hugging Face Trainer, focused on staying under 150 lines
  ☆198Updated 11 months ago
• abacaj / transformers
  Understanding large language models
  ☆116Updated 2 years ago
• google-research-datasets / indic-gen-bench
  IndicGenBench is a high-quality, multilingual, multi-way parallel benchmark for evaluating Large Language Models (LLMs) on 4 user-facing …
  ☆46Updated 7 months ago
• jaymody / speculative-sampling
  Simple implementation of Speculative Sampling in NumPy for GPT-2.
  ☆93Updated last year
• kyleliang919 / Long-context-transformers
  Exploring finetuning public checkpoints on filter 8K sequences on Pile
  ☆115Updated 2 years ago
• ArmelRandy / Self-instruct
  A repository to perform self-instruct with a model on HF Hub
  ☆32Updated last year
• hamelsmu / ft-drift
  Check for data drift between two OpenAI multi-turn chat jsonl files.
  ☆37Updated last year
• AI4Bharat / IndicLLMSuite
  A blueprint for creating Pretraining and Fine-Tuning datasets for Indic languages
  ☆106Updated 6 months ago
• siboehm / ShallowSpeed
  Small scale distributed training of sequential deep learning models, built on Numpy and MPI.
  ☆130Updated last year
• philschmid / optimum-static-quantization
  ☆28Updated last year
• Locutusque / TPU-Alignment
  Fully fine-tune large models like Mistral, Llama-2-13B, or Qwen-14B completely for free
  ☆231Updated 5 months ago
• IlyasMoutawwakil / py-txi
  A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.
  ☆34Updated 4 months ago
• sayakpaul / keras-xla-benchmarks
  Presents comprehensive benchmarks of XLA-compatible pre-trained models in Keras.
  ☆37Updated last year
• backpropagation64 / mle-interview-questions
  Interview Questions and Answers for Machine Learning Engineer role
  ☆119Updated 2 years ago
• wandb / Groundbreaking-Papers
  ML Research paper summaries, annotated papers and implementation walkthroughs
  ☆114Updated 3 years ago
• lessw2020 / transformer_central
  Various transformers for FSDP research
  ☆37Updated 2 years ago
• johnrobinsn / redpajama
  Training and Inference Notebooks for the RedPajama (OpenLlama) models
  ☆18Updated last year