Alternatives and similar repositories for llama-nuts-and-bolts

Users that are interested in llama-nuts-and-bolts are comparing it to the libraries listed below

• Pints-AI / 1.5-Pints
  A compact LLM pretrained in 9 days by using high quality data
  ☆337Updated 8 months ago
• lapp0 / lm-inference-engines
  Comparison of Language Model Inference Engines
  ☆238Updated last year
• mlabonne / llm-autoeval
  Automatically evaluate your LLMs in Google Colab
  ☆677Updated last year
• keeeeenw / MicroLlama
  Micro Llama is a small Llama based model with 300M parameters trained from scratch with $500 budget
  ☆163Updated 4 months ago
• apoorvumang / prompt-lookup-decoding
  ☆583Updated last year
• mani-kantap / llm-inference-solutions
  A collection of all available inference solutions for the LLMs
  ☆93Updated 9 months ago
• neuralmagic / nm-vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆267Updated 3 weeks ago
• adriancable / qwen3.c
  Local Qwen3 LLM inference. One easy-to-understand file of C source with no dependencies.
  ☆150Updated 5 months ago
• arcee-ai / PruneMe
  Automated Identification of Redundant Layer Blocks for Pruning in Large Language Models
  ☆258Updated last year
• anyscale / llm-router
  Tutorial for building LLM router
  ☆239Updated last year
• dropbox / hqq
  Official implementation of Half-Quadratic Quantization (HQQ)
  ☆902Updated last week
• Leeroo-AI / mergoo
  A library for easily merging multiple LLM experts, and efficiently train the merged LLM.
  ☆500Updated last year
• microsoft / VPTQ
  VPTQ, A Flexible and Extreme low-bit quantization algorithm
  ☆670Updated 8 months ago
• VITA-Group / Q-GaLore
  Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.
  ☆202Updated last year
• ScalingIntelligence / tokasaurus
  ☆461Updated last month
• ServiceNow / Fast-LLM
  Accelerating your LLM training to full speed! Made with ❤️ by ServiceNow Research
  ☆273Updated this week
• predibase / llm_distillation_playbook
  Best practices for distilling large language models.
  ☆595Updated last year
• ray-project / llmperf-leaderboard
  ☆474Updated last year
• taprosoft / llm_finetuning
  Convenient wrapper for fine-tuning and inference of Large Language Models (LLMs) with several quantization techniques (GTPQ, bitsandbytes…
  ☆146Updated 2 years ago
• likejazz / llama3.cuda
  llama3.cuda is a pure C/CUDA implementation for Llama 3 model.
  ☆348Updated 8 months ago
• lamini-ai / Lamini-Memory-Tuning
  Banishing LLM Hallucinations Requires Rethinking Generalization
  ☆275Updated last year
• Infini-AI-Lab / UMbreLLa
  LLM Inference on consumer devices
  ☆128Updated 9 months ago
• mistralai-sf24 / hackathon
  ☆446Updated last year
• antimatter15 / reverse-engineering-gemma-3n
  Reverse Engineering Gemma 3n: Google's New Edge-Optimized Language Model
  ☆255Updated 6 months ago
• valine / NeuralFlow
  Visualize the intermediate output of Mistral 7B
  ☆381Updated 11 months ago
• Dan-wanna-M / formatron
  Formatron empowers everyone to control the format of language models' output with minimal overhead.
  ☆232Updated 6 months ago
• Infini-AI-Lab / Sequoia
  scalable and robust tree-based speculative decoding algorithm
  ☆366Updated 10 months ago
• astramind-ai / BitMat
  An efficent implementation of the method proposed in "The Era of 1-bit LLMs"
  ☆155Updated last year
• mistralai / mistral-common
  Official inference library for pre-processing of Mistral models
  ☆832Updated this week
• intel / auto-round
  Advanced quantization toolkit for LLMs and VLMs. Support for WOQ, MXFP4, NVFP4, GGUF, Adaptive Schemes and seamless integration with Tra…
  ☆775Updated this week