Alternatives and similar repositories for llama-nuts-and-bolts

Users that are interested in llama-nuts-and-bolts are comparing it to the libraries listed below

• Pints-AI / 1.5-Pints
  A compact LLM pretrained in 9 days by using high quality data
  ☆324Updated 5 months ago
• apoorvumang / prompt-lookup-decoding
  ☆567Updated last year
• mlabonne / llm-autoeval
  Automatically evaluate your LLMs in Google Colab
  ☆660Updated last year
• lapp0 / lm-inference-engines
  Comparison of Language Model Inference Engines
  ☆229Updated 9 months ago
• taprosoft / llm_finetuning
  Convenient wrapper for fine-tuning and inference of Large Language Models (LLMs) with several quantization techniques (GTPQ, bitsandbytes…
  ☆146Updated last year
• ScalingIntelligence / tokasaurus
  ☆421Updated last month
• valine / NeuralFlow
  Visualize the intermediate output of Mistral 7B
  ☆369Updated 8 months ago
• datamllab / LongLM
  [ICML'24 Spotlight] LLM Maybe LongLM: Self-Extend LLM Context Window Without Tuning
  ☆661Updated last year
• arcee-ai / PruneMe
  Automated Identification of Redundant Layer Blocks for Pruning in Large Language Models
  ☆248Updated last year
• Leeroo-AI / mergoo
  A library for easily merging multiple LLM experts, and efficiently train the merged LLM.
  ☆491Updated last year
• matt-c1 / llama-3-quant-comparison
  Comparison of the output quality of quantization methods, using Llama 3, transformers, GGUF, EXL2.
  ☆163Updated last year
• Dan-wanna-M / formatron
  Formatron empowers everyone to control the format of language models' output with minimal overhead.
  ☆225Updated 3 months ago
• galatolofederico / microchain
  function calling-based LLM agents
  ☆287Updated last year
• QuixiAI / OpenChatML
  ☆161Updated last month
• keeeeenw / MicroLlama
  Micro Llama is a small Llama based model with 300M parameters trained from scratch with $500 budget
  ☆162Updated last month
• mani-kantap / llm-inference-solutions
  A collection of all available inference solutions for the LLMs
  ☆91Updated 6 months ago
• Cornell-RelaxML / quip-sharp
  ☆558Updated 10 months ago
• MDK8888 / GPTFast
  Accelerate your Hugging Face Transformers 7.6-9x. Native to Hugging Face and PyTorch.
  ☆687Updated last year
• intel / neural-speed
  An innovative library for efficient LLM inference via low-bit quantization
  ☆348Updated last year
• exo-explore / mlx-bitnet
  1.58 Bit LLM on Apple Silicon using MLX
  ☆223Updated last year
• mobiusml / hqq
  Official implementation of Half-Quadratic Quantization (HQQ)
  ☆878Updated 2 weeks ago
• Cerebras / gigaGPT
  a small code base for training large models
  ☆311Updated 4 months ago
• ray-project / llmperf-leaderboard
  ☆469Updated last year
• likejazz / llama3.cuda
  llama3.cuda is a pure C/CUDA implementation for Llama 3 model.
  ☆344Updated 5 months ago
• astramind-ai / BitMat
  An efficent implementation of the method proposed in "The Era of 1-bit LLMs"
  ☆155Updated 11 months ago
• dzhulgakov / llama-mistral
  Inference code for Mistral and Mixtral hacked up into original Llama implementation
  ☆370Updated last year
• predibase / llm_distillation_playbook
  Best practices for distilling large language models.
  ☆575Updated last year
• facebookresearch / LayerSkip
  Code for "LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding", ACL 2024
  ☆338Updated 4 months ago
• jondurbin / bagel
  A bagel, with everything.
  ☆325Updated last year
• microsoft / VPTQ
  VPTQ, A Flexible and Extreme low-bit quantization algorithm
  ☆658Updated 5 months ago