Alternatives and similar repositories for distributed-llama

Users that are interested in distributed-llama are comparing it to the libraries listed below

• willccbb / mlx_parallm
  Fast parallel LLM inference for MLX
  ☆245Updated last year
• exo-explore / mlx-bitnet
  1.58 Bit LLM on Apple Silicon using MLX
  ☆242Updated last year
• rafacelente / bllama
  1.58-bit LLaMa model
  ☆82Updated last year
• SakanaAI / evo-memory
  Code to train and evaluate Neural Attention Memory Models to obtain universally-applicable memory systems for transformers.
  ☆347Updated last year
• pranavjad / tinyllama-bitnet
  Train your own small bitnet model
  ☆77Updated last year
• mzbac / mlx_sharding
  Distributed Inference for mlx LLm
  ☆100Updated last year
• eqimp / hogwild_llm
  Official PyTorch implementation for Hogwild! Inference: Parallel LLM Generation with a Concurrent Attention Cache
  ☆140Updated 5 months ago
• intel / neural-speed
  An innovative library for efficient LLM inference via low-bit quantization
  ☆352Updated last year
• sshh12 / multi_token
  Embed arbitrary modalities (images, audio, documents, etc) into large language models.
  ☆189Updated last year
• ScalingIntelligence / good-kernels
  Samples of good AI generated CUDA kernels
  ☆99Updated 8 months ago
• apple / ml-recurrent-drafter
  ☆219Updated last year
• Decentralised-AI / LFM-Liquid-AI-Liquid-Foundation-Models
  An open source implementation of LFMs from Liquid AI: Liquid Foundation Models
  ☆119Updated last year
• CerebrasResearch / reap
  REAP: Router-weighted Expert Activation Pruning for SMoE compression
  ☆222Updated last month
• ServiceNow / Fast-LLM
  Accelerating your LLM training to full speed! Made with ❤️ by ServiceNow Research
  ☆287Updated this week
• astramind-ai / BitMat
  An efficent implementation of the method proposed in "The Era of 1-bit LLMs"
  ☆155Updated last year
• adriancable / qwen3.c
  Local Qwen3 LLM inference. One easy-to-understand file of C source with no dependencies.
  ☆156Updated 7 months ago
• fairydreaming / farel-bench
  Testing LLM reasoning abilities with family relationship quizzes.
  ☆63Updated last year
• facebookresearch / ExploreToM
  Code for ExploreTom
  ☆90Updated 7 months ago
• jadechip / nanoXLSTM
  The simplest, fastest repository for training/finetuning medium-sized xLSTMs.
  ☆41Updated last year
• ibm-granite / granite-3.0-language-models
  ☆270Updated 7 months ago
• evintunador / FractalFormer
  A GPT with self-similar nested properties
  ☆20Updated last year
• intel / auto-round
  🎯An accuracy-first, highly efficient quantization toolkit for LLMs, designed to minimize quality degradation across Weight-Only Quantiza…
  ☆839Updated this week
• QuixiAI / spectrum
  ☆141Updated 5 months ago
• OpenPipe / deductive-reasoning
  Train your own SOTA deductive reasoning model
  ☆107Updated 11 months ago
• VITA-Group / Q-GaLore
  Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.
  ☆201Updated last year
• Pints-AI / 1.5-Pints
  A compact LLM pretrained in 9 days by using high quality data
  ☆339Updated 9 months ago
• unslothai / llama.cpp
  LLM inference in C/C++
  ☆104Updated last week
• keeeeenw / MicroLlama
  Micro Llama is a small Llama based model with 300M parameters trained from scratch with $500 budget
  ☆169Updated 5 months ago
• KevlarKanou / rwkv7.c
  Inference RWKV v7 in pure C.
  ☆44Updated 3 months ago
• backprop-ai / vllm-benchmark
  Benchmarking the serving capabilities of vLLM
  ☆58Updated last year