Alternatives and similar repositories for distributed-llama

Users that are interested in distributed-llama are comparing it to the libraries listed below

• rafacelente / bllama
  1.58-bit LLaMa model
  ☆82Updated last year
• willccbb / mlx_parallm
  Fast parallel LLM inference for MLX
  ☆246Updated last year
• SakanaAI / evo-memory
  Code to train and evaluate Neural Attention Memory Models to obtain universally-applicable memory systems for transformers.
  ☆347Updated last year
• janhq / ReZero
  ☆159Updated 9 months ago
• Pints-AI / 1.5-Pints
  A compact LLM pretrained in 9 days by using high quality data
  ☆339Updated 10 months ago
• mzbac / mlx_sharding
  Distributed Inference for mlx LLm
  ☆100Updated last year
• eqimp / hogwild_llm
  Official PyTorch implementation for Hogwild! Inference: Parallel LLM Generation with a Concurrent Attention Cache
  ☆140Updated 5 months ago
• ServiceNow / Fast-LLM
  Accelerating your LLM training to full speed! Made with ❤️ by ServiceNow Research
  ☆287Updated this week
• exo-explore / mlx-bitnet
  1.58 Bit LLM on Apple Silicon using MLX
  ☆243Updated last year
• cornstarch-org / Cornstarch
  ☆115Updated 5 months ago
• epolewski / EricLLM
  A fast batching API to serve LLM models
  ☆189Updated last year
• kotak-ai / 1.58BitNet
  Experimental BitNet Implementation
  ☆73Updated 2 months ago
• Decentralised-AI / LFM-Liquid-AI-Liquid-Foundation-Models
  An open source implementation of LFMs from Liquid AI: Liquid Foundation Models
  ☆119Updated last year
• microsoft / ArchScale
  Simple & Scalable Pretraining for Neural Architecture Research
  ☆307Updated 2 months ago
• QuixiAI / spectrum
  ☆141Updated 5 months ago
• pranavjad / tinyllama-bitnet
  Train your own small bitnet model
  ☆77Updated last year
• apple / ml-recurrent-drafter
  ☆219Updated last year
• evintunador / templateGPT
  customizable template GPT code designed for easy novel architecture experimentation
  ☆26Updated 10 months ago
• N8python / mlx-pretrain
  A simple MLX implementation for pretraining LLMs on Apple Silicon.
  ☆85Updated 5 months ago
• VITA-Group / Q-GaLore
  Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.
  ☆201Updated last year
• fairydreaming / farel-bench
  Testing LLM reasoning abilities with family relationship quizzes.
  ☆63Updated last year
• QuixiAI / grokadamw
  ☆137Updated last year
• keeeeenw / MicroLlama
  Micro Llama is a small Llama based model with 300M parameters trained from scratch with $500 budget
  ☆169Updated 5 months ago
• ibm-granite / granite-3.0-language-models
  ☆270Updated 7 months ago
• microsoft / GRIN-MoE
  GRadient-INformed MoE
  ☆264Updated last year
• astramind-ai / BitMat
  An efficent implementation of the method proposed in "The Era of 1-bit LLMs"
  ☆155Updated last year
• matt-c1 / llama-3-quant-comparison
  Comparison of the output quality of quantization methods, using Llama 3, transformers, GGUF, EXL2.
  ☆165Updated last year
• TrelisResearch / one-click-llms
  One click templates for inferencing Language Models
  ☆228Updated 2 months ago
• RichardAragon / QGLS
  ☆34Updated 11 months ago
• intel / neural-speed
  An innovative library for efficient LLM inference via low-bit quantization
  ☆352Updated last year