Alternatives and similar repositories for distributed-llama:

Users that are interested in distributed-llama are comparing it to the libraries listed below

• willccbb / mlx_parallm
  Fast parallel LLM inference for MLX
  ☆177Updated 8 months ago
• mzbac / mlx_sharding
  Distributed Inference for mlx LLm
  ☆87Updated 8 months ago
• rafacelente / bllama
  1.58-bit LLaMa model
  ☆81Updated last year
• OpenPipe / deductive-reasoning
  Train your own SOTA deductive reasoning model
  ☆81Updated 3 weeks ago
• cognitivecomputations / grokadamw
  ☆126Updated 7 months ago
• argilla-io / argilla-cookbook
  Simple examples using Argilla tools to build AI
  ☆52Updated 4 months ago
• Leoleojames1 / Agent_Chef
  🍲Agent Chef🥘 is my robust tool for dataset refinement, structuring, and generation. By leveraging procedural and synthetic dataset gene…
  ☆19Updated 2 months ago
• unslothai / llama.cpp
  LLM inference in C/C++
  ☆67Updated last week
• xjdr-alt / llmri
  look how they massacred my boy
  ☆63Updated 5 months ago
• moxin-org / Moxin-LLM
  Moxin is a family of fully open-source and reproducible LLMs
  ☆85Updated 2 weeks ago
• fairydreaming / farel-bench
  Testing LLM reasoning abilities with family relationship quizzes.
  ☆62Updated 2 months ago
• mzbac / mlx-llm-server
  For inferring and serving local LLMs using the MLX framework
  ☆99Updated last year
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆164Updated this week
• cognitivecomputations / kraken
  ☆66Updated 10 months ago
• astramind-ai / BitMat
  An efficent implementation of the method proposed in "The Era of 1-bit LLMs"
  ☆155Updated 5 months ago
• severian42 / MoA-LMStudio-Chat
  This is the Mixture-of-Agents (MoA) concept, adapted from the original work by TogetherAI. My version is tailored for local model usage a…
  ☆12Updated 9 months ago
• 7ozzam / cohere-toolkit-with-openai
  Cohere Toolkit is a collection of prebuilt components enabling users to quickly build and deploy RAG applications.
  ☆28Updated 2 months ago
• SinatrasC / entropix
  Entropy Based Sampling and Parallel CoT Decoding
  ☆17Updated 5 months ago
• zhuzilin / faster-nougat
  Implementation of nougat that focuses on processing pdf locally.
  ☆81Updated 2 months ago
• ComposioHQ / Composio-Function-Calling-Benchmark
  Function Calling Benchmark & Testing
  ☆85Updated 8 months ago
• agokrani / distillKitPlus
  Easy to use, High Performant Knowledge Distillation for LLMs
  ☆55Updated this week
• remichu-ai / gallama
  ☆125Updated last week
• serp-ai / Parameter-Efficient-MoE
  Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks
  ☆31Updated 10 months ago
• charmandercha / ArchiDoc
  ☆17Updated 3 months ago
• Xalp / ECHO
  Official homepage for "Self-Harmonized Chain of Thought" (NAACL 2025)
  ☆91Updated 2 months ago
• monk1337 / auto-ollama
  run ollama & gguf easily with a single command
  ☆50Updated 10 months ago
• Aesthisia / LLMinator
  Gradio based tool to run opensource LLM models directly from Huggingface
  ☆91Updated 9 months ago
• perk11 / large-model-proxy
  Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…
  ☆55Updated last month
• abacusai / gh200-llm
  Docker image NVIDIA GH200 machines - optimized for vllm serving and hf trainer finetuning
  ☆38Updated last month
• HishamAlyahya / semantic_backprop
  Source code of "How to Correctly do Semantic Backpropagation on Language-based Agentic Systems" 🤖
  ☆63Updated 3 months ago