Alternatives and similar repositories for groqflow

Users that are interested in groqflow are comparing it to the libraries listed below

• skypilot-org / skypilot-tutorial
  Tutorial to get started with SkyPilot!
  ☆58Updated last year
• normal-computing / extended-mind-transformers
  ☆123Updated last year
• NVIDIA-AI-Blueprints / llm-router
  Route LLM requests to the best model for the task at hand.
  ☆87Updated last month
• groq / mlagility
  Machine Learning Agility (MLAgility) benchmark and benchmarking tools
  ☆39Updated last week
• deepsilicon / Sila
  ☆89Updated 10 months ago
• tairov / QStarLearning.mojo
  ☆111Updated last year
• vikhyat / mixtral-inference
  inference code for mixtral-8x7b-32kseqlen
  ☆101Updated last year
• deepinfra / deepctl
  Command line tool for Deep Infra cloud ML inference service
  ☆32Updated last year
• exo-explore / mlx-bitnet
  1.58 Bit LLM on Apple Silicon using MLX
  ☆217Updated last year
• agentic-ai / enact
  A framework for generative software.
  ☆113Updated last month
• EmbeddedLLM / vllm
  vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆87Updated this week
• NousResearch / finetuning-subnet
  ☆121Updated last year
• mistralai / vllm-release
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆53Updated last year
• mzbac / mlx_sharding
  Distributed Inference for mlx LLm
  ☆94Updated last year
• lamini-ai / lamini-examples
  ☆160Updated 5 months ago
• SpellcraftAI / turing
  Turing machines, Rule 110, and A::B reversal using Claude 3 Opus.
  ☆58Updated last year
• petals-infra / health.petals.dev
  🏥 Health monitor for a Petals swarm
  ☆39Updated last year
• QuixiAI / kraken
  ☆66Updated last year
• N8python / n8loom
  A tree-based prefix cache library that allows rapid creation of looms: hierarchal branching pathways of LLM generations.
  ☆72Updated 5 months ago
• PrimeIntellect-ai / prime-cli
  The Prime Intellect CLI provides a powerful command-line interface for managing GPU resources across various providers
  ☆30Updated this week
• willccbb / mlx_parallm
  Fast parallel LLM inference for MLX
  ☆204Updated last year
• METR / eval-analysis-public
  Public repository containing METR's DVC pipeline for eval data analysis
  ☆86Updated 4 months ago
• serp-ai / Parameter-Efficient-MoE
  Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks
  ☆31Updated last year
• 4dh / GRDN
  GRDN.AI app for garden optimization
  ☆70Updated last year
• Datura-ai / cortex.t
  ☆63Updated 7 months ago
• KillianLucas / ooba
  Run language models on consumer hardware.
  ☆27Updated last year
• The-Swarm-Corporation / swarms-cloud
  Deploy your autonomous agents to production grade environments with 99% Uptime Guarantee, Infinite Scalability, and self-healing.
  ☆42Updated 2 weeks ago
• Cerebras / inference-examples
  Inference examples
  ☆55Updated 5 months ago
• NVIDIA / nim-anywhere
  Accelerate your Gen AI with NVIDIA NIM and NVIDIA AI Workbench
  ☆178Updated 3 months ago
• sacha-ichbiah / outlines-mlx
  A fast minimalistic implementation of guided generation on Apple Silicon using Outlines and MLX
  ☆55Updated last year