Alternatives and similar repositories for groqflow

Users that are interested in groqflow are comparing it to the libraries listed below

• exo-explore / mlx-bitnet
  1.58 Bit LLM on Apple Silicon using MLX
  ☆221Updated last year
• groq / mlagility
  Machine Learning Agility (MLAgility) benchmark and benchmarking tools
  ☆39Updated 3 weeks ago
• NVIDIA-AI-Blueprints / llm-router
  Route LLM requests to the best model for the task at hand.
  ☆96Updated 2 months ago
• mistralai / vllm-release
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆52Updated last year
• LachlanGray / lmql-tree-of-thoughts
  LMQL implementation of tree of thoughts
  ☆34Updated last year
• skypilot-org / skypilot-tutorial
  Tutorial to get started with SkyPilot!
  ☆58Updated last year
• deepsilicon / Sila
  ☆89Updated 10 months ago
• petals-infra / health.petals.dev
  🏥 Health monitor for a Petals swarm
  ☆39Updated last year
• glaive-ai / function-calling-server
  ☆36Updated last year
• N8python / n8loom
  A tree-based prefix cache library that allows rapid creation of looms: hierarchal branching pathways of LLM generations.
  ☆73Updated 6 months ago
• Alignment-Lab-AI / KnowledgeBase
  never forget anything again! combine AI and intelligent tooling for a local knowledge base to track catalogue, annotate, and plan for you…
  ☆37Updated last year
• normal-computing / extended-mind-transformers
  ☆123Updated last year
• NVIDIA / nim-anywhere
  Accelerate your Gen AI with NVIDIA NIM and NVIDIA AI Workbench
  ☆180Updated 3 months ago
• furiousteabag / vram-calculator
  Transformer GPU VRAM estimator
  ☆66Updated last year
• vikhyat / mixtral-inference
  inference code for mixtral-8x7b-32kseqlen
  ☆101Updated last year
• The-Swarm-Corporation / swarms-cloud
  Deploy your autonomous agents to production grade environments with 99% Uptime Guarantee, Infinite Scalability, and self-healing.
  ☆45Updated last week
• serp-ai / Parameter-Efficient-MoE
  Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks
  ☆31Updated last year
• tensorwavecloud / ScalarLM
  ScalarLM - a unified training and inference stack
  ☆55Updated 3 weeks ago
• EmbeddedLLM / vllm
  vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆88Updated last week
• SpellcraftAI / turing
  Turing machines, Rule 110, and A::B reversal using Claude 3 Opus.
  ☆58Updated last year
• sacha-ichbiah / outlines-mlx
  A fast minimalistic implementation of guided generation on Apple Silicon using Outlines and MLX
  ☆56Updated last year
• KillianLucas / ooba
  Run language models on consumer hardware.
  ☆28Updated last year
• Cerebras / inference-examples
  Inference examples
  ☆56Updated 6 months ago
• xjdr-alt / llmri
  look how they massacred my boy
  ☆64Updated 10 months ago
• METR / eval-analysis-public
  Public repository containing METR's DVC pipeline for eval data analysis
  ☆96Updated 4 months ago
• willccbb / mlx_parallm
  Fast parallel LLM inference for MLX
  ☆206Updated last year
• rafacelente / bllama
  1.58-bit LLaMa model
  ☆82Updated last year
• dorjeduck / momograd
  A Learning Journey: Micrograd in Mojo 🔥
  ☆62Updated 10 months ago
• jina-ai / jerboa
  LLM finetuning
  ☆42Updated 2 years ago
• Datura-ai / cortex.t
  ☆63Updated 8 months ago