Alternatives and similar repositories for groqflow:

Users that are interested in groqflow are comparing it to the libraries listed below

• deepsilicon / Sila
  ☆89Updated 5 months ago
• serp-ai / Parameter-Efficient-MoE
  Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks
  ☆31Updated 10 months ago
• rejunity / tiny-asic-1_58bit-matrix-mul
  Tiny ASIC implementation for "The Era of 1-bit LLMs All Large Language Models are in 1.58 Bits" matrix multiplication unit
  ☆127Updated 11 months ago
• groq / mlagility
  Machine Learning Agility (MLAgility) benchmark and benchmarking tools
  ☆38Updated 3 weeks ago
• rafacelente / bllama
  1.58-bit LLaMa model
  ☆82Updated 11 months ago
• EmbeddedLLM / vllm
  vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆87Updated this week
• mzbac / mlx_sharding
  Distributed Inference for mlx LLm
  ☆87Updated 7 months ago
• willccbb / mlx_parallm
  Fast parallel LLM inference for MLX
  ☆174Updated 8 months ago
• mlc-ai / web-llm-assistant
  AI Assistant running within your browser.
  ☆62Updated 3 months ago
• unslothai / llama.cpp
  LLM inference in C/C++
  ☆66Updated this week
• 4dh / GRDN
  GRDN.AI app for garden optimization
  ☆70Updated last year
• SpellcraftAI / turing
  Turing machines, Rule 110, and A::B reversal using Claude 3 Opus.
  ☆59Updated 10 months ago
• sacha-ichbiah / outlines-mlx
  A fast minimalistic implementation of guided generation on Apple Silicon using Outlines and MLX
  ☆53Updated last year
• N8python / n8loom
  A tree-based prefix cache library that allows rapid creation of looms: hierarchal branching pathways of LLM generations.
  ☆67Updated last month
• tenstorrent / tt-buda-demos
  Repository of model demos using TT-Buda
  ☆63Updated last week
• skypilot-org / skypilot-tutorial
  Tutorial to get started with SkyPilot!
  ☆57Updated 10 months ago
• yandex-research / swarm
  Official code for "SWARM Parallelism: Training Large Models Can Be Surprisingly Communication-Efficient"
  ☆137Updated last year
• Jaykef / mlx-rag-gguf
  Minimal, clean code implementation of RAG with mlx using gguf model weights
  ☆49Updated 11 months ago
• teknium1 / ShareGPT-Builder
  ☆111Updated 3 months ago
• xjdr-alt / llmri
  look how they massacred my boy
  ☆63Updated 5 months ago
• cognitivecomputations / kraken
  ☆66Updated 10 months ago
• furiousteabag / vram-calculator
  Transformer GPU VRAM estimator
  ☆58Updated last year
• glaive-ai / function-calling-server
  ☆35Updated last year
• lordspline / DevOn
  ☆41Updated 10 months ago
• LLMSELECTOR / LLMSELECTOR
  ☆61Updated last month
• normal-computing / extended-mind-transformers
  ☆113Updated 7 months ago
• gpu-mode / discord-cluster-manager
  Write a fast kernel and run it on Discord. See how you compare against the best!
  ☆34Updated this week
• Doriandarko / MLX-GRPO
  A pure MLX-based training pipeline for fine-tuning LLMs using GRPO on Apple Silicon.
  ☆29Updated last month
• nicholasyager / llama-cpp-guidance
  A guidance compatibility layer for llama-cpp-python
  ☆34Updated last year
• SohamGovande / podplex
  🦾💻🌐 distributed training & serverless inference at scale on RunPod
  ☆17Updated 10 months ago