Alternatives and similar repositories for groqflow:

Users that are interested in groqflow are comparing it to the libraries listed below

• groq / mlagility
  Machine Learning Agility (MLAgility) benchmark and benchmarking tools
  ☆38Updated 2 months ago
• mzbac / mlx_sharding
  Distributed Inference for mlx LLm
  ☆82Updated 6 months ago
• EmbeddedLLM / vllm
  vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆88Updated this week
• willccbb / mlx_parallm
  Fast parallel LLM inference for MLX
  ☆162Updated 7 months ago
• xjdr-alt / llmri
  look how they massacred my boy
  ☆63Updated 4 months ago
• mlc-ai / web-llm-assistant
  AI Assistant running within your browser.
  ☆59Updated 2 months ago
• catena-labs / moa-llm
  A Python library to orchestrate LLMs in a neural network-inspired structure
  ☆46Updated 4 months ago
• deepsilicon / Sila
  ☆86Updated 4 months ago
• SohamGovande / podplex
  🦾💻🌐 distributed training & serverless inference at scale on RunPod
  ☆17Updated 8 months ago
• cognitivecomputations / kraken
  ☆65Updated 8 months ago
• remichu-ai / gallama
  ☆123Updated last week
• teknium1 / RawTransform
  A repository of prompts and Python scripts for intelligent transformation of raw text into diverse formats.
  ☆30Updated last year
• andrew-silva / mlx-rlhf
  An example implementation of RLHF (or, more accurately, RLAIF) built on MLX and HuggingFace.
  ☆23Updated 7 months ago
• Not-Diamond / RoRF
  Routing on Random Forest (RoRF)
  ☆112Updated 4 months ago
• sacha-ichbiah / outlines-mlx
  A fast minimalistic implementation of guided generation on Apple Silicon using Outlines and MLX
  ☆51Updated last year
• KillianLucas / ooba
  Run language models on consumer hardware.
  ☆25Updated last year
• Fus3n / TwoAI
  A simple experiment on letting two local LLM have a conversation about anything!
  ☆104Updated 7 months ago
• serp-ai / Parameter-Efficient-MoE
  Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks
  ☆31Updated 8 months ago
• vikhyat / mixtral-inference
  inference code for mixtral-8x7b-32kseqlen
  ☆99Updated last year
• teknium1 / ShareGPT-Builder
  ☆111Updated last month
• swyxio / openlangmem
  ☆46Updated 10 months ago
• normal-computing / extended-mind-transformers
  ☆112Updated 6 months ago
• Jaykef / mlx-rag-gguf
  Minimal, clean code implementation of RAG with mlx using gguf model weights
  ☆48Updated 9 months ago
• furiousteabag / vram-calculator
  Transformer GPU VRAM estimator
  ☆49Updated 10 months ago
• abacusai / gh200-llm
  Docker image NVIDIA GH200 machines - optimized for vllm serving and hf trainer finetuning
  ☆34Updated this week
• mzbac / mlx-lora
  ☆38Updated 11 months ago
• nicholasyager / llama-cpp-guidance
  A guidance compatibility layer for llama-cpp-python
  ☆34Updated last year
• 4dh / GRDN
  GRDN.AI app for garden optimization
  ☆70Updated last year