Alternatives and similar repositories for groqflow

Users that are interested in groqflow are comparing it to the libraries listed below

• groq / mlagility
  Machine Learning Agility (MLAgility) benchmark and benchmarking tools
  ☆40Updated 5 months ago
• EmbeddedLLM / vllm
  vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆93Updated this week
• skypilot-org / skypilot-tutorial
  Tutorial to get started with SkyPilot!
  ☆58Updated last year
• tairov / QStarLearning.mojo
  ☆112Updated 2 years ago
• deepsilicon / Sila
  ☆90Updated last year
• mistralai / vllm-release
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆53Updated 2 years ago
• tenstorrent / tt-buda-demos
  Repository of model demos using TT-Buda
  ☆63Updated 9 months ago
• petals-infra / health.petals.dev
  🏥 Health monitor for a Petals swarm
  ☆40Updated last year
• NousResearch / finetuning-subnet
  ☆122Updated last year
• katsumiok / pyaskit
  AskIt: Unified programming interface for programming with LLMs (GPT-3.5, GPT-4, Gemini, Claude, Cohere, Llama 2)
  ☆80Updated last year
• tensorwavecloud / ScalarLM
  ScalarLM - a unified training and inference stack
  ☆95Updated 2 months ago
• serp-ai / Parameter-Efficient-MoE
  Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks
  ☆31Updated last year
• normal-computing / extended-mind-transformers
  ☆125Updated last year
• mlc-ai / web-llm-assistant
  AI Assistant running within your browser.
  ☆78Updated last year
• QuixiAI / kraken
  ☆68Updated last year
• yandex-research / swarm
  Official code for "SWARM Parallelism: Training Large Models Can Be Surprisingly Communication-Efficient"
  ☆148Updated 2 years ago
• chai-research / chaiverse
  Chaiverse: the Chai AI developer platform.
  ☆190Updated last year
• Alignment-Lab-AI / Our-Projects
  A repository of projects and datasets under active development by Alignment Lab AI
  ☆22Updated 2 years ago
• teknium1 / ShareGPT-Builder
  ☆119Updated last year
• Datura-ai / cortex.t
  ☆64Updated last year
• exo-explore / mlx-bitnet
  1.58 Bit LLM on Apple Silicon using MLX
  ☆238Updated last year
• PrimeIntellect-ai / pccl
  PCCL (Prime Collective Communications Library) implements fault tolerant collective communications over IP
  ☆141Updated 4 months ago
• glaive-ai / function-calling-server
  ☆36Updated last year
• mystic-ai / pipeline
  Pipeline is an open source python SDK for building AI/ML workflows
  ☆138Updated last year
• Cerebras / inference-examples
  Inference examples
  ☆65Updated 4 months ago
• willccbb / mlx_parallm
  Fast parallel LLM inference for MLX
  ☆242Updated last year
• furiousteabag / vram-calculator
  Transformer GPU VRAM estimator
  ☆67Updated last year
• dorjeduck / momograd
  A Learning Journey: Micrograd in Mojo 🔥
  ☆65Updated last year
• N8python / n8loom
  A tree-based prefix cache library that allows rapid creation of looms: hierarchal branching pathways of LLM generations.
  ☆77Updated 11 months ago
• rafacelente / bllama
  1.58-bit LLaMa model
  ☆83Updated last year