Alternatives and similar repositories for groqflow

Users that are interested in groqflow are comparing it to the libraries listed below

• furiousteabag / vram-calculator
  Transformer GPU VRAM estimator
  ☆68Updated last year
• deepsilicon / Sila
  ☆91Updated last year
• groq / mlagility
  Machine Learning Agility (MLAgility) benchmark and benchmarking tools
  ☆40Updated 6 months ago
• rafacelente / bllama
  1.58-bit LLaMa model
  ☆82Updated last year
• EmbeddedLLM / vllm
  vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆93Updated this week
• katsumiok / pyaskit
  AskIt: Unified programming interface for programming with LLMs (GPT-3.5, GPT-4, Gemini, Claude, Cohere, Llama 2)
  ☆80Updated last year
• petals-infra / health.petals.dev
  🏥 Health monitor for a Petals swarm
  ☆40Updated last year
• tenstorrent / tt-buda-demos
  Repository of model demos using TT-Buda
  ☆63Updated 10 months ago
• skypilot-org / skypilot-tutorial
  Tutorial to get started with SkyPilot!
  ☆58Updated last year
• normal-computing / extended-mind-transformers
  ☆125Updated last year
• mistralai / vllm-release
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆53Updated 2 years ago
• exo-explore / mlx-bitnet
  1.58 Bit LLM on Apple Silicon using MLX
  ☆243Updated last year
• The-Swarm-Corporation / swarms-cloud
  Deploy your autonomous agents to production grade environments with 99% Uptime Guarantee, Infinite Scalability, and self-healing.
  ☆50Updated 3 months ago
• serp-ai / Parameter-Efficient-MoE
  Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks
  ☆31Updated last year
• JosefAlbers / Roy
  Roy: A lightweight, model-agnostic framework for crafting advanced multi-agent systems using large language models.
  ☆78Updated 2 years ago
• teknium1 / ShareGPT-Builder
  ☆119Updated last year
• NousResearch / finetuning-subnet
  ☆122Updated last year
• tensorwavecloud / ScalarLM
  ScalarLM - a unified training and inference stack
  ☆97Updated 2 months ago
• lamini-ai / lamini-examples
  ☆162Updated last year
• NVIDIA-AI-Blueprints / llm-router
  Route LLM requests to the best model for the task at hand.
  ☆177Updated 3 weeks ago
• tenstorrent / tt-smi
  Tenstorrent console based hardware information program
  ☆58Updated this week
• 4dh / GRDN
  GRDN.AI app for garden optimization
  ☆69Updated 2 months ago
• QuixiAI / kraken
  ☆68Updated last year
• tairov / QStarLearning.mojo
  ☆112Updated 2 years ago
• agiresearch / Formal-LLM
  Formal-LLM: Integrating Formal Language and Natural Language for Controllable LLM-based Agents
  ☆132Updated last year
• argilla-io / awesome-llm-datasets
  👩🤝🤖 A curated list of datasets for large language models (LLMs), RLHF and related resources (continually updated)
  ☆24Updated 2 years ago
• SakanaAI / vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆34Updated last year
• willccbb / mlx_parallm
  Fast parallel LLM inference for MLX
  ☆246Updated last year
• vikhyat / mixtral-inference
  inference code for mixtral-8x7b-32kseqlen
  ☆105Updated 2 years ago
• zhudotexe / redel
  ReDel is a toolkit for researchers and developers to build, iterate on, and analyze recursive multi-agent systems. (EMNLP 2024 Demo)
  ☆90Updated last month