Alternatives and similar repositories for groqflow

Users that are interested in groqflow are comparing it to the libraries listed below

• groq / mlagility
  Machine Learning Agility (MLAgility) benchmark and benchmarking tools
  ☆40Updated 3 months ago
• deepsilicon / Sila
  ☆89Updated last year
• skypilot-org / skypilot-tutorial
  Tutorial to get started with SkyPilot!
  ☆57Updated last year
• mistralai / vllm-release
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆52Updated last year
• tairov / QStarLearning.mojo
  ☆112Updated last year
• EmbeddedLLM / vllm
  vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆90Updated this week
• serp-ai / Parameter-Efficient-MoE
  Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks
  ☆31Updated last year
• katsumiok / pyaskit
  AskIt: Unified programming interface for programming with LLMs (GPT-3.5, GPT-4, Gemini, Claude, Cohere, Llama 2)
  ☆79Updated 9 months ago
• The-Swarm-Corporation / swarms-cloud
  Deploy your autonomous agents to production grade environments with 99% Uptime Guarantee, Infinite Scalability, and self-healing.
  ☆47Updated 2 weeks ago
• unslothai / llama.cpp
  LLM inference in C/C++
  ☆103Updated 2 months ago
• rafacelente / bllama
  1.58-bit LLaMa model
  ☆83Updated last year
• glaive-ai / function-calling-server
  ☆36Updated last year
• argilla-io / awesome-llm-datasets
  👩🤝🤖 A curated list of datasets for large language models (LLMs), RLHF and related resources (continually updated)
  ☆24Updated 2 years ago
• exo-explore / mlx-bitnet
  1.58 Bit LLM on Apple Silicon using MLX
  ☆225Updated last year
• furiousteabag / vram-calculator
  Transformer GPU VRAM estimator
  ☆67Updated last year
• vikhyat / mixtral-inference
  inference code for mixtral-8x7b-32kseqlen
  ☆102Updated last year
• isEmmanuelOlowe / llm-cost-estimator
  Estimating hardware and cloud costs of LLMs and transformer projects
  ☆19Updated 4 months ago
• chai-research / chaiverse
  Chaiverse: the Chai AI developer platform.
  ☆191Updated last year
• QuixiAI / kraken
  ☆67Updated last year
• deepinfra / deepctl
  Command line tool for Deep Infra cloud ML inference service
  ☆33Updated last year
• normal-computing / extended-mind-transformers
  ☆123Updated last year
• Alignment-Lab-AI / AutoMaticAssistant
  ☆24Updated last year
• petals-infra / health.petals.dev
  🏥 Health monitor for a Petals swarm
  ☆39Updated last year
• gpu-mode / discord-cluster-manager
  Write a fast kernel and run it on Discord. See how you compare against the best!
  ☆58Updated 2 weeks ago
• xjdr-alt / llmri
  look how they massacred my boy
  ☆63Updated last year
• sshh12 / llm_optimize
  LLM Optimize is a proof-of-concept library for doing LLM (large language model) guided blackbox optimization.
  ☆58Updated 2 years ago
• zhudotexe / redel
  ReDel is a toolkit for researchers and developers to build, iterate on, and analyze recursive multi-agent systems. (EMNLP 2024 Demo)
  ☆88Updated last month
• METR / eval-analysis-public
  Public repository containing METR's DVC pipeline for eval data analysis
  ☆124Updated 6 months ago
• gregorycoppola / bayes-star
  Implementation
  ☆25Updated 7 months ago
• tensorwavecloud / ScalarLM
  ScalarLM - a unified training and inference stack
  ☆90Updated 3 weeks ago