Alternatives and similar repositories for groqflow

Users that are interested in groqflow are comparing it to the libraries listed below

• groq / mlagility
  Machine Learning Agility (MLAgility) benchmark and benchmarking tools
  ☆39Updated 3 weeks ago
• facebookresearch / matrix
  Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…
  ☆60Updated last week
• serp-ai / Parameter-Efficient-MoE
  Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks
  ☆31Updated last year
• EmbeddedLLM / vllm
  vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆86Updated this week
• deepsilicon / Sila
  ☆89Updated 8 months ago
• LachlanGray / lmql-tree-of-thoughts
  LMQL implementation of tree of thoughts
  ☆34Updated last year
• skypilot-org / skypilot-tutorial
  Tutorial to get started with SkyPilot!
  ☆57Updated last year
• gpu-mode / discord-cluster-manager
  Write a fast kernel and run it on Discord. See how you compare against the best!
  ☆44Updated this week
• vikhyat / mixtral-inference
  inference code for mixtral-8x7b-32kseqlen
  ☆100Updated last year
• 4dh / GRDN
  GRDN.AI app for garden optimization
  ☆70Updated last year
• katsumiok / pyaskit
  AskIt: Unified programming interface for programming with LLMs (GPT-3.5, GPT-4, Gemini, Claude, Cohere, Llama 2)
  ☆78Updated 4 months ago
• nicholasyager / llama-cpp-guidance
  A guidance compatibility layer for llama-cpp-python
  ☆34Updated last year
• ScalingIntelligence / good-kernels
  Samples of good AI generated CUDA kernels
  ☆65Updated last week
• LLMSELECTOR / LLMSELECTOR
  ☆68Updated 3 months ago
• deepinfra / deepctl
  Command line tool for Deep Infra cloud ML inference service
  ☆30Updated 11 months ago
• mlc-ai / web-llm-assistant
  AI Assistant running within your browser.
  ☆67Updated 6 months ago
• N8python / n8loom
  A tree-based prefix cache library that allows rapid creation of looms: hierarchal branching pathways of LLM generations.
  ☆69Updated 3 months ago
• unslothai / llama.cpp
  LLM inference in C/C++
  ☆77Updated 3 weeks ago
• rafacelente / bllama
  1.58-bit LLaMa model
  ☆81Updated last year
• emrgnt-cmplxty / zero-shot-replication
  ☆72Updated last year
• abacusai / gh200-llm
  Docker image NVIDIA GH200 machines - optimized for vllm serving and hf trainer finetuning
  ☆42Updated 3 months ago
• omegalabsinc / omegalabs-anytoany-bittensor
  Making the world's first and smartest opensource any-to-any AGI system
  ☆41Updated this week
• sacha-ichbiah / outlines-mlx
  A fast minimalistic implementation of guided generation on Apple Silicon using Outlines and MLX
  ☆53Updated last year
• Alignment-Lab-AI / KnowledgeBase
  never forget anything again! combine AI and intelligent tooling for a local knowledge base to track catalogue, annotate, and plan for you…
  ☆37Updated last year
• SpellcraftAI / turing
  Turing machines, Rule 110, and A::B reversal using Claude 3 Opus.
  ☆59Updated last year
• PrimeIntellect-ai / prime-vllm
  Modded vLLM to run pipeline parallelism over public networks
  ☆35Updated 2 weeks ago
• Jaykef / mlx-rag-gguf
  Minimal, clean code implementation of RAG with mlx using gguf model weights
  ☆50Updated last year
• furiousteabag / vram-calculator
  Transformer GPU VRAM estimator
  ☆64Updated last year
• stanford-futuredata / Megatron-LM
  Ongoing research training transformer models at scale
  ☆37Updated last year
• cray-lm / cray-lm
  Cray-LM unified training and inference stack.
  ☆22Updated 4 months ago