Alternatives and similar repositories for groqflow

Users that are interested in groqflow are comparing it to the libraries listed below

• serp-ai / Parameter-Efficient-MoE
  Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks
  ☆31Updated 11 months ago
• groq / mlagility
  Machine Learning Agility (MLAgility) benchmark and benchmarking tools
  ☆39Updated 2 months ago
• mistralai / vllm-release
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆52Updated last year
• deepsilicon / Sila
  ☆89Updated 7 months ago
• katsumiok / pyaskit
  AskIt: Unified programming interface for programming with LLMs (GPT-3.5, GPT-4, Gemini, Claude, Cohere, Llama 2)
  ☆79Updated 4 months ago
• mlc-ai / web-llm-assistant
  AI Assistant running within your browser.
  ☆65Updated 5 months ago
• EmbeddedLLM / vllm
  vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆86Updated this week
• rejunity / tiny-asic-1_58bit-matrix-mul
  Tiny ASIC implementation for "The Era of 1-bit LLMs All Large Language Models are in 1.58 Bits" matrix multiplication unit
  ☆145Updated last year
• rafacelente / bllama
  1.58-bit LLaMa model
  ☆81Updated last year
• catena-labs / moa-llm
  A Python library to orchestrate LLMs in a neural network-inspired structure
  ☆47Updated 7 months ago
• N8python / n8loom
  A tree-based prefix cache library that allows rapid creation of looms: hierarchal branching pathways of LLM generations.
  ☆68Updated 3 months ago
• RichardAragon / QGLS
  ☆33Updated 2 months ago
• mzbac / mlx_sharding
  Distributed Inference for mlx LLm
  ☆91Updated 9 months ago
• willccbb / mlx_parallm
  Fast parallel LLM inference for MLX
  ☆187Updated 10 months ago
• furiousteabag / vram-calculator
  Transformer GPU VRAM estimator
  ☆61Updated last year
• cognitivecomputations / kraken
  ☆66Updated 11 months ago
• facebookresearch / matrix
  Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…
  ☆33Updated this week
• evintunador / FractalFormer
  A GPT with self-similar nested properties
  ☆20Updated last year
• unslothai / llama.cpp
  LLM inference in C/C++
  ☆76Updated this week
• teknium1 / ShareGPT-Builder
  ☆113Updated 4 months ago
• sacha-ichbiah / outlines-mlx
  A fast minimalistic implementation of guided generation on Apple Silicon using Outlines and MLX
  ☆53Updated last year
• normal-computing / extended-mind-transformers
  ☆118Updated 9 months ago
• yandex-research / swarm
  Official code for "SWARM Parallelism: Training Large Models Can Be Surprisingly Communication-Efficient"
  ☆140Updated last year
• nicholasyager / llama-cpp-guidance
  A guidance compatibility layer for llama-cpp-python
  ☆34Updated last year
• skypilot-org / skypilot-tutorial
  Tutorial to get started with SkyPilot!
  ☆57Updated 11 months ago
• transformerlab / transformerlab-api
  API Server for Transformer Lab
  ☆61Updated this week
• teknium1 / RawTransform
  A repository of prompts and Python scripts for intelligent transformation of raw text into diverse formats.
  ☆30Updated last year
• gpu-mode / discord-cluster-manager
  Write a fast kernel and run it on Discord. See how you compare against the best!
  ☆44Updated last week
• blackhole89 / autopen
  Editor with LLM generation tree exploration
  ☆66Updated 3 months ago
• LaurieWired / BenchmarkCustomPTX
  Custom PTX Instruction Benchmark
  ☆123Updated 2 months ago