Alternatives and similar repositories for groqflow

Users that are interested in groqflow are comparing it to the libraries listed below

• deepsilicon / Sila
  ☆89Updated 11 months ago
• skypilot-org / skypilot-tutorial
  Tutorial to get started with SkyPilot!
  ☆58Updated last year
• rafacelente / bllama
  1.58-bit LLaMa model
  ☆82Updated last year
• groq / mlagility
  Machine Learning Agility (MLAgility) benchmark and benchmarking tools
  ☆39Updated last month
• NousResearch / finetuning-subnet
  ☆121Updated last year
• mistralai / vllm-release
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆52Updated last year
• katsumiok / pyaskit
  AskIt: Unified programming interface for programming with LLMs (GPT-3.5, GPT-4, Gemini, Claude, Cohere, Llama 2)
  ☆79Updated 8 months ago
• normal-computing / extended-mind-transformers
  ☆123Updated last year
• teknium1 / ShareGPT-Builder
  ☆116Updated 9 months ago
• xjdr-alt / llmri
  look how they massacred my boy
  ☆64Updated 11 months ago
• PrimeIntellect-ai / prime-cli
  The Prime Intellect CLI provides a powerful command-line interface for managing GPU resources across various providers
  ☆84Updated this week
• serp-ai / Parameter-Efficient-MoE
  Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks
  ☆31Updated last year
• catena-labs / moa-llm
  A Python library to orchestrate LLMs in a neural network-inspired structure
  ☆50Updated 11 months ago
• vikhyat / mixtral-inference
  inference code for mixtral-8x7b-32kseqlen
  ☆101Updated last year
• petals-infra / health.petals.dev
  🏥 Health monitor for a Petals swarm
  ☆39Updated last year
• EmbeddedLLM / vllm
  vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆89Updated this week
• Datura-ai / cortex.t
  ☆63Updated 8 months ago
• kenshin9000 / ConceptARC-Representations
  This repository explains and provides examples for "concept anchoring" in GPT4.
  ☆71Updated last year
• teknium1 / RawTransform
  A repository of prompts and Python scripts for intelligent transformation of raw text into diverse formats.
  ☆30Updated 2 years ago
• yandex-research / swarm
  Official code for "SWARM Parallelism: Training Large Models Can Be Surprisingly Communication-Efficient"
  ☆143Updated last year
• glaive-ai / function-calling-server
  ☆36Updated last year
• isEmmanuelOlowe / llm-cost-estimator
  Estimating hardware and cloud costs of LLMs and transformer projects
  ☆18Updated 2 months ago
• exo-explore / mlx-bitnet
  1.58 Bit LLM on Apple Silicon using MLX
  ☆223Updated last year
• sacha-ichbiah / outlines-mlx
  A fast minimalistic implementation of guided generation on Apple Silicon using Outlines and MLX
  ☆56Updated last year
• Alignment-Lab-AI / KnowledgeBase
  never forget anything again! combine AI and intelligent tooling for a local knowledge base to track catalogue, annotate, and plan for you…
  ☆39Updated last year
• SpellcraftAI / turing
  Turing machines, Rule 110, and A::B reversal using Claude 3 Opus.
  ☆58Updated last year
• furiousteabag / vram-calculator
  Transformer GPU VRAM estimator
  ☆66Updated last year
• tenstorrent / tt-buda-demos
  Repository of model demos using TT-Buda
  ☆62Updated 5 months ago
• willccbb / mlx_parallm
  Fast parallel LLM inference for MLX
  ☆217Updated last year
• PrimeIntellect-ai / pccl
  PCCL (Prime Collective Communications Library) implements fault tolerant collective communications over IP
  ☆120Updated last week