groq / groqflowLinks
GroqFlow provides an automated tool flow for compiling machine learning and linear algebra workloads into Groq programs and executing those programs on GroqChip™ processors.
☆114Updated 3 months ago
Alternatives and similar repositories for groqflow
Users that are interested in groqflow are comparing it to the libraries listed below
Sorting:
- Machine Learning Agility (MLAgility) benchmark and benchmarking tools☆40Updated 3 months ago
- Tutorial to get started with SkyPilot!☆57Updated last year
- Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks☆31Updated last year
- ☆89Updated last year
- A high-throughput and memory-efficient inference and serving engine for LLMs☆52Updated last year
- Command line tool for Deep Infra cloud ML inference service☆33Updated last year
- ☆36Updated last year
- LMQL implementation of tree of thoughts☆34Updated last year
- A fast minimalistic implementation of guided generation on Apple Silicon using Outlines and MLX☆57Updated last year
- Fast parallel LLM inference for MLX☆224Updated last year
- ☆112Updated last year
- ☆120Updated last year
- look how they massacred my boy☆63Updated last year
- ReDel is a toolkit for researchers and developers to build, iterate on, and analyze recursive multi-agent systems. (EMNLP 2024 Demo)☆88Updated this week
- ☆123Updated last year
- ☆67Updated last year
- 1.58-bit LLaMa model☆83Updated last year
- Formal-LLM: Integrating Formal Language and Natural Language for Controllable LLM-based Agents☆128Updated last year
- inference code for mixtral-8x7b-32kseqlen☆102Updated last year
- ☆116Updated 10 months ago
- Deploy your autonomous agents to production grade environments with 99% Uptime Guarantee, Infinite Scalability, and self-healing.☆47Updated 2 weeks ago
- vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs☆90Updated this week
- ☆63Updated 10 months ago
- Roy: A lightweight, model-agnostic framework for crafting advanced multi-agent systems using large language models.☆79Updated 2 years ago
- 🏥 Health monitor for a Petals swarm☆39Updated last year
- ☆163Updated 8 months ago
- An NVIDIA AI Workbench example project for fine-tuning a Mistral 7B model☆63Updated last year
- ☆141Updated last year
- Turing machines, Rule 110, and A::B reversal using Claude 3 Opus.☆58Updated last year
- This repository explains and provides examples for "concept anchoring" in GPT4.☆71Updated last year