AMD-AGI / AMD-LLMLinks
☆189Updated last year
Alternatives and similar repositories for AMD-LLM
Users that are interested in AMD-LLM are comparing it to the libraries listed below
Sorting:
- ☆196Updated 5 months ago
- Docker-based inference engine for AMD GPUs☆230Updated last year
- Code sample showing how to run and benchmark models on Qualcomm's Window PCs☆102Updated last year
- Run and explore Llama models locally with minimal dependencies on CPU☆189Updated last year
- Richard is gaining power☆197Updated 4 months ago
- Algebraic enhancements for GEMM & AI accelerators☆279Updated 7 months ago
- ☆126Updated 4 months ago
- Absolute minimalistic implementation of a GPT-like transformer using only numpy (<650 lines).☆254Updated last year
- This repo contains a new way to use bloom filters to do lossless video compression☆249Updated 4 months ago
- Neurox control helm chart details☆30Updated 5 months ago
- An implementation of bucketMul LLM inference☆223Updated last year
- Run larger LLMs with longer contexts on Apple Silicon by using differentiated precision for KV cache quantization. KVSplit enables 8-bit …☆360Updated 5 months ago
- Fully Open Language Models with Stellar Performance☆248Updated 2 months ago
- Felafax is building AI infra for non-NVIDIA GPUs☆568Updated 9 months ago
- Tensor library & inference framework for machine learning☆113Updated 2 weeks ago
- ☆248Updated last year
- Pytorch script hot swap: Change code without unloading your LLM from VRAM☆124Updated 6 months ago
- ☆234Updated 7 months ago
- High-Performance Implementation of OpenAI's TikToken.☆458Updated 3 months ago
- Dead Simple LLM Abliteration☆232Updated 8 months ago
- ☆163Updated last year
- ☆1,062Updated 5 months ago
- Mistral7B playing DOOM☆138Updated last year
- Heirarchical Navigable Small Worlds☆101Updated 2 months ago
- A GPU Accelerated Binary Vector Store☆47Updated 8 months ago
- Lamport's Bakery Algorithm Demonstrated in Python☆95Updated last year
- Bayesian Optimization as a Coverage Tool for Evaluating LLMs. Accurate evaluation (benchmarking) that's 10 times faster with just a few l…☆286Updated last month
- ☆162Updated 6 months ago
- ☆443Updated last month
- Proof of thought : LLM-based reasoning using Z3 theorem proving with multiple backend support (SMT2 and JSON DSL)☆342Updated this week