AMD-AIG-AIMA / AMD-LLMLinks
☆187Updated 11 months ago
Alternatives and similar repositories for AMD-LLM
Users that are interested in AMD-LLM are comparing it to the libraries listed below
Sorting:
- Docker-based inference engine for AMD GPUs☆231Updated 10 months ago
- ☆197Updated 3 months ago
- Code sample showing how to run and benchmark models on Qualcomm's Window PCs☆101Updated 10 months ago
- Run and explore Llama models locally with minimal dependencies on CPU☆191Updated 10 months ago
- Algebraic enhancements for GEMM & AI accelerators☆278Updated 5 months ago
- Richard is gaining power☆194Updated 2 months ago
- Absolute minimalistic implementation of a GPT-like transformer using only numpy (<650 lines).☆253Updated last year
- This repo contains a new way to use bloom filters to do lossless video compression☆248Updated 2 months ago
- A GPU Accelerated Binary Vector Store☆47Updated 6 months ago
- Ultra-lightweight AI Agent☆250Updated this week
- Run larger LLMs with longer contexts on Apple Silicon by using differentiated precision for KV cache quantization. KVSplit enables 8-bit …☆356Updated 3 months ago
- ☆126Updated 3 months ago
- Neurox control helm chart details☆30Updated 3 months ago
- Dead Simple LLM Abliteration☆231Updated 6 months ago
- Heirarchical Navigable Small Worlds☆101Updated 2 weeks ago
- ☆249Updated last year
- A CLI to manage install and configure llama inference implemenation in multiple languages☆67Updated last year
- Pytorch script hot swap: Change code without unloading your LLM from VRAM☆126Updated 4 months ago
- A copy of ONNX models, datasets, and code all in one GitHub repository. Follow the README to learn more.☆105Updated last year
- Fully Open Language Models with Stellar Performance☆243Updated 3 weeks ago
- An implementation of bucketMul LLM inference☆223Updated last year
- ☆163Updated last year
- High-Performance Implementation of OpenAI's TikToken.☆445Updated last month
- Animating R1's thoughts.☆384Updated 6 months ago
- Mistral7B playing DOOM☆135Updated last year
- ☆164Updated 5 months ago
- Live-bending a foundation model’s output at neural network level.☆266Updated 4 months ago
- Bayesian Optimization as a Coverage Tool for Evaluating LLMs. Accurate evaluation (benchmarking) that's 10 times faster with just a few l…☆286Updated 3 weeks ago
- throwaway GPT inference☆140Updated last year
- fractal-structure inspired, parent-children orbiting, zooming-elements based interactive graph visualization user interface☆130Updated 5 months ago