AMD-AIG-AIMA / AMD-LLMLinks
☆187Updated 9 months ago
Alternatives and similar repositories for AMD-LLM
Users that are interested in AMD-LLM are comparing it to the libraries listed below
Sorting:
- ☆192Updated 3 weeks ago
- Code sample showing how to run and benchmark models on Qualcomm's Window PCs☆97Updated 8 months ago
- Docker-based inference engine for AMD GPUs☆230Updated 7 months ago
- Run and explore Llama models locally with minimal dependencies on CPU☆189Updated 7 months ago
- An implementation of bucketMul LLM inference☆217Updated 11 months ago
- Algebraic enhancements for GEMM & AI accelerators☆276Updated 3 months ago
- Online compiler for HIP and NVIDIA® CUDA® code to WebGPU☆150Updated 4 months ago
- Run larger LLMs with longer contexts on Apple Silicon by using differentiated precision for KV cache quantization. KVSplit enables 8-bit …☆350Updated 2 weeks ago
- ☆163Updated last year
- Absolute minimalistic implementation of a GPT-like transformer using only numpy (<650 lines).☆251Updated last year
- A copy of ONNX models, datasets, and code all in one GitHub repository. Follow the README to learn more.☆105Updated last year
- Dead Simple LLM Abliteration☆218Updated 3 months ago
- Bayesian Optimization as a Coverage Tool for Evaluating LLMs. Accurate evaluation (benchmarking) that's 10 times faster with just a few l…☆284Updated last week
- Pytorch script hot swap: Change code without unloading your LLM from VRAM☆126Updated last month
- ☆243Updated last year
- ☆121Updated last week
- ☆228Updated this week
- Richard is gaining power☆187Updated 6 months ago
- minimal yet working VPN daemon for Linux☆106Updated last month
- Stateful load balancer custom-tailored for llama.cpp 🏓🦙☆764Updated last week
- Heirarchical Navigable Small Worlds☆96Updated last month
- Fully Open Language Models with Stellar Performance☆228Updated 3 weeks ago
- DiscoGrad - automatically differentiate across conditional branches in C++ programs☆202Updated 8 months ago
- ☆279Updated 5 months ago
- Implement recursion using English as the programming language and an LLM as the runtime.☆235Updated 2 years ago
- Live-bending a foundation model’s output at neural network level.☆254Updated last month
- ☆131Updated last month
- Official codebase for the paper "Beyond A* Better Planning with Transformers via Search Dynamics Bootstrapping".☆367Updated 11 months ago
- ☆159Updated 2 months ago
- Repository for the QUIK project, enabling the use of 4bit kernels for generative inference - EMNLP 2024☆182Updated last year