slashml / amd_inferenceLinks
Docker-based inference engine for AMD GPUs
☆231Updated last year
Alternatives and similar repositories for amd_inference
Users that are interested in amd_inference are comparing it to the libraries listed below
Sorting:
- Run and explore Llama models locally with minimal dependencies on CPU☆190Updated last year
- ☆200Updated 8 months ago
- A monitoring station for carnivorous flora.☆128Updated 8 months ago
- Dead Simple LLM Abliteration☆248Updated 11 months ago
- This is a python implementation for stitching images.☆231Updated last year
- ☆279Updated 7 months ago
- browser plugin to send youtube, insta (all social videos) to local backend and process audio and video in all sorts of ways.☆248Updated 5 months ago
- Generate Cool-Looking Mazes and Animations Illustrating the A* Pathfinding Algorithm☆176Updated 11 months ago
- A clock that let's you understand if you should have another cup of coffee. It calculates the half-life your caffeine level as you metabo…☆220Updated last year
- Documentation and code for Hack the MontyHome device for extended applications.☆233Updated 7 months ago
- ☆164Updated 10 months ago
- ☆191Updated last year
- CLI app- Give it a YouTube URL and you get a transcription with possible speaker identification and optional summary or translation, all …☆330Updated last month
- Optimally allocate poker chips using constrained, nonlinear optimization☆175Updated last year
- This project collects GPU benchmarks from various cloud providers and compares them to fixed per token costs. Use our tool for efficient …☆222Updated last year
- Run larger LLMs with longer contexts on Apple Silicon by using differentiated precision for KV cache quantization. KVSplit enables 8-bit …☆363Updated 8 months ago
- High-Performance Implementation of OpenAI's TikToken.☆467Updated 7 months ago
- Examples and guides for using the VLM Run API☆305Updated last week
- Code sample showing how to run and benchmark models on Qualcomm's Window PCs☆104Updated last year
- A copy of ONNX models, datasets, and code all in one GitHub repository. Follow the README to learn more.☆105Updated 2 years ago
- ☆154Updated last year
- This repo contains a new way to use bloom filters to do lossless video compression☆250Updated 7 months ago
- Proof of thought : LLM-based reasoning using Z3 theorem proving with multiple backend support (SMT2 and JSON DSL)☆362Updated 3 months ago
- ☆96Updated last year
- WIP: Next-gen network protocol for reliable data transfer in lossy environments. Outperforms TCP/UDP in high packet loss scenarios.☆305Updated last year
- A hub for various industry-specific schemas to be used with VLMs.☆540Updated last month
- minimal yet working VPN daemon for Linux☆106Updated 5 months ago
- ☆126Updated 8 months ago
- vtc: Video Traffic Counter☆60Updated last year
- Homemade automated solar concentrator 🔧 ☀️ 🔎☆355Updated last year