slashml / amd_inferenceLinks
Docker-based inference engine for AMD GPUs
☆231Updated last year
Alternatives and similar repositories for amd_inference
Users that are interested in amd_inference are comparing it to the libraries listed below
Sorting:
- Run and explore Llama models locally with minimal dependencies on CPU☆190Updated last year
- ☆200Updated 9 months ago
- Examples and guides for using the VLM Run API☆305Updated last week
- A monitoring station for carnivorous flora.☆129Updated 8 months ago
- This is a python implementation for stitching images.☆231Updated last year
- ☆163Updated 10 months ago
- Run larger LLMs with longer contexts on Apple Silicon by using differentiated precision for KV cache quantization. KVSplit enables 8-bit …☆363Updated 8 months ago
- Documentation and code for Hack the MontyHome device for extended applications.☆233Updated 7 months ago
- ☆279Updated 8 months ago
- ☆154Updated last year
- Code sample showing how to run and benchmark models on Qualcomm's Window PCs☆104Updated last year
- Generate Cool-Looking Mazes and Animations Illustrating the A* Pathfinding Algorithm☆176Updated 11 months ago
- A clock that let's you understand if you should have another cup of coffee. It calculates the half-life your caffeine level as you metabo…☆220Updated last year
- CLI app- Give it a YouTube URL and you get a transcription with possible speaker identification and optional summary or translation, all …☆330Updated last month
- High-Performance Implementation of OpenAI's TikToken.☆467Updated 7 months ago
- A copy of ONNX models, datasets, and code all in one GitHub repository. Follow the README to learn more.☆105Updated 2 years ago
- Proof of thought : LLM-based reasoning using Z3 theorem proving with multiple backend support (SMT2 and JSON DSL)☆364Updated 3 months ago
- ☆191Updated last year
- Dead Simple LLM Abliteration☆248Updated 11 months ago
- ai for jq☆249Updated last year
- This project collects GPU benchmarks from various cloud providers and compares them to fixed per token costs. Use our tool for efficient …☆223Updated last year
- This repo contains a new way to use bloom filters to do lossless video compression☆250Updated 8 months ago
- ☆96Updated last year
- vtc: Video Traffic Counter☆60Updated last year
- browser plugin to send youtube, insta (all social videos) to local backend and process audio and video in all sorts of ways.☆248Updated 5 months ago
- Advanced Python Function Debugging with MCP Integration.☆58Updated 7 months ago
- Lamport's Bakery Algorithm Demonstrated in Python☆95Updated 2 years ago
- LLM-generated real-time commentary for Pong☆151Updated 9 months ago
- Sequential Logic☆114Updated 2 weeks ago
- ✨ rudimentary simulation of the three-body problem☆159Updated last year