slashml / amd_inferenceLinks
Docker-based inference engine for AMD GPUs
☆231Updated 9 months ago
Alternatives and similar repositories for amd_inference
Users that are interested in amd_inference are comparing it to the libraries listed below
Sorting:
- Run and explore Llama models locally with minimal dependencies on CPU☆191Updated 9 months ago
- ☆196Updated 2 months ago
- A monitoring station for carnivorous flora.☆131Updated 2 months ago
- Dead Simple LLM Abliteration☆222Updated 4 months ago
- A clock that let's you understand if you should have another cup of coffee. It calculates the half-life your caffeine level as you metabo…☆219Updated 8 months ago
- Run larger LLMs with longer contexts on Apple Silicon by using differentiated precision for KV cache quantization. KVSplit enables 8-bit …☆356Updated last month
- This is a python implementation for stitching images.☆232Updated 9 months ago
- ☆163Updated 3 months ago
- ☆188Updated 10 months ago
- High-Performance Implementation of OpenAI's TikToken.☆432Updated last week
- Generate Cool-Looking Mazes and Animations Illustrating the A* Pathfinding Algorithm☆177Updated 4 months ago
- ☆96Updated 8 months ago
- Code sample showing how to run and benchmark models on Qualcomm's Window PCs☆100Updated 9 months ago
- ☆278Updated last month
- A copy of ONNX models, datasets, and code all in one GitHub repository. Follow the README to learn more.☆105Updated last year
- ☆123Updated last month
- Documentation and code for Hack the MontyHome device for extended applications.☆231Updated 3 weeks ago
- Examples and guides for using the VLM Run API☆281Updated last week
- fractal-structure inspired, parent-children orbiting, zooming-elements based interactive graph visualization user interface☆131Updated 4 months ago
- MCP server and CLI tool for searching and downloading documents from Anna's Archive☆281Updated this week
- This project collects GPU benchmarks from various cloud providers and compares them to fixed per token costs. Use our tool for efficient …☆221Updated 7 months ago
- Optimally allocate poker chips using constrained, nonlinear optimization☆174Updated 7 months ago
- LLM-generated real-time commentary for Pong☆152Updated 2 months ago
- This repo contains a new way to use bloom filters to do lossless video compression☆245Updated last month
- Connect to remote ffmpeg servers☆336Updated 3 months ago
- dead mans switch without reliance on your system, infra, or application☆318Updated last week
- Homemade automated solar concentrator 🔧 ☀️ 🔎☆356Updated 9 months ago
- Lamport's Bakery Algorithm Demonstrated in Python☆96Updated last year
- vtc: Video Traffic Counter☆60Updated 7 months ago
- A comprehensive suite of tools, built to liberate science by making the creation, evaluation, and dissemination of research more transpar…☆199Updated last month