slashml / amd_inferenceLinks
Docker-based inference engine for AMD GPUs
☆231Updated 9 months ago
Alternatives and similar repositories for amd_inference
Users that are interested in amd_inference are comparing it to the libraries listed below
Sorting:
- Run and explore Llama models locally with minimal dependencies on CPU☆191Updated 9 months ago
- ☆196Updated 2 months ago
- Run larger LLMs with longer contexts on Apple Silicon by using differentiated precision for KV cache quantization. KVSplit enables 8-bit …☆356Updated 2 months ago
- ☆164Updated 4 months ago
- High-Performance Implementation of OpenAI's TikToken.☆440Updated last month
- A monitoring station for carnivorous flora.☆131Updated 2 months ago
- Examples and guides for using the VLM Run API☆286Updated 3 weeks ago
- Documentation and code for Hack the MontyHome device for extended applications.☆232Updated last month
- A copy of ONNX models, datasets, and code all in one GitHub repository. Follow the README to learn more.☆105Updated last year
- browser plugin to send youtube videos to local backend☆159Updated this week
- Dead Simple LLM Abliteration☆228Updated 5 months ago
- ☆278Updated last month
- This is a python implementation for stitching images.☆232Updated 10 months ago
- This project collects GPU benchmarks from various cloud providers and compares them to fixed per token costs. Use our tool for efficient …☆221Updated 7 months ago
- TUI app- Give it a YouTube URL and you get a transcription with possible speaker identification and optional summary or translation, all …☆297Updated 4 months ago
- Generate Cool-Looking Mazes and Animations Illustrating the A* Pathfinding Algorithm☆177Updated 5 months ago
- fractal-structure inspired, parent-children orbiting, zooming-elements based interactive graph visualization user interface☆131Updated 5 months ago
- ☆188Updated 11 months ago
- ☆124Updated 2 months ago
- ☆157Updated 9 months ago
- This repo contains a new way to use bloom filters to do lossless video compression☆247Updated last month
- Code sample showing how to run and benchmark models on Qualcomm's Window PCs☆100Updated 10 months ago
- vtc: Video Traffic Counter☆60Updated 8 months ago
- ai for jq☆243Updated 10 months ago
- ☆96Updated 9 months ago
- A hub for various industry-specific schemas to be used with VLMs.☆528Updated 2 months ago
- A clock that let's you understand if you should have another cup of coffee. It calculates the half-life your caffeine level as you metabo…☆219Updated 9 months ago
- Optimally allocate poker chips using constrained, nonlinear optimization☆175Updated 7 months ago
- Homemade automated solar concentrator 🔧 ☀️ 🔎☆356Updated 10 months ago
- Build an AI Telephony Agent for Inbound and Outbound Calls☆76Updated last month