Foreseerr / TScaleLinks
☆196Updated 2 months ago
Alternatives and similar repositories for TScale
Users that are interested in TScale are comparing it to the libraries listed below
Sorting:
- Docker-based inference engine for AMD GPUs☆231Updated 9 months ago
- This repo contains a new way to use bloom filters to do lossless video compression☆247Updated last month
- High-Performance Implementation of OpenAI's TikToken.☆440Updated 3 weeks ago
- Run larger LLMs with longer contexts on Apple Silicon by using differentiated precision for KV cache quantization. KVSplit enables 8-bit …☆356Updated 2 months ago
- ☆133Updated 3 months ago
- Run and explore Llama models locally with minimal dependencies on CPU☆191Updated 9 months ago
- Heirarchical Navigable Small Worlds☆98Updated 3 months ago
- Code sample showing how to run and benchmark models on Qualcomm's Window PCs☆100Updated 9 months ago
- A GPU Accelerated Binary Vector Store☆47Updated 5 months ago
- Dead Simple LLM Abliteration☆228Updated 5 months ago
- ☆188Updated 11 months ago
- A copy of ONNX models, datasets, and code all in one GitHub repository. Follow the README to learn more.☆105Updated last year
- This is a python implementation for stitching images.☆232Updated 10 months ago
- Tensor library & inference framework for machine learning☆103Updated 2 weeks ago
- ☆124Updated 2 months ago
- RAG Logger is an open-source logging tool designed specifically for Retrieval-Augmented Generation (RAG) applications. It serves as a lig…☆224Updated 7 months ago
- Pytorch script hot swap: Change code without unloading your LLM from VRAM☆126Updated 3 months ago
- Animating R1's thoughts.☆383Updated 5 months ago
- fractal-structure inspired, parent-children orbiting, zooming-elements based interactive graph visualization user interface☆131Updated 5 months ago
- TUI app- Give it a YouTube URL and you get a transcription with possible speaker identification and optional summary or translation, all …☆297Updated 4 months ago
- minimal yet working VPN daemon for Linux☆106Updated last week
- Merliot Device Hub☆161Updated last month
- Live-bending a foundation model’s output at neural network level.☆265Updated 3 months ago
- ☆164Updated 4 months ago
- ☆220Updated 4 months ago
- DiscoGrad - automatically differentiate across conditional branches in C++ programs☆204Updated 10 months ago
- Implement recursion using English as the programming language and an LLM as the runtime.☆239Updated 2 years ago
- state of the art browsing agent (WebArena 72.7%)☆226Updated this week
- WIP: Next-gen network protocol for reliable data transfer in lossy environments. Outperforms TCP/UDP in high packet loss scenarios.☆310Updated 10 months ago
- This project collects GPU benchmarks from various cloud providers and compares them to fixed per token costs. Use our tool for efficient …☆221Updated 7 months ago