Foreseerr / TScaleLinks
☆200Updated 9 months ago
Alternatives and similar repositories for TScale
Users that are interested in TScale are comparing it to the libraries listed below
Sorting:
- Docker-based inference engine for AMD GPUs☆231Updated last year
- This repo contains a new way to use bloom filters to do lossless video compression☆250Updated 8 months ago
- Run larger LLMs with longer contexts on Apple Silicon by using differentiated precision for KV cache quantization. KVSplit enables 8-bit …☆363Updated 8 months ago
- High-Performance Implementation of OpenAI's TikToken.☆467Updated 7 months ago
- ☆135Updated 5 months ago
- ☆191Updated last year
- Run and explore Llama models locally with minimal dependencies on CPU☆190Updated last year
- Heirarchical Navigable Small Worlds☆101Updated 5 months ago
- A GPU Accelerated Binary Vector Store☆47Updated 11 months ago
- Code sample showing how to run and benchmark models on Qualcomm's Window PCs☆104Updated last year
- Persistent memory for LLMs and apps. Content-addressed storage with dedupe, compression, full-text and vector search.☆363Updated last week
- Multimodal RAG to search and interact locally with technical documents of any kind☆284Updated 2 weeks ago
- Proof of thought : LLM-based reasoning using Z3 theorem proving with multiple backend support (SMT2 and JSON DSL)☆364Updated 3 months ago
- Dead Simple LLM Abliteration☆248Updated 11 months ago
- This is a python implementation for stitching images.☆231Updated last year
- Tensor library & inference framework for machine learning☆117Updated 4 months ago
- ☆164Updated 10 months ago
- Neurox control helm chart details☆30Updated 9 months ago
- ☆289Updated last week
- A copy of ONNX models, datasets, and code all in one GitHub repository. Follow the README to learn more.☆105Updated 2 years ago
- Advanced Python Function Debugging with MCP Integration.☆58Updated 7 months ago
- minimal yet working VPN daemon for Linux☆106Updated 5 months ago
- RAG Logger is an open-source logging tool designed specifically for Retrieval-Augmented Generation (RAG) applications. It serves as a lig…☆227Updated last year
- A collection of fluid simulations☆59Updated 4 months ago
- Pytorch script hot swap: Change code without unloading your LLM from VRAM☆125Updated 9 months ago
- Merliot Device Hub☆166Updated 7 months ago
- This project visualizes 100,000 real galaxies in blue and 100,000 randomly distributed galaxies in red. The data is sourced from the GPU …☆90Updated this week
- This project collects GPU benchmarks from various cloud providers and compares them to fixed per token costs. Use our tool for efficient …☆223Updated last year
- ☆126Updated 8 months ago
- Live-bending a foundation model’s output at neural network level.☆273Updated 10 months ago