Dynamic per-token early exit for LLM inference. Skip layers tokens don't need
☆33Mar 18, 2026Updated 5 months ago
Alternatives and similar repositories for TIDE
Users that are interested in TIDE are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Ultra-low-latency, high-throughput multiprocess transport over SHM and mmap. LMAX-Disruptor-style cross-process ring substrate.☆20Aug 6, 2026Updated last month
- Benchmarking Intelligence Efficiency of LM Inference☆87Updated this week
- Convergence assistant for knowledge corpora☆17Aug 15, 2026Updated 3 weeks ago
- SGLang kernel library for Intel XPU☆34Updated this week
- Rust TUI for the Lelit Mara espresso machine — runs on ESP32, streams telemetry to MQTT, built with Ratatui☆27Jun 28, 2026Updated 2 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Sequential Monte Carlo Speculative Decoding☆52Aug 25, 2026Updated 2 weeks ago
- Zoof is a high-efficiency Small Language Model (SLM) engineered from scratch. It demonstrates how modern architectural choices and high-q…☆47Jan 13, 2026Updated 7 months ago
- Full-stack Amazon India-inspired e-commerce clone built with Next.js, TypeScript, Prisma, MongoDB, and Stripe.☆22Sep 2, 2026Updated last week
- DashAttention: Differentiable and Adaptive Sparse Hierarchical Attention☆23May 25, 2026Updated 3 months ago
- AnyDSL traversal code☆16Feb 18, 2019Updated 7 years ago
- Autoresearch for GPU kernels. Give it any PyTorch model, go to sleep, wake up to optimized Triton kernels.☆1,555Mar 19, 2026Updated 5 months ago
- Distributed machine learning platform☆13Aug 20, 2015Updated 11 years ago
- [ICLR2026] Catching the Details: Self-Distilled RoI Predictors for Fine-Grained MLLM Perception☆18Jan 26, 2026Updated 7 months ago
- Kakao Mobility MCP Server for directions and transit information☆11Sep 14, 2025Updated 11 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Using YouTube to prepare a speech recognition dataset for any language☆10Mar 30, 2021Updated 5 years ago
- ☆14Nov 15, 2022Updated 3 years ago
- ☆15Jul 13, 2026Updated last month
- Self-contained Python lib with zero-dependencies that give you a unified device properties for gpu, cpu, and npu. No more calling separat…☆16Aug 23, 2026Updated 3 weeks ago
- A Python DSL to write Nvidia PTX for Hopper and Blackwell in JAX and PyTorch☆382Jul 9, 2026Updated 2 months ago
- Complete solution to enable RDMA (on both InfiniBand and RoCE) and accelerate TCP to bare metal performance on Kubernetes☆11Aug 1, 2018Updated 8 years ago
- Example implementation of Iteration of Tought - Gives a star if you like the project☆41Dec 24, 2024Updated last year
- My collection of dotfiles☆14Apr 22, 2026Updated 4 months ago
- A PyTorch implementation of "Self-Supervised GNN that Jointly Learns to Augment" or "Jointly Learnable Data Augmentations for Self-Superv…☆13Dec 13, 2021Updated 4 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Large language model of Medical AI, General Medical AI (GMAI)☆17Jan 30, 2024Updated 2 years ago
- Implemention based on lightrag and nano-graphrag to connect with psql☆15Oct 28, 2024Updated last year
- This project shows how to build a simple handwriting recognizer in Keras with the IAM dataset.☆13Aug 15, 2021Updated 5 years ago
- [WACV 2024] Enhancing Multimodal Compositional Reasoning of Visual Language Models with Generative Negative Mining, WACV 2024☆13Jan 3, 2024Updated 2 years ago
- Alphabot: a screen-less interactive spelling primer powered by computer vision☆14Sep 11, 2018Updated 8 years ago
- An android VoIP application using native SIP API & ConnectionService (CallKit in iOS) API☆10Mar 13, 2020Updated 6 years ago
- minimal Energy-based transformer☆44Dec 11, 2025Updated 9 months ago
- Text Classification Dataset for Turkish Language☆10Nov 16, 2021Updated 4 years ago
- Alleycat plugin by devttys0, ported to IDA 8☆10Jan 15, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- bddem is a SWI-Prolog pack for using Binary Decision Diagrams☆13Aug 30, 2026Updated 2 weeks ago
- An unofficial implementation of SOLAR-10.7B model and the newly proposed interlocked-DUS(iDUS) implementation and experiment details.☆14Mar 20, 2024Updated 2 years ago
- ☆10Sep 1, 2020Updated 6 years ago
- Row-wise block scaling for fp8 quantization matrix multiplication. Solution to GPU mode AMD challenge.☆19Feb 9, 2026Updated 7 months ago
- Example OCaml library written using Rust and ocaml-rs☆17Mar 10, 2021Updated 5 years ago
- initial☆10Dec 10, 2024Updated last year
- A relational logic programming language embedded in Rust.☆12Aug 15, 2025Updated last year