a guide to learn and implement inference techniques from scratch
☆14Jun 18, 2026Updated 4 months ago
Alternatives and similar repositories for llm-inference-techniques
Users that are interested in llm-inference-techniques are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A hardware hybrid scheduling tensor engine. Improves performace by 35% for medium workload compared to pure GPU.☆13Jun 22, 2026Updated 4 months ago
- a minimal paged attention implementation☆20Jan 30, 2026Updated 9 months ago
- writing really fast kernels☆24Updated this week
- a LLM inference engine to run on consumer hardware☆49Apr 15, 2026Updated 6 months ago
- a simple c++ inference engine for gpt based architecture☆41Dec 10, 2025Updated 10 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- serving a torch model using Celery, Redis and RabbitMQ to serve users asynchronously☆25Jan 21, 2024Updated 2 years ago
- Implementation of the models described in "Cancer detection in breast MRI screening via explainable artificial intelligence anomaly detec…☆14Updated this week
- LLM that can be trained on 1 or more GPUs for research.☆59Jul 8, 2026Updated 3 months ago
- En este repositorio se presentan lecciones de Python para hacer estadística☆26Apr 18, 2025Updated last year
- RAG with knowledge graphs implemented from scratch☆38Jan 7, 2024Updated 2 years ago
- Solutions to LeetCode Problems in Java, Python, Go, Rust, and TypeScript☆11Feb 8, 2026Updated 8 months ago
- Anor Londo Lighting Fix v1.1 – Enhances Anor Londo’s lighting by restoring missing light sources, improving shadows, and balancing bright…☆14Aug 11, 2025Updated last year
- ☆27Jun 7, 2026Updated 4 months ago
- ☆14Jan 13, 2026Updated 9 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A high-performance, multithreaded subdomain enumerator written in Julia, leveraging crt.sh for rapid reconnaissance with built-in Docker …☆10Sep 8, 2025Updated last year
- Automate handsearching and citation searching for your systematic reviews.☆13Jan 25, 2025Updated last year
- A small, readable PyTorch inference engine for Qwen3-4B with continuous batching, native paged attention, prefix caching, and an OpenAI-c…☆18Oct 24, 2026Updated last week
- ☆13Jul 12, 2026Updated 3 months ago
- Official code for the transformer LLM experiments in the paper [Evolution Strategies at the Hyperscale](https://arxiv.org/abs/2511.16652)…☆16Apr 14, 2026Updated 6 months ago
- Código de @jyts__ para hacer el web scrapping de las estadísticas de los últimos partidos de selecciones, ajustar un modelo XGBoost para …☆42Jun 29, 2026Updated 4 months ago
- ☆22Jan 29, 2026Updated 9 months ago
- Implementation of Lift4d, Harmonizing Single-View 3D Estimation for 4D Reconstruction In-the-Wild, from Litman et al. of Carnegie Mellon☆15Jun 24, 2026Updated 4 months ago
- Optimizing diffusion for production-ready speeds☆41Jan 10, 2026Updated 9 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- A curated list of research papers, experiments, and resources related to LLM security and alignment.☆14Sep 13, 2026Updated last month
- A Desktop Markdown based notetaking app☆12Mar 21, 2024Updated 2 years ago
- a smol raycaster engine in c++☆10Mar 11, 2026Updated 7 months ago
- ☆16Aug 6, 2026Updated 2 months ago
- Lets build a Deep Learning Framework!☆32Oct 27, 2026Updated last week
- ☆11Oct 15, 2025Updated last year
- Forza Horizon 4 patches for mac. Only offline play available as of now with minor graphical bugs.☆17Updated this week
- Library for Auditing and Repairing Safety Drift in Fine-Tuned LLMs☆20Updated this week
- A simple, thread safe & stop-the-world, Mark & Sweep Garbage Collector. Written in C++.☆10Feb 19, 2026Updated 8 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Block-R1: Multi-domain RL Post-training Benchmark for dLLMs.☆22Jul 30, 2026Updated 3 months ago
- a weird data structures library with type descriptors.☆15Jun 3, 2026Updated 5 months ago
- This repo has scripts to compare various powerful RL methods☆41Feb 23, 2026Updated 8 months ago
- ☆17Oct 9, 2025Updated last year
- ☆12Aug 25, 2026Updated 2 months ago
- Multimodal Speech Recognition for phoneme level prediction using Audio-Visual data from TCDTIMIT dataset implementing RNNs with LSTMs for…☆15Jul 27, 2023Updated 3 years ago
- 🤪Cogifed version of Tencent (Hunyuan)'s Open-Source Lip-Sync Model HunyuanVideo-Avatar🫦☆11Jun 3, 2025Updated last year