☆104Oct 4, 2026Updated last month
Alternatives and similar repositories for vLLM_Inference_Engine
Users that are interested in vLLM_Inference_Engine are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 100 days of LLM inference engineering — daily posts, experiments, and visualizations☆1,909Apr 30, 2026Updated 6 months ago
- A durable LSM-tree storage engine exploring WALs, memtables, SSTables, compaction, and crash recovery from first principles.☆25Updated this week
- A curated resource list for learning AI performance engineering, from GPU fundamentals to production inference.☆4,348Oct 17, 2026Updated 3 weeks ago
- SafeInstall inspects remote installer scripts before executing them. It downloads the artifact, runs static analysis, checks against vuln…☆28Sep 25, 2026Updated last month
- Step-by-step C++17 GEMM optimization: ten kernels from naive ijk to AVX2 and OpenMP. Peaks at 323 GFLOPS at 2048x2048 on i5-13450HX.☆19Sep 30, 2026Updated last month
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- a collection of CUDA Kernels☆18Jul 24, 2026Updated 3 months ago
- ☆144Oct 29, 2026Updated last week
- A small, readable PyTorch inference engine for Qwen3-4B with continuous batching, native paged attention, prefix caching, and an OpenAI-c…☆18Oct 24, 2026Updated 2 weeks ago
- Lightcode is a coding agent written in Go.☆22Aug 23, 2026Updated 2 months ago
- Deployment & experimentation of LLM inference at production scale (P/D disaggregation, KV offloading, parallelism, and autoscaling).☆64Sep 26, 2026Updated last month
- a lightweight terminal agent☆34Sep 4, 2026Updated 2 months ago
- Don't memorize ML. Understand it from first principles including Inference, Cuda, Deep Learning, Data Science and Reinforcement Learning☆820Updated this week
- A basic walkthrough of kubernetes autoscaling in all its forms☆33May 29, 2024Updated 2 years ago
- ☆192Sep 8, 2026Updated 2 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- peer-to-peer synchronized video watching. no servers. no accounts. just a room code and a udp packet.☆24May 28, 2026Updated 5 months ago
- Tamil continued pretraining and instruction tuning of Qwen3.5-2B-Base: serving stack, eval harness, training recipe and knowledge base bu…☆20Oct 1, 2026Updated last month
- Agent Harness prototype with main components and deployment on Railway☆27Aug 21, 2026Updated 2 months ago
- A 10-week, 30-minutes-a-day roadmap for LLM inference serving and optimization. vLLM, SGLang, quantization, speculative decoding, benchma…☆1,073Aug 14, 2026Updated 2 months ago
- Future of work and communication☆12Dec 23, 2025Updated 10 months ago
- Seera is a minimal deep learning framework written from scratch in C, CUDA and wrapped with python, featuring a custom autograd engine, m…☆16May 4, 2026Updated 6 months ago
- ☆17Oct 18, 2026Updated 3 weeks ago
- An agent skill for hands-on technical learning☆13Jun 1, 2026Updated 5 months ago
- ☆10Aug 19, 2020Updated 6 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- LLM that can be trained on 1 or more GPUs for research.☆59Jul 8, 2026Updated 3 months ago
- A repo to learn system design from scratch.☆18Oct 28, 2026Updated last week
- ☆17Aug 14, 2026Updated 2 months ago
- Ground Truth: A working developer's path into AI and machine learning, with interactive explanations, reproducible Python labs, and pract…☆40Updated this week
- Plug-and-play PyTorch transformer research framework. Swap attention, FFN, norm, positional, connection, projection, optimizer, scheduler…☆18Oct 25, 2026Updated 2 weeks ago
- Track LLM token usage, enforce rate limit & budget policies, and trigger alerts across OpenAI, Groq, OpenRouter, and AWS Bedrock.☆20Aug 11, 2026Updated 2 months ago
- R package containing Murdock's Ethnolinguistic Map (1959) and Ethnographic Atlas (1967) data for the African Continent☆12Apr 26, 2018Updated 8 years ago
- valo-tui · Valorant esports in your terminal: a fast, cached, read-only TUI for live scores, results, and full per-map scoreboards. Built…☆19Jun 12, 2026Updated 4 months ago
- Implementation of Lift4d, Harmonizing Single-View 3D Estimation for 4D Reconstruction In-the-Wild, from Litman et al. of Carnegie Mellon☆15Jun 24, 2026Updated 4 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- This typewriter OCR code can convert JPEG typewritten text images into RTF documents, while removing typos for you!☆16Sep 23, 2022Updated 4 years ago
- GoalOS AGIALPHA Ascension — Sovereign Machine Economy: proof-settled autonomous AI work, Evidence Dockets, validator-gated jobs, governed…☆15Updated this week
- Zero-dependency Dynamax workflows for pi: live parallel subagents, typed handoffs, synthesized results.☆12Oct 29, 2026Updated last week
- Listing out all the best technical blogs company wise☆450Apr 26, 2026Updated 6 months ago
- How to build an ACP compliant agent that uses MCP as well!☆11May 6, 2025Updated last year
- ☆14Oct 27, 2026Updated last week
- Optimization bugs found in popular quantum computing SDKs due to poor numerical handling☆12Oct 12, 2026Updated 3 weeks ago