Everything you need to know about LLM inference
☆275Mar 25, 2026Updated this week
Alternatives and similar repositories for llm-inference-handbook
Users that are interested in llm-inference-handbook are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Detect and remove unused dependencies for Python projects☆18Apr 5, 2025Updated 11 months ago
- Postgres extension that speeds up analytics queries by upto 90%☆52Jun 8, 2024Updated last year
- Tools and dumps related to the Smishing Triad and the USPS smishing campaign from late 2023 into 2024☆11Apr 28, 2024Updated last year
- MCP server for consulting powerful reasoning models in Claude Code☆67Mar 20, 2026Updated last week
- ☆23Jun 5, 2025Updated 9 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click and start building anything your business needs.
- 🪐 Jupyter Kernel Client through HTTP and WebSocket.☆19Mar 1, 2026Updated 3 weeks ago
- Your appetite for code + Claude's capabilities = Limitless creation. No experience required - just pure hunger! 🧠⚡💻☆57Jun 20, 2025Updated 9 months ago
- A smaller and simpler approach for JavaScript MVC.☆25Jun 9, 2015Updated 10 years ago
- PyLate efficient inference engine☆79Jan 7, 2026Updated 2 months ago
- A demonstration of text/GUI bi-directional editing via an LSP server☆38Jul 1, 2025Updated 8 months ago
- Imbue tarantool space with power of queue☆16Dec 18, 2025Updated 3 months ago
- Create an LLM XML context document from an llms.txt file☆23Aug 26, 2024Updated last year
- Expose Datasette instances to LLM as a tool☆27May 27, 2025Updated 10 months ago
- Richly render (streamed) markdown, such as from command-line LLMs.☆19Aug 23, 2025Updated 7 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click and start building anything your business needs.
- ☆19Aug 7, 2024Updated last year
- Open-source LLM Prompt-Injection and Jailbreaking Playground☆32Jul 19, 2025Updated 8 months ago
- (WIP) various language support for libpglite native☆21Aug 5, 2025Updated 7 months ago
- Personal Site☆20Jan 11, 2026Updated 2 months ago
- Simple Agents Made Easy☆618Mar 16, 2026Updated 2 weeks ago
- A generic Python Application plugin the asdf version manager.☆63Jul 19, 2022Updated 3 years ago
- A lightweight Java SVG badge/shield generation library☆20Jun 29, 2023Updated 2 years ago
- Model Context Protocol Server for Apache OpenDAL™☆34Apr 10, 2025Updated 11 months ago
- Node-Based Robotics Framework Written in Rust☆71Oct 6, 2024Updated last year
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- LLM-Inference-Bench☆60Jul 18, 2025Updated 8 months ago
- PHP Kernel for Jupyter Notebooks☆32Feb 7, 2022Updated 4 years ago
- ☆17Jan 11, 2025Updated last year
- ☆25Sep 15, 2025Updated 6 months ago
- A survey to help potential co-founders explore their relationship and discover (in)compatibilities early on.☆16Apr 16, 2018Updated 7 years ago
- Demo App☆11Jan 27, 2026Updated 2 months ago
- A simple rss reader plugin for neovim☆33Feb 19, 2026Updated last month
- Community-driven Python client & CLI for the Karakeep API.☆32Feb 28, 2026Updated last month
- ☆15Aug 27, 2025Updated 7 months ago
- DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- A book about observability in practice☆18Feb 25, 2023Updated 3 years ago
- Achieve the llama3 inference step-by-step, grasp the core concepts, master the process derivation, implement the code.☆629Feb 24, 2025Updated last year
- ☆24Updated this week
- Your AI research assistant☆79Mar 31, 2025Updated 11 months ago
- Toy distributed PostgreSQL by implementing SQL over KV☆11Jan 14, 2026Updated 2 months ago
- AI Dataset Generator – Create realistic datasets for demos, learning, and dashboards☆756Oct 3, 2025Updated 5 months ago
- This repository contains a ready-to-use boilerplate for quickly setting up and working with crewai. It provides essential configurations …☆11Sep 11, 2024Updated last year