bentoml / llm-inference-handbookView external linksLinks
Everything you need to know about LLM inference
☆262Jan 8, 2026Updated last month
Alternatives and similar repositories for llm-inference-handbook
Users that are interested in llm-inference-handbook are comparing it to the libraries listed below
Sorting:
- Detect and remove unused dependencies for Python projects☆18Apr 5, 2025Updated 10 months ago
- vyai – A lightweight CLI tool to interact with the Gemini API from the terminal.☆11Dec 8, 2025Updated 2 months ago
- Postgres extension that speeds up analytics queries by upto 90%☆52Jun 8, 2024Updated last year
- A parser to get the product, OS, device, cpu, and engine information from a user agent, inspired by https://github.com/faisalman/ua-parse…☆20Nov 24, 2025Updated 2 months ago
- A smaller and simpler approach for JavaScript MVC.☆25Jun 9, 2015Updated 10 years ago
- Your AI Chief of Staff — a personal operating system starter kit that adapts to your role. No coding required.☆88Updated this week
- This is the documentation for Kilo Code, open source AI coding assistant for planning, building, and fixing code.☆28Aug 27, 2025Updated 5 months ago
- Personal Site☆20Jan 11, 2026Updated last month
- Experiment on reimplementation of GRPO RL☆17Feb 7, 2025Updated last year
- The docs repository of Pulsar2 which is AXera's SoC 2rd AI toolchain. Such as AX650A, AX650N☆17Updated this week
- A meta-framework for self-improving LLMs with transparent reasoning☆31Dec 10, 2025Updated 2 months ago
- Open-source LLM Prompt-Injection and Jailbreaking Playground☆29Jul 19, 2025Updated 6 months ago
- Token Downsampling optimization for stable-diffusion-webui☆26Apr 22, 2024Updated last year
- Свободный аудио проигрыватель Вашей любимой музыки на сайте Вконтакте (http://vk.com).☆11Dec 5, 2014Updated 11 years ago
- Rust SDK for Threema Gateway.☆26Jan 4, 2026Updated last month
- High-performance open-source synthetic data engine. Uses LLMs for schema design and vectorized NumPy for deterministic, scalable generati…☆51Updated this week
- A demonstration of text/GUI bi-directional editing via an LSP server☆38Jul 1, 2025Updated 7 months ago
- Simple Agents Made Easy☆616Nov 5, 2025Updated 3 months ago
- Mobile adapter for IOS and android for mobile LLM agents☆43Nov 24, 2024Updated last year
- AutoGenBook is a Python-based tool that automatically generates books using LLMs. It creates chapters, sections, and subsections recurs…☆24Nov 3, 2024Updated last year
- Curated list of resources and tools to implement your PARA Method workflow.☆28Jan 4, 2024Updated 2 years ago
- A minimal Typescript library for converting a json-rules-engine condition to a JsonLogic rule specification.☆11Jul 6, 2022Updated 3 years ago
- SnapDocs - A Modern, Open-Source Document Workspace☆24Sep 7, 2025Updated 5 months ago
- A Model Context Protocol (MCP) server that enables AI assistants to generate images, text, and audio through the Pollinations APIs. Suppo…☆39Dec 2, 2025Updated 2 months ago
- Achieve the llama3 inference step-by-step, grasp the core concepts, master the process derivation, implement the code.☆624Feb 24, 2025Updated 11 months ago
- Your AI research assistant☆79Mar 31, 2025Updated 10 months ago
- Text Behind Video. Enjoy it is completely free.☆31Feb 15, 2025Updated last year
- Sutracli is an AI-powered code manager for coding agents. It spawns agents for multiple projects, connects repos through cross-indexing, …☆28Nov 7, 2025Updated 3 months ago
- shifts hg19/38 genomic position for feasible input format.☆12Jun 8, 2023Updated 2 years ago
- Cognito: Supercharge your Chrome browser with AI. Guide, query, and control everything using natural language.☆57Jan 11, 2026Updated last month
- Model Context Protocol Server for Apache OpenDAL™☆34Apr 10, 2025Updated 10 months ago
- This is a python implementation for stitching images.☆231Oct 3, 2024Updated last year
- Markdown-compatible AI-Powered Terminal Notepad☆14Apr 24, 2025Updated 9 months ago
- This project utilizes Generative Adversarial Networks (GANs) to tackle the problem of credit card fraud detection. GANs are a powerful de…☆12Oct 11, 2023Updated 2 years ago
- My effort to contribute in open source with some Classic Machine Learning Projects to Boost up skills and knowledge if you're a Beginner.☆10Apr 18, 2021Updated 4 years ago
- Spellbound - your multilingual AI-powered writing assistant☆12May 12, 2025Updated 9 months ago
- MCP as a Judge is a behavioral MCP that strengthens AI coding assistants by requiring explicit LLM evaluations☆16Dec 15, 2025Updated 2 months ago
- 🎓 Open-source AI thesis writer with 19 specialized agents. Generate 20k+ word research drafts in 10 minutes. FREE (Gemini). Verified cit…☆40Feb 3, 2026Updated last week
- Tamagotchi-style digital pet with a neural network featuring neurogenesis & Hebbian learning☆272Updated this week