Code for the the article "LLM inference from first principles"
☆17May 13, 2025Updated last year
Alternatives and similar repositories for llm-inference-economics-from-first-principles
Users that are interested in llm-inference-economics-from-first-principles are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Lightweight harness for replaying inference traffic against an endpoint☆33Aug 1, 2026Updated 3 months ago
- Estimate the throughput of OAI compatible servers☆22Oct 14, 2026Updated last month
- The repository contains a reference end-to-end pipeline for a real-time video analytics application. Realtime data is provided to an infe…☆12Nov 3, 2025Updated last year
- ☆12Mar 18, 2024Updated 2 years ago
- ☆12Jan 5, 2019Updated 7 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- A student driven lego detection system☆10Apr 7, 2021Updated 5 years ago
- This chatbot utilizes the concept of Agentic RAG to develop an advanced chatbot that is capable of reasoning among complicated-context do…☆22Oct 22, 2024Updated 2 years ago
- contextual menu for neovim plugins☆14Jan 3, 2021Updated 5 years ago
- [CF ’20] Verified Instruction-Level Energy Consumption Measurement for NVIDIA GPUs☆15Dec 11, 2020Updated 5 years ago
- 🎓Automatically Update CV Papers Daily using Github Actions (Update Every 12th hours)☆12May 17, 2026Updated 6 months ago
- Recurrent neural network from scratch in numpy, with a custom-made word2vec☆12Apr 13, 2020Updated 6 years ago
- Optima by Artificial Analysis☆17Updated this week
- one-click deepfake (face swap)☆10May 30, 2023Updated 3 years ago
- ☆12Apr 20, 2026Updated 6 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆20Updated this week
- How Safe is SF?☆10Aug 20, 2024Updated 2 years ago
- ☆12Aug 21, 2024Updated 2 years ago
- Polynomial arithmetic over GF2☆12Oct 30, 2018Updated 8 years ago
- ☆15Jul 25, 2024Updated 2 years ago
- Converts any timeframe OHLC data points (e.g. crypto data) to higher timeframes☆13Aug 21, 2021Updated 5 years ago
- ☆29Apr 10, 2026Updated 7 months ago
- Python poker library☆14Sep 9, 2023Updated 3 years ago
- Reproducible nvim completion framework benchmarks.☆13Aug 22, 2023Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- sonictemplate-vim integration☆14Nov 20, 2023Updated 2 years ago
- Genome-scale model for Mus musculus☆14Oct 6, 2026Updated last month
- A Hybrid LLM Inference Gateway for Local GPUs and Cloud APIs☆25Updated this week
- Yet Another Introduction to Quantum Computing☆14Oct 27, 2025Updated last year
- A simple way to connect your N26 bank account to a Google Sheets cell.☆12Oct 18, 2018Updated 8 years ago
- Automatically exported from code.google.com/p/shunit2☆10Feb 15, 2016Updated 10 years ago
- torch.compile artifacts for common deep learning models, can be used as a learning resource for torch.compile☆19Dec 22, 2023Updated 2 years ago
- SimPype is a simulation framework based on Simpy that relies on the concepts of resource and pipe.☆15Feb 19, 2021Updated 5 years ago
- LLM-Inference-Bench☆63Jul 18, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆18Apr 8, 2026Updated 7 months ago
- ☆12Feb 14, 2025Updated last year
- ☆10Dec 14, 2018Updated 7 years ago
- RSS feed site for newly added Neovim plugins☆14Updated this week
- Estimate Your LLM's Token Toll Across Various Platforms and Configurations☆40Nov 9, 2025Updated last year
- ☆25Sep 23, 2026Updated last month
- Diagram-first LLM architecture, memory, hardware-fit, throughput, and verified cloud-cost explorer.☆22Aug 24, 2026Updated 2 months ago
Are these results useful?