Code for the the article "LLM inference from first principles"
☆17May 13, 2025Updated last year
Alternatives and similar repositories for llm-inference-economics-from-first-principles
Users that are interested in llm-inference-economics-from-first-principles are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A basic example for how to use hashes to "store" complex objects as hashes. Inspired by 0xSplits.☆13Jul 30, 2022Updated 4 years ago
- Estimate the throughput of OAI compatible servers☆21Jul 1, 2026Updated 2 months ago
- A time library for the Motoko programming language.☆14Feb 8, 2021Updated 5 years ago
- The Exponent Platform for the Internet Compter☆12May 22, 2021Updated 5 years ago
- ☆13Sep 11, 2025Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- A collection of plugins for c-lightning☆15Apr 18, 2020Updated 6 years ago
- ☆21Jan 8, 2022Updated 4 years ago
- A protocol for splitting ERC20 tokens into their yield, governance and capital components☆21Jan 23, 2023Updated 3 years ago
- [CF ’20] Verified Instruction-Level Energy Consumption Measurement for NVIDIA GPUs☆15Dec 11, 2020Updated 5 years ago
- contextual menu for neovim plugins☆14Jan 3, 2021Updated 5 years ago
- Complete simulation of IEEE 754 fixed and floating point specification to any precision☆13Aug 26, 2020Updated 6 years ago
- sonictemplate-vim integration☆14Nov 20, 2023Updated 2 years ago
- ☆12Aug 21, 2024Updated 2 years ago
- Diagram-first LLM architecture, memory, hardware-fit, throughput, and verified cloud-cost explorer.☆22Aug 24, 2026Updated 3 weeks ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Converts any timeframe OHLC data points (e.g. crypto data) to higher timeframes☆13Aug 21, 2021Updated 5 years ago
- torch.compile artifacts for common deep learning models, can be used as a learning resource for torch.compile☆19Dec 22, 2023Updated 2 years ago
- Code companion for the RL Post-Training Handbook - training reasoning models on a single GPU☆20Jan 30, 2026Updated 7 months ago
- ☆12Feb 14, 2025Updated last year
- RSS feed site for newly added Neovim plugins☆14Updated this week
- Automatically exported from code.google.com/p/shunit2☆10Feb 15, 2016Updated 10 years ago
- A very basic demonstration connecting speech recognition and text-to-speech☆20May 3, 2020Updated 6 years ago
- Repository for compilation and cycle-accurate simulator for scale-out systolic arrays☆16Jan 4, 2023Updated 3 years ago
- study of Ampere' Sparse Matmul☆18Jan 10, 2021Updated 5 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- The IPIP BFFM (International Personality Item Pool Big Five Factor Markers) personality test is universally recognized as an established …☆21Oct 22, 2023Updated 2 years ago
- Reproducible nvim completion framework benchmarks.☆13Aug 22, 2023Updated 3 years ago
- ☆19Sep 12, 2024Updated 2 years ago
- ☆10Nov 14, 2019Updated 6 years ago
- The simplest fuzzy selector plugin of Vim☆14Feb 22, 2025Updated last year
- My dotfiles☆14Updated this week
- ポケモン第1世代(初代)のセーブデータについての日本語ドキュメントです☆13Jan 17, 2023Updated 3 years ago
- ☆19Feb 24, 2023Updated 3 years ago
- A text-object for LHS/RHS of assignment.☆16Oct 31, 2020Updated 5 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- NeuroSpector: Dataflow and Mapping Optimizer for Deep Neural Network Accelerators☆23Mar 20, 2025Updated last year
- wrapper for the crossref events api☆24May 23, 2023Updated 3 years ago
- NLP examples(almost Japanese) on AWS☆12May 31, 2022Updated 4 years ago
- A custom element that renders the readme of a github repository☆17May 20, 2019Updated 7 years ago
- In this course, students will learn about the foundational elements of programming languages as well as the design principles behind Moto…☆30Mar 30, 2022Updated 4 years ago
- course design☆23Feb 28, 2018Updated 8 years ago
- dotfiles that can be installed by one command☆16Sep 9, 2026Updated last week