Code for the the article "LLM inference from first principles"
☆17May 13, 2025Updated last year
Alternatives and similar repositories for llm-inference-economics-from-first-principles
Users that are interested in llm-inference-economics-from-first-principles are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A CSV benchmark in C#!☆17Aug 24, 2025Updated 11 months ago
- ☆13Mar 3, 2023Updated 3 years ago
- An application skeleton for a typical Loopback+AngularJS web app using ng-boilerplate☆11Jul 26, 2014Updated 12 years ago
- ☆12Jan 5, 2019Updated 7 years ago
- ☆12Mar 18, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- A set of Wasm samples using the mono-wasm sdk☆11Sep 12, 2023Updated 2 years ago
- [CF ’20] Verified Instruction-Level Energy Consumption Measurement for NVIDIA GPUs☆15Dec 11, 2020Updated 5 years ago
- Next generation cryptocurrency network☆12Apr 17, 2018Updated 8 years ago
- contextual menu for neovim plugins☆14Jan 3, 2021Updated 5 years ago
- Infrastructure and example of using CQS, together with Dapper and SimpleInjection☆12Apr 11, 2022Updated 4 years ago
- Swanc HTML5 Canvas Framework☆17Jun 5, 2015Updated 11 years ago
- Tools for Optuna, MLflow and the integration of both.☆17May 28, 2023Updated 3 years ago
- ☆10Nov 26, 2019Updated 6 years ago
- sonictemplate-vim integration☆14Nov 20, 2023Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Flan T5 LLM fine-tuning, by attaching a regression model last hidden layers activations. Runs on colab with A100 40gb☆13Mar 24, 2023Updated 3 years ago
- C# 8 Demo for the new proposed feature Async Streams☆12Aug 6, 2018Updated 8 years ago
- ☆11Nov 6, 2020Updated 5 years ago
- Estimating hardware and cloud costs of LLMs and transformer projects☆22Apr 1, 2026Updated 4 months ago
- GPT-3 summarizations of new arxiv.org machine learning papers (frontend only)☆12Mar 28, 2023Updated 3 years ago
- A VSCode extension for converting Typescript to C#☆12Mar 4, 2023Updated 3 years ago
- WikiGenGPT creates fictional Wikipedia articles using GPT-4 API for imaginative exploration.☆13Nov 5, 2023Updated 2 years ago
- A Github-contributions like visualisation for Strava activities☆17Jan 5, 2023Updated 3 years ago
- Visa API☆12Apr 29, 2017Updated 9 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Automated utilities to block users on Twitter.☆13Sep 13, 2021Updated 4 years ago
- Code companion for the RL Post-Training Handbook - training reasoning models on a single GPU☆19Jan 30, 2026Updated 6 months ago
- ☆28Sep 1, 2021Updated 4 years ago
- ☆12Feb 14, 2025Updated last year
- This is the typical story arc of an Ethereum hero. This journey is inevitable. No Hero ever knew what they were getting involved with. Th…☆14Mar 7, 2025Updated last year
- ☆14Updated this week
- LLM-Inference-Bench☆63Jul 18, 2025Updated last year
- [DEPRECATED] Simple utility for parsing binary evm code into opcodes☆13Jan 9, 2020Updated 6 years ago
- A solidity smart contract based reputation system with UI☆14Apr 27, 2017Updated 9 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Random research and simulations☆16Mar 22, 2019Updated 7 years ago
- study of Ampere' Sparse Matmul☆18Jan 10, 2021Updated 5 years ago
- Reproducible nvim completion framework benchmarks.☆13Aug 22, 2023Updated 2 years ago
- Some random notes by chriseth☆19Feb 10, 2025Updated last year
- [ICML 2026] Official codebase for "Flash-VAED: Plug-and-Play VAE Decoders for Efficient Video Generation"☆35Updated this week
- C# implementation of DID security and privacy controls☆15Jul 31, 2020Updated 6 years ago
- A simple SPA banner manager application for Salesforce implemented using React and Reflux.☆18May 29, 2015Updated 11 years ago