tugot17 / tokenomicsLinks
Estimate the throughput of OAI compatible servers
☆21Updated 3 months ago
Alternatives and similar repositories for tokenomics
Users that are interested in tokenomics are comparing it to the libraries listed below
Sorting:
- ☆162Updated last year
- ☆171Updated last year
- Where GPUs get cooked 👩🍳🔥☆363Updated 2 weeks ago
- A Lightweight Library for AI Observability☆255Updated 11 months ago
- ☆79Updated last year
- Modded vLLM to run pipeline parallelism over public networks☆40Updated 8 months ago
- Simple UI for debugging correlations of text embeddings☆305Updated 8 months ago
- Minimal example scripts of the Hugging Face Trainer, focused on staying under 150 lines☆196Updated last year
- Manage scalable open LLM inference endpoints in Slurm clusters☆280Updated last year
- Fine-tune an LLM to perform batch inference and online serving.☆120Updated 8 months ago
- The Batched API provides a flexible and efficient way to process multiple requests in a batch, with a primary focus on dynamic batching o…☆155Updated 6 months ago
- ☆198Updated 2 years ago
- ☆280Updated this week
- ☆54Updated last year
- smol models are fun too☆93Updated last year
- A miniature version of Modal☆23Updated last year
- ☆20Updated last year
- A set of scripts and notebooks on LLM finetunning and dataset creation☆116Updated last year
- Tutorial for building LLM router☆244Updated last year
- Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.☆83Updated 2 years ago
- Fully fine-tune large models like Mistral, Llama-2-13B, or Qwen-14B completely for free☆232Updated last year
- ☆198Updated last year
- Atropos is a Language Model Reinforcement Learning Environments framework for collecting and evaluating LLM trajectories through diverse …☆853Updated this week
- ☆141Updated 5 months ago
- Automatically evaluate your LLMs in Google Colab☆685Updated last year
- ☆237Updated last month
- Foyle is a copilot to help developers deploy and operate their applications.☆133Updated 10 months ago
- ☆94Updated 2 years ago
- [ACL'25] Official Code for LlamaDuo: LLMOps Pipeline for Seamless Migration from Service LLMs to Small-Scale Local LLMs☆314Updated 6 months ago
- Starter pack for NeurIPS LLM Efficiency Challenge 2023.☆129Updated 2 years ago