isEmmanuelOlowe / llm-cost-estimatorLinks
Estimating hardware and cloud costs of LLMs and transformer projects
☆17Updated last week
Alternatives and similar repositories for llm-cost-estimator
Users that are interested in llm-cost-estimator are comparing it to the libraries listed below
Sorting:
- 👩🤝🤖 A curated list of datasets for large language models (LLMs), RLHF and related resources (continually updated)☆23Updated 2 years ago
- Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna☆53Updated 4 months ago
- Repository for CPU Kernel Generation for LLM Inference☆26Updated last year
- ☆36Updated last month
- Self-host LLMs with LMDeploy and BentoML☆20Updated 2 weeks ago
- Latent Large Language Models☆18Updated 10 months ago
- vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs☆87Updated this week
- ☆41Updated 2 weeks ago
- 👷 Build compute kernels☆68Updated this week
- Compression for Foundation Models☆31Updated 3 months ago
- Cascade Speculative Drafting☆29Updated last year
- Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and min…☆26Updated 7 months ago
- AskIt: Unified programming interface for programming with LLMs (GPT-3.5, GPT-4, Gemini, Claude, Cohere, Llama 2)☆79Updated 5 months ago
- ☆48Updated 11 months ago
- Repo hosting codes and materials related to speeding LLMs' inference using token merging.☆36Updated last year
- The Benefits of a Concise Chain of Thought on Problem Solving in Large Language Models☆22Updated 7 months ago
- ☆68Updated this week
- Implementation of SelfExtend from the paper "LLM Maybe LongLM: Self-Extend LLM Context Window Without Tuning" from Pytorch and Zeta☆13Updated 7 months ago
- Data preparation code for CrystalCoder 7B LLM☆45Updated last year
- ☆39Updated 2 years ago
- Repository for Sparse Finetuning of LLMs via modified version of the MosaicML llmfoundry☆42Updated last year
- Github repo for Peifeng's internship project☆13Updated last year
- a pipeline for using api calls to agnostically convert unstructured data into structured training data☆30Updated 9 months ago
- A collection of reproducible inference engine benchmarks☆31Updated 2 months ago
- Make triton easier☆46Updated last year
- Visualize expert firing frequencies across sentences in the Mixtral MoE model☆18Updated last year
- new optimizer☆20Updated 10 months ago
- MPI Code Generation through Domain-Specific Language Models☆14Updated 7 months ago
- minimal C implementation of speculative decoding based on llama2.c☆23Updated 11 months ago
- Unit Scaling demo and experimentation code☆16Updated last year