isEmmanuelOlowe / llm-cost-estimatorLinks
Estimating hardware and cloud costs of LLMs and transformer projects
☆20Updated 2 weeks ago
Alternatives and similar repositories for llm-cost-estimator
Users that are interested in llm-cost-estimator are comparing it to the libraries listed below
Sorting:
- AskIt: Unified programming interface for programming with LLMs (GPT-3.5, GPT-4, Gemini, Claude, Cohere, Llama 2)☆79Updated 11 months ago
- Advanced Ultra-Low Bitrate Compression Techniques for the LLaMA Family of LLMs☆110Updated last year
- 👩🤝🤖 A curated list of datasets for large language models (LLMs), RLHF and related resources (continually updated)☆24Updated 2 years ago
- vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs☆94Updated this week
- [ICLR 2024] Skeleton-of-Thought: Prompting LLMs for Efficient Parallel Generation☆182Updated last year
- LLM Optimize is a proof-of-concept library for doing LLM (large language model) guided blackbox optimization.☆60Updated 2 years ago
- Pre-training code for CrystalCoder 7B LLM☆55Updated last year
- Tutorial to get started with SkyPilot!☆58Updated last year
- Compression for Foundation Models☆34Updated 5 months ago
- Data preparation code for CrystalCoder 7B LLM☆45Updated last year
- Data preparation code for Amber 7B LLM☆94Updated last year
- ☆52Updated last year
- Zeus LLM Trainer is a rewrite of Stanford Alpaca aiming to be the trainer for all Large Language Models☆70Updated 2 years ago
- Repo hosting codes and materials related to speeding LLMs' inference using token merging.☆37Updated 2 months ago
- The Benefits of a Concise Chain of Thought on Problem Solving in Large Language Models☆22Updated last year
- A collection of reproducible inference engine benchmarks☆38Updated 8 months ago
- Open Implementations of LLM Analyses☆108Updated last year
- Example implementation of Iteration of Tought - Gives a star if you like the project☆41Updated last year
- Repository for CPU Kernel Generation for LLM Inference☆27Updated 2 years ago
- ReLM is a Regular Expression engine for Language Models☆107Updated 2 years ago
- [ICML 2023] "Outline, Then Details: Syntactically Guided Coarse-To-Fine Code Generation", Wenqing Zheng, S P Sharan, Ajay Kumar Jaiswal, …☆43Updated 2 years ago
- PB-LLM: Partially Binarized Large Language Models☆157Updated 2 years ago
- 🏙 Interactive performance profiling and debugging tool for PyTorch neural networks.☆64Updated 11 months ago
- ☆67Updated 9 months ago
- GPT-4 Level Conversational QA Trained In a Few Hours☆66Updated last year
- Formal-LLM: Integrating Formal Language and Natural Language for Controllable LLM-based Agents☆133Updated last year
- Implementation of nougat that focuses on processing pdf locally.☆83Updated 11 months ago
- Latent Large Language Models☆19Updated last year
- Code for the paper: CodeTree: Agent-guided Tree Search for Code Generation with Large Language Models☆30Updated 8 months ago
- Samples of good AI generated CUDA kernels☆95Updated 6 months ago