isEmmanuelOlowe / llm-cost-estimatorLinks
Estimating hardware and cloud costs of LLMs and transformer projects
☆20Updated last week
Alternatives and similar repositories for llm-cost-estimator
Users that are interested in llm-cost-estimator are comparing it to the libraries listed below
Sorting:
- Tutorial to get started with SkyPilot!☆57Updated last year
- AskIt: Unified programming interface for programming with LLMs (GPT-3.5, GPT-4, Gemini, Claude, Cohere, Llama 2)☆79Updated 10 months ago
- Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna☆58Updated last month
- Advanced Ultra-Low Bitrate Compression Techniques for the LLaMA Family of LLMs☆110Updated last year
- 👩🤝🤖 A curated list of datasets for large language models (LLMs), RLHF and related resources (continually updated)☆24Updated 2 years ago
- ☆52Updated last year
- Code for the paper: CodeTree: Agent-guided Tree Search for Code Generation with Large Language Models☆29Updated 7 months ago
- Repository for CPU Kernel Generation for LLM Inference☆27Updated 2 years ago
- GPT-4 Level Conversational QA Trained In a Few Hours☆65Updated last year
- ☆28Updated 7 months ago
- Lightweight Python Wrapper for OpenVINO, enabling LLM inference on NPUs☆23Updated 11 months ago
- A Python library to orchestrate LLMs in a neural network-inspired structure☆51Updated last year
- vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs☆93Updated this week
- Implementation of nougat that focuses on processing pdf locally.☆83Updated 10 months ago
- Formal-LLM: Integrating Formal Language and Natural Language for Controllable LLM-based Agents☆131Updated last year
- Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…☆101Updated this week
- Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and min…☆25Updated last year
- ☆120Updated last year
- GroqFlow provides an automated tool flow for compiling machine learning and linear algebra workloads into Groq programs and executing tho…☆114Updated 3 months ago
- Compression for Foundation Models☆35Updated 3 months ago
- Repo hosting codes and materials related to speeding LLMs' inference using token merging.☆37Updated last month
- LLMs as Collaboratively Edited Knowledge Bases☆45Updated last year
- QuIP quantization☆60Updated last year
- never forget anything again! combine AI and intelligent tooling for a local knowledge base to track catalogue, annotate, and plan for you…☆38Updated last year
- new optimizer☆20Updated last year
- Small, simple agent task environments for training and evaluation☆19Updated last year
- LLM Optimize is a proof-of-concept library for doing LLM (large language model) guided blackbox optimization.☆59Updated 2 years ago
- Open Implementations of LLM Analyses☆107Updated last year
- ReLM is a Regular Expression engine for Language Models☆107Updated 2 years ago
- Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks☆31Updated last year