Alternatives and similar repositories for llm-cost-estimator

Users that are interested in llm-cost-estimator are comparing it to the libraries listed below

• NolanoOrg / SpectraSuite
  ☆51Updated last year
• EmbeddedLLM / vllm
  vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆89Updated this week
• s-smits / grpo-optuna
  Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna
  ☆55Updated 7 months ago
• katsumiok / pyaskit
  AskIt: Unified programming interface for programming with LLMs (GPT-3.5, GPT-4, Gemini, Claude, Cohere, Llama 2)
  ☆79Updated 8 months ago
• Cerebras / DocChat
  GPT-4 Level Conversational QA Trained In a Few Hours
  ☆64Updated last year
• GreenBitAI / low_bit_llama
  Advanced Ultra-Low Bitrate Compression Techniques for the LLaMA Family of LLMs
  ☆110Updated last year
• ScalingIntelligence / good-kernels
  Samples of good AI generated CUDA kernels
  ☆90Updated 3 months ago
• imagination-research / sot
  [ICLR 2024] Skeleton-of-Thought: Prompting LLMs for Efficient Parallel Generation
  ☆176Updated last year
• LLM360 / amber-data-prep
  Data preparation code for Amber 7B LLM
  ☆91Updated last year
• facebookresearch / fastgen
  Simple high-throughput inference library
  ☆127Updated 4 months ago
• IST-DASLab / QIGen
  Repository for CPU Kernel Generation for LLM Inference
  ☆26Updated 2 years ago
• matthewrenze / jhu-concise-cot
  The Benefits of a Concise Chain of Thought on Problem Solving in Large Language Models
  ☆22Updated 9 months ago
• opendatahub-io / vllm-tgis-adapter
  vLLM adapter for a TGIS-compatible gRPC server.
  ☆40Updated this week
• facebookresearch / matrix
  Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…
  ☆95Updated this week
• nisten / grokadamw
  new optimizer
  ☆20Updated last year
• zenrran4nlp / Awesome-LLM-Inference-Serving
  ☆42Updated 4 months ago
• tiiuae / onebitllms
  Lightweight toolkit package to train and fine-tune 1.58bit Language models
  ☆88Updated 4 months ago
• bipul1010 / agents_tutorial
  ☆19Updated last year
• Noumena-Network / NSA-Test
  NSA Triton Kernels written with GPT5 and Opus 4.1
  ☆65Updated last month
• zhuzilin / faster-nougat
  Implementation of nougat that focuses on processing pdf locally.
  ☆82Updated 8 months ago
• xaedes / llama.cpp
  Port of Facebook's LLaMA model in C/C++
  ☆22Updated last year
• LLM360 / crystalcoder-train
  Pre-training code for CrystalCoder 7B LLM
  ☆55Updated last year
• serp-ai / Parameter-Efficient-MoE
  Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks
  ☆31Updated last year
• IST-DASLab / Quartet
  ☆94Updated 3 weeks ago
• reka-ai / rekaquant
  ☆62Updated 2 months ago
• sshh12 / llm_optimize
  LLM Optimize is a proof-of-concept library for doing LLM (large language model) guided blackbox optimization.
  ☆58Updated 2 years ago
• argilla-io / awesome-llm-datasets
  👩🤝🤖 A curated list of datasets for large language models (LLMs), RLHF and related resources (continually updated)
  ☆24Updated 2 years ago
• arcee-ai / DAM
  ☆54Updated 10 months ago
• skypilot-org / skypilot-tutorial
  Tutorial to get started with SkyPilot!
  ☆58Updated last year
• fw-ai / benchmark
  Benchmark suite for LLMs from Fireworks.ai
  ☆83Updated 2 weeks ago