Alternatives and similar repositories for llm-cost-estimator

Users that are interested in llm-cost-estimator are comparing it to the libraries listed below

• eth-easl / deltazip
  Compression for Foundation Models
  ☆31Updated 2 months ago
• huggingface / kernel-builder
  👷 Build compute kernels
  ☆44Updated this week
• IST-DASLab / SparseFinetuning
  Repository for Sparse Finetuning of LLMs via modified version of the MosaicML llmfoundry
  ☆42Updated last year
• IST-DASLab / QIGen
  Repository for CPU Kernel Generation for LLM Inference
  ☆26Updated last year
• mayank31398 / ladder-residual-inference
  ☆13Updated 3 weeks ago
• chu-tianxiang / QuIP-for-all
  QuIP quantization
  ☆52Updated last year
• UmerHA / triton_util
  Make triton easier
  ☆47Updated 11 months ago
• argilla-io / awesome-llm-datasets
  👩🤝🤖 A curated list of datasets for large language models (LLMs), RLHF and related resources (continually updated)
  ☆23Updated 2 years ago
• foundation-model-stack / fms-model-optimizer
  FMS Model Optimizer is a framework for developing reduced precision neural network models.
  ☆20Updated this week
• guidance-ai / jsonschemabench
  ☆39Updated last month
• opendatahub-io / vllm-tgis-adapter
  vLLM adapter for a TGIS-compatible gRPC server.
  ☆30Updated this week
• deepspeedai / DeepSpeed-Kernels
  ☆71Updated 2 months ago
• EmbeddedLLM / vllm
  vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆86Updated this week
• logikon-ai / cot-eval
  A framework for evaluating the effectiveness of chain-of-thought reasoning in language models.
  ☆17Updated 4 months ago
• zenrran4nlp / Awesome-LLM-Inference-Serving
  ☆33Updated last month
• AlpinDale / QuIP-for-Llama
  Code for paper: "QuIP: 2-Bit Quantization of Large Language Models With Guarantees" adapted for Llama models
  ☆35Updated last year
• Michaelvll / llm-ie-benchmarks
  A collection of reproducible inference engine benchmarks
  ☆31Updated last month
• skypilot-org / skypilot-tutorial
  Tutorial to get started with SkyPilot!
  ☆57Updated last year
• ScalingIntelligence / good-kernels
  Samples of good AI generated CUDA kernels
  ☆65Updated last week
• NolanoOrg / SpectraSuite
  ☆48Updated 10 months ago
• catid / lllm
  Latent Large Language Models
  ☆18Updated 9 months ago
• evanatyourservice / llm-jax
  Train a SmolLM-style llm on fineweb-edu in JAX/Flax with an assortment of optimizers.
  ☆17Updated 2 months ago
• nexusflowai / NexusBench
  Nexusflow function call, tool use, and agent benchmarks.
  ☆19Updated 5 months ago
• kyegomez / Exa
  Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and min…
  ☆26Updated 6 months ago
• IST-DASLab / Quartet
  ☆46Updated last week
• fblgit / model-similarity
  Simple Model Similarities Analysis
  ☆21Updated last year
• kyegomez / SelfExtend
  Implementation of SelfExtend from the paper "LLM Maybe LongLM: Self-Extend LLM Context Window Without Tuning" from Pytorch and Zeta
  ☆13Updated 6 months ago
• minosvasilias / simple_grpo
  Simple GRPO scripts and configurations.
  ☆58Updated 4 months ago
• google-deepmind / asyncdiloco
  ☆44Updated last year
• LLM360 / k2-data-prep
  ☆20Updated last year