Alternatives and similar repositories for llm-cost-estimator

Users that are interested in llm-cost-estimator are comparing it to the libraries listed below

• bentoml / BentoLMDeploy
  Self-host LLMs with LMDeploy and BentoML
  ☆20Updated last week
• GreenBitAI / low_bit_llama
  Advanced Ultra-Low Bitrate Compression Techniques for the LLaMA Family of LLMs
  ☆110Updated last year
• EmbeddedLLM / vllm
  vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆87Updated this week
• zenrran4nlp / Awesome-LLM-Inference-Serving
  ☆36Updated 2 months ago
• AutonomicPerfectionist / PipeInfer
  PipeInfer: Accelerating LLM Inference using Asynchronous Pipelined Speculation
  ☆30Updated 8 months ago
• Cerebras / DocChat
  GPT-4 Level Conversational QA Trained In a Few Hours
  ☆63Updated 10 months ago
• katsumiok / pyaskit
  AskIt: Unified programming interface for programming with LLMs (GPT-3.5, GPT-4, Gemini, Claude, Cohere, Llama 2)
  ☆79Updated 6 months ago
• NolanoOrg / SpectraSuite
  ☆49Updated last year
• huggingface / kernel-builder
  👷 Build compute kernels
  ☆77Updated this week
• LLM360 / amber-data-prep
  Data preparation code for Amber 7B LLM
  ☆91Updated last year
• matthewrenze / jhu-concise-cot
  The Benefits of a Concise Chain of Thought on Problem Solving in Large Language Models
  ☆22Updated 7 months ago
• s-smits / grpo-optuna
  Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna
  ☆55Updated 5 months ago
• chu-tianxiang / QuIP-for-all
  QuIP quantization
  ☆54Updated last year
• samchaineau / llm_slerp_generation
  Repo hosting codes and materials related to speeding LLMs' inference using token merging.
  ☆36Updated last year
• ScalingIntelligence / good-kernels
  Samples of good AI generated CUDA kernels
  ☆84Updated last month
• LLM360 / crystalcoder-data-prep
  Data preparation code for CrystalCoder 7B LLM
  ☆45Updated last year
• xjdr-alt / mla_blog_translation
  ☆13Updated last year
• abdelfattah-lab / nitro
  Lightweight Python Wrapper for OpenVINO, enabling LLM inference on NPUs
  ☆21Updated 7 months ago
• LLM360 / crystalcoder-train
  Pre-training code for CrystalCoder 7B LLM
  ☆54Updated last year
• vcskaushik / LLMzip
  ☆57Updated 6 months ago
• LLM360 / Analysis360
  Open Implementations of LLM Analyses
  ☆105Updated 9 months ago
• IST-DASLab / QIGen
  Repository for CPU Kernel Generation for LLM Inference
  ☆26Updated 2 years ago
• facebookresearch / matrix
  Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…
  ☆73Updated 2 weeks ago
• catena-labs / moa-llm
  A Python library to orchestrate LLMs in a neural network-inspired structure
  ☆49Updated 9 months ago
• graphcore-research / unit-scaling-demo
  Unit Scaling demo and experimentation code
  ☆16Updated last year
• serp-ai / Parameter-Efficient-MoE
  Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks
  ☆31Updated last year
• microsoft / Evoke
  Everything for the Paper: 'Evoke: Evoking Critical Thinking Abilities in LLMs via Reviewer-Author Prompt Editing'
  ☆16Updated last year
• argilla-io / awesome-llm-datasets
  👩🤝🤖 A curated list of datasets for large language models (LLMs), RLHF and related resources (continually updated)
  ☆23Updated 2 years ago
• hahnyuan / PB-LLM
  PB-LLM: Partially Binarized Large Language Models
  ☆152Updated last year
• tyler-griggs / melange-release
  ☆47Updated last year