Alternatives and similar repositories for llm-cost-estimator:

Users that are interested in llm-cost-estimator are comparing it to the libraries listed below

• kyegomez / Exa
  Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and min…
  ☆26Updated 5 months ago
• EmbeddedLLM / vllm
  vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆86Updated this week
• AutonomicPerfectionist / PipeInfer
  PipeInfer: Accelerating LLM Inference using Asynchronous Pipelined Speculation
  ☆29Updated 5 months ago
• deepspeedai / DeepSpeed-Kernels
  ☆68Updated 3 weeks ago
• tyler-griggs / melange-release
  ☆45Updated 9 months ago
• GreenBitAI / green-bit-llm
  A toolkit for fine-tuning, inferencing, and evaluating GreenBitAI's LLMs.
  ☆82Updated last month
• eth-easl / deltazip
  Compression for Foundation Models
  ☆31Updated 3 weeks ago
• xaedes / llama.cpp
  Port of Facebook's LLaMA model in C/C++
  ☆20Updated last year
• Just-Curieous / Curie
  ❓Curie: Automated and Rigorous Scientific Experimentation with AI Agents
  ☆77Updated this week
• Cerebras / DocChat
  GPT-4 Level Conversational QA Trained In a Few Hours
  ☆60Updated 8 months ago
• NolanoOrg / SpectraSuite
  ☆46Updated 9 months ago
• kyegomez / SwarmOS
  An all-new OS that orchestrates autonomous agents as workers to execute tasks.
  ☆17Updated 5 months ago
• catid / lllm
  Latent Large Language Models
  ☆17Updated 8 months ago
• GreenBitAI / low_bit_llama
  Advanced Ultra-Low Bitrate Compression Techniques for the LLaMA Family of LLMs
  ☆111Updated last year
• nexusflowai / NexusBench
  Nexusflow function call, tool use, and agent benchmarks.
  ☆19Updated 4 months ago
• LLM360 / crystalcoder-data-prep
  Data preparation code for CrystalCoder 7B LLM
  ☆44Updated 11 months ago
• s-smits / grpo-optuna
  Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna
  ☆39Updated 2 months ago
• AlpinDale / QuIP-for-Llama
  Code for paper: "QuIP: 2-Bit Quantization of Large Language Models With Guarantees" adapted for Llama models
  ☆35Updated last year
• argilla-io / awesome-llm-datasets
  👩🤝🤖 A curated list of datasets for large language models (LLMs), RLHF and related resources (continually updated)
  ☆23Updated last year
• bentoml / BentoLMDeploy
  Self-host LLMs with LMDeploy and BentoML
  ☆18Updated last month
• SqueezeAILab / Tool2Vec
  Efficient and Scalable Estimation of Tool Representations in Vector Space
  ☆23Updated 7 months ago
• xjdr-alt / mla_blog_translation
  ☆13Updated 10 months ago
• serp-ai / Parameter-Efficient-MoE
  Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks
  ☆31Updated 11 months ago
• merrymercy / Awesome-Efficient-LLM
  A curated list for Efficient Large Language Models
  ☆11Updated last year
• samchaineau / llm_slerp_generation
  Repo hosting codes and materials related to speeding LLMs' inference using token merging.
  ☆36Updated 11 months ago
• The-Swarm-Corporation / AgentParse
  AgentParse is a high-performance parsing library designed to map various structured data formats (such as Pydantic models, JSON, YAML, an…
  ☆13Updated this week
• ajtejankar / mixtral-vis-moe
  Visualize expert firing frequencies across sentences in the Mixtral MoE model
  ☆17Updated last year
• tile-ai / tvm
  Open deep learning compiler stack for cpu, gpu and specialized accelerators
  ☆18Updated this week
• mscheong01 / speculative_decoding.c
  minimal C implementation of speculative decoding based on llama2.c
  ☆22Updated 9 months ago
• Michaelvll / llm-ie-benchmarks
  A collection of reproducible inference engine benchmarks
  ☆24Updated this week