Alternatives and similar repositories for llm-cost-estimator:

Users that are interested in llm-cost-estimator are comparing it to the libraries listed below

• AutonomicPerfectionist / PipeInfer
  PipeInfer: Accelerating LLM Inference using Asynchronous Pipelined Speculation
  ☆24Updated 2 months ago
• mlc-ai / mlc-python
  ☆21Updated this week
• tyler-griggs / melange-release
  ☆43Updated 7 months ago
• intel / llm-on-ray
  Pretrain, finetune and serve LLMs on Intel platforms with Ray
  ☆110Updated 2 months ago
• skypilot-org / sky-llama
  ☆25Updated last year
• LAION-AI / Desktop-BUD-E_V1.0
  BUD-E (Buddy) is an open-source voice assistant framework that facilitates seamless interaction with AI models and APIs, enabling the cre…
  ☆17Updated 3 months ago
• g-aggarwal / mlx-hub
  A python command-line tool to download & manage MLX AI models from Hugging Face.
  ☆17Updated 5 months ago
• microsoft / cusync
  ☆25Updated 11 months ago
• PirateforFreedom / TypeAgent
  Luann allows you to create a LLM agent,which has complete memory module (long-term memory, short-term memory) and knowledge module（Variou…
  ☆18Updated 3 weeks ago
• illinois-impact / klap
  A source-to-source compiler for optimizing CUDA dynamic parallelism by aggregating launches
  ☆14Updated 5 years ago
• fixie-ai / ai-benchmarks
  Benchmarking suite for popular AI APIs
  ☆80Updated 2 months ago
• mlc-ai / web-llm-assistant
  AI Assistant running within your browser.
  ☆57Updated last month
• GreenBitAI / green-bit-llm
  A toolkit for fine-tuning, inferencing, and evaluating GreenBitAI's LLMs.
  ☆80Updated last week
• eth-easl / deltazip
  Compression for Foundation Models
  ☆21Updated this week
• microsoft / DeepSpeed-Kernels
  ☆58Updated 8 months ago
• argilla-io / awesome-llm-datasets
  👩🤝🤖 A curated list of datasets for large language models (LLMs), RLHF and related resources (continually updated)
  ☆22Updated last year
• kyegomez / SwarmOS
  An all-new OS that orchestrates autonomous agents as workers to execute tasks.
  ☆17Updated 2 months ago
• facebookresearch / dual-system-for-visual-language-reasoning
  Github repo for Peifeng's internship project
  ☆13Updated last year
• laramohan / wikillm
  LLMs as Collaboratively Edited Knowledge Bases
  ☆43Updated 11 months ago
• JakeFurtaw / Chat-RAG
  Uses a Gradio interface to stream coding related responses from local and cloud based large language models. Pulls context from GitHub Re…
  ☆19Updated 4 months ago
• saic-fi / MobileQuant
  [EMNLP Findings 2024] MobileQuant: Mobile-friendly Quantization for On-device Language Models
  ☆54Updated 4 months ago
• AlpinDale / QuIP-for-Llama
  Code for paper: "QuIP: 2-Bit Quantization of Large Language Models With Guarantees" adapted for Llama models
  ☆36Updated last year
• mlc-ai / llm-perf-bench
  ☆116Updated 9 months ago
• SciPhi-AI / R2R-rag-prebuilt
  ☆11Updated 5 months ago
• langchain-ai / prompt-eval-recommendation
  Streamlit app for recommending eval functions using prompt diffs
  ☆27Updated last year
• opendatahub-io / vllm-tgis-adapter
  vLLM adapter for a TGIS-compatible gRPC server.
  ☆17Updated this week
• lamini-ai / llm-operator
  Prototype Operator
  ☆24Updated 7 months ago
• roboflow / cog-vlm-client
  Simple CogVLM client script
  ☆14Updated last year
• phunterlau / paper_without_code
  LLM reads a paper and produce a working prototype
  ☆48Updated last month
• vedantroy / gpu_kernels
  ☆25Updated last year