Alternatives and similar repositories for llm-perf-backend

Users that are interested in llm-perf-backend are comparing it to the libraries listed below

• IlyasMoutawwakil / py-txi
  A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.
  ☆33Updated 2 months ago
• hamelsmu / llama-inference
  experiments with inference on llama
  ☆104Updated last year
• aniketmaurya / fastserve-ai
  Machine Learning Serving focused on GenAI with simplicity as the top priority.
  ☆59Updated last week
• chainyo / tensorshare
  🤝 Trade any tensors over the network
  ☆30Updated last year
• titanml / takeoff-community
  TitanML Takeoff Server is an optimization, compression and deployment platform that makes state of the art machine learning models access…
  ☆114Updated last year
• substratusai / vllm-docker
  ☆62Updated 3 months ago
• pacman100 / peft-codegen-25
  ☆23Updated 2 years ago
• ChrisHayduk / qlora-multi-gpu
  QLoRA with Enhanced Multi GPU Support
  ☆37Updated last year
• stas00 / ml-ways
  ML/DL Math and Method notes
  ☆61Updated last year
• kevinwu23 / StanfordFineTuneBench
  ☆30Updated 8 months ago
• huggingface / huggingface-inference-toolkit
  Hugging Face Inference Toolkit used to serve transformers, sentence-transformers, and diffusers models.
  ☆82Updated this week
• CarperAI / treasure_trove
  ☆22Updated last year
• Preemo-Inc / text-generation-inference
  ☆199Updated last year
• AnswerDotAI / ModernBERT-Instruct-mini-cookbook
  ☆48Updated 5 months ago
• teknium1 / LLM-Benchmark-Logs
  Just a bunch of benchmark logs for different LLMs
  ☆119Updated 11 months ago
• official-elinas / zeus-llm-trainer
  Zeus LLM Trainer is a rewrite of Stanford Alpaca aiming to be the trainer for all Large Language Models
  ☆69Updated last year
• louisbrulenaudet / ragoon
  High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡
  ☆66Updated 8 months ago
• premAI-io / benchmarks
  🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.
  ☆137Updated 11 months ago
• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆49Updated last year
• fw-ai / benchmark
  Benchmark suite for LLMs from Fireworks.ai
  ☆76Updated last week
• Upaya07 / NeurIPS-llm-efficiency-challenge
  Code for NeurIPS LLM Efficiency Challenge
  ☆59Updated last year
• TuanaCelik / unstructuredio-haystack
  💙 Unstructured Data Connectors for Haystack 2.0
  ☆17Updated last year
• Alignment-Lab-AI / datagen
  a pipeline for using api calls to agnostically convert unstructured data into structured training data
  ☆30Updated 9 months ago
• langchain-ai / prompt-eval-recommendation
  Streamlit app for recommending eval functions using prompt diffs
  ☆28Updated last year
• automix-llm / automix
  Mixing Language Models with Self-Verification and Meta-Verification
  ☆106Updated 7 months ago
• skypilot-org / skypilot-tutorial
  Tutorial to get started with SkyPilot!
  ☆58Updated last year
• davanstrien / haiku-dpo
  Using open source LLMs to build synthetic datasets for direct preference optimization
  ☆64Updated last year
• anyscale / e2e-llm-workflows
  Fine-tune an LLM to perform batch inference and online serving.
  ☆112Updated last month
• davanstrien / data-for-fine-tuning-llms
  ☆77Updated last year
• davidberenstein1957 / dataset-viber
  Dataset Viber is your chill repo for data collection, annotation and vibe checks.
  ☆47Updated 10 months ago