Alternatives and similar repositories for llm-perf-backend

Users that are interested in llm-perf-backend are comparing it to the libraries listed below

• IlyasMoutawwakil / py-txi
  A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.
  ☆33Updated last month
• stas00 / ml-ways
  ML/DL Math and Method notes
  ☆64Updated last year
• skypilot-org / skypilot-tutorial
  Tutorial to get started with SkyPilot!
  ☆57Updated last year
• hamelsmu / llama-inference
  experiments with inference on llama
  ☆103Updated last year
• chainyo / tensorshare
  🤝 Trade any tensors over the network
  ☆30Updated 2 years ago
• Alignment-Lab-AI / datagen
  a pipeline for using api calls to agnostically convert unstructured data into structured training data
  ☆31Updated last year
• AnswerDotAI / ModernBERT-Instruct-mini-cookbook
  ☆49Updated 8 months ago
• teknium1 / LLM-Benchmark-Logs
  Just a bunch of benchmark logs for different LLMs
  ☆118Updated last year
• fw-ai / benchmark
  Benchmark suite for LLMs from Fireworks.ai
  ☆82Updated last week
• ChrisHayduk / qlora-multi-gpu
  QLoRA with Enhanced Multi GPU Support
  ☆37Updated 2 years ago
• pacman100 / peft-codegen-25
  ☆23Updated 2 years ago
• substratusai / vllm-docker
  ☆64Updated 6 months ago
• aniketmaurya / fastserve-ai
  Machine Learning Serving focused on GenAI with simplicity as the top priority.
  ☆58Updated 2 weeks ago
• kevinwu23 / StanfordFineTuneBench
  ☆31Updated 11 months ago
• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆50Updated last year
• Upaya07 / NeurIPS-llm-efficiency-challenge
  Code for NeurIPS LLM Efficiency Challenge
  ☆59Updated last year
• Preemo-Inc / text-generation-inference
  ☆197Updated last year
• rwightman / genalog
  Genalog is an open source, cross-platform python package allowing generation of synthetic document images with custom degradations and te…
  ☆43Updated last year
• huggingface / optimum-tpu
  Google TPU optimizations for transformers models
  ☆120Updated 9 months ago
• Snowflake-Labs / vllm
  ☆15Updated last month
• titanml / takeoff-community
  TitanML Takeoff Server is an optimization, compression and deployment platform that makes state of the art machine learning models access…
  ☆114Updated last year
• louisbrulenaudet / ragoon
  High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡
  ☆67Updated 11 months ago
• muellerzr / nbdistributed
  Seemless interface of using PyTOrch distributed with Jupyter notebooks
  ☆51Updated last month
• huggingface / huggingface-inference-toolkit
  Hugging Face Inference Toolkit used to serve transformers, sentence-transformers, and diffusers models.
  ☆88Updated last month
• premAI-io / benchmarks
  🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.
  ☆139Updated last year
• official-elinas / zeus-llm-trainer
  Zeus LLM Trainer is a rewrite of Stanford Alpaca aiming to be the trainer for all Large Language Models
  ☆69Updated 2 years ago
• daniel-furman / sft-demos
  Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.
  ☆78Updated last year
• automix-llm / automix
  Mixing Language Models with Self-Verification and Meta-Verification
  ☆109Updated 10 months ago
• davanstrien / haiku-dpo
  Using open source LLMs to build synthetic datasets for direct preference optimization
  ☆68Updated last year
• weaviate-tutorials / Hurricane
  Writing Blog Posts with Generative Feedback Loops!
  ☆50Updated last year