Alternatives and similar repositories for llm-perf-backend:

Users that are interested in llm-perf-backend are comparing it to the libraries listed below

• IlyasMoutawwakil / py-txi
  A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.
  ☆34Updated 3 months ago
• Alignment-Lab-AI / datagen
  a pipeline for using api calls to agnostically convert unstructured data into structured training data
  ☆29Updated 6 months ago
• chainyo / tensorshare
  🤝 Trade any tensors over the network
  ☆30Updated last year
• pacman100 / peft-codegen-25
  ☆24Updated last year
• hamelsmu / llama-inference
  experiments with inference on llama
  ☆104Updated 9 months ago
• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆49Updated 8 months ago
• substratusai / vllm-docker
  ☆54Updated 2 months ago
• hamelsmu / ft-drift
  Check for data drift between two OpenAI multi-turn chat jsonl files.
  ☆38Updated 11 months ago
• PrithivirajDamodaran / blitz-embed
  C++ inference wrappers for running blazing fast embedding services on your favourite serverless like AWS Lambda. By Prithivi Da, PRs welc…
  ☆21Updated last year
• kevinwu23 / StanfordFineTuneBench
  ☆27Updated 4 months ago
• fw-ai / benchmark
  Benchmark suite for LLMs from Fireworks.ai
  ☆69Updated last month
• CarperAI / treasure_trove
  ☆22Updated last year
• weaviate-tutorials / Hurricane
  Writing Blog Posts with Generative Feedback Loops!
  ☆47Updated last year
• Percent-BFD / neurips_submission
  ☆15Updated last year
• rwightman / genalog
  Genalog is an open source, cross-platform python package allowing generation of synthetic document images with custom degradations and te…
  ☆42Updated last year
• langchain-ai / prompt-eval-recommendation
  Streamlit app for recommending eval functions using prompt diffs
  ☆27Updated last year
• enjalot / latent-data-modal
  Using modal.com to process FineWeb-edu data
  ☆20Updated 2 weeks ago
• Upaya07 / NeurIPS-llm-efficiency-challenge
  Code for NeurIPS LLM Efficiency Challenge
  ☆57Updated 11 months ago
• S1M0N38 / dspy-arxiv
  Explore the use of DSPy for extracting features from PDFs 🔎
  ☆39Updated last year
• AblateIt / finetune-study
  Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.
  ☆82Updated last year
• bentoml / BentoVLLM
  Self-host LLMs with vLLM and BentoML
  ☆94Updated this week
• aniketmaurya / fastserve-ai
  Machine Learning Serving focused on GenAI with simplicity as the top priority.
  ☆58Updated 2 months ago
• davanstrien / data-for-fine-tuning-llms
  ☆76Updated 9 months ago
• BBischof / yapping
  Verbosity control for AI agents
  ☆60Updated 9 months ago
• arcee-ai / DAM
  ☆48Updated 4 months ago
• withmartian / leaderboard-backend
  Open sourced backend for Martian's LLM Inference Provider Leaderboard
  ☆17Updated 7 months ago
• bentoml / sentence-embedding-bento
  Sentence Embedding as a Service
  ☆15Updated last year