Alternatives and similar repositories for llm-perf-backend

Users that are interested in llm-perf-backend are comparing it to the libraries listed below

• IlyasMoutawwakil / py-txi
  A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.
  ☆34Updated 3 weeks ago
• AnswerDotAI / ModernBERT-Instruct-mini-cookbook
  ☆43Updated 3 months ago
• chainyo / tensorshare
  🤝 Trade any tensors over the network
  ☆30Updated last year
• pacman100 / peft-codegen-25
  ☆23Updated last year
• S1M0N38 / dspy-arxiv
  Explore the use of DSPy for extracting features from PDFs 🔎
  ☆40Updated last year
• Alignment-Lab-AI / datagen
  a pipeline for using api calls to agnostically convert unstructured data into structured training data
  ☆29Updated 8 months ago
• Upaya07 / NeurIPS-llm-efficiency-challenge
  Code for NeurIPS LLM Efficiency Challenge
  ☆58Updated last year
• aniketmaurya / fastserve-ai
  Machine Learning Serving focused on GenAI with simplicity as the top priority.
  ☆57Updated last month
• bentoml / BentoLMDeploy
  Self-host LLMs with LMDeploy and BentoML
  ☆19Updated 2 months ago
• substratusai / vllm-docker
  ☆60Updated 2 months ago
• tanyuqian / cappy
  NeurIPS 2023 - Cappy: Outperforming and Boosting Large Multi-Task LMs with a Small Scorer
  ☆43Updated last year
• weaviate-tutorials / Hurricane
  Writing Blog Posts with Generative Feedback Loops!
  ☆48Updated last year
• LAION-AI / blade2blade
  Adversarial Training and SFT for Bot Safety Models
  ☆40Updated 2 years ago
• cognitivecomputations / SystemChat
  ☆30Updated 10 months ago
• lancedb / ragged
  ☆19Updated 7 months ago
• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆49Updated 10 months ago
• Michaelvll / llm-ie-benchmarks
  A collection of reproducible inference engine benchmarks
  ☆31Updated last month
• bentoml / sentence-embedding-bento
  Sentence Embedding as a Service
  ☆15Updated last year
• kevinwu23 / StanfordFineTuneBench
  ☆29Updated 6 months ago
• Snowflake-Labs / vllm
  ☆15Updated 2 months ago
• v-prgmr / mergekit
  Tools for merging pretrained large language models.
  ☆19Updated 11 months ago
• illuin-tech / contextual-embeddings
  Model implementation for the contextual embeddings project
  ☆26Updated this week
• JoshuaPurtell / SmallBench
  Small, simple agent task environments for training and evaluation
  ☆18Updated 7 months ago
• stas00 / ml-ways
  ML/DL Math and Method notes
  ☆61Updated last year
• davidberenstein1957 / dataset-viber
  Dataset Viber is your chill repo for data collection, annotation and vibe checks.
  ☆47Updated 8 months ago
• datavistics / encoder-analysis
  Analysis on the cost of encoder based models
  ☆11Updated 3 months ago
• hamelsmu / ft-drift
  Check for data drift between two OpenAI multi-turn chat jsonl files.
  ☆37Updated last year
• argilla-io / distilabel-spin-dibt
  Repository containing the SPIN experiments on the DIBT 10k ranked prompts
  ☆24Updated last year
• PrithivirajDamodaran / blitz-embed
  C++ inference wrappers for running blazing fast embedding services on your favourite serverless like AWS Lambda. By Prithivi Da, PRs welc…
  ☆22Updated last year
• rwightman / genalog
  Genalog is an open source, cross-platform python package allowing generation of synthetic document images with custom degradations and te…
  ☆42Updated last year