Alternatives and similar repositories for llm-perf-backend:

Users that are interested in llm-perf-backend are comparing it to the libraries listed below

• IlyasMoutawwakil / py-txi
  A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.
  ☆34Updated last month
• chainyo / tensorshare
  🤝 Trade any tensors over the network
  ☆30Updated last year
• bipul1010 / agents_tutorial
  ☆19Updated 5 months ago
• pacman100 / peft-codegen-25
  ☆24Updated last year
• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆48Updated 6 months ago
• enjalot / fineweb-modal
  Using modal.com to process FineWeb-edu data
  ☆19Updated last month
• skypilot-org / skypilot-tutorial
  Tutorial to get started with SkyPilot!
  ☆56Updated 8 months ago
• aniketmaurya / fastserve-ai
  Machine Learning Serving focused on GenAI with simplicity as the top priority.
  ☆58Updated last week
• Upaya07 / NeurIPS-llm-efficiency-challenge
  Code for NeurIPS LLM Efficiency Challenge
  ☆54Updated 9 months ago
• AnswerDotAI / toolslm
  Tools to make language models a bit easier to use
  ☆32Updated last month
• langchain-ai / prompt-eval-recommendation
  Streamlit app for recommending eval functions using prompt diffs
  ☆26Updated last year
• hamelsmu / llama-inference
  experiments with inference on llama
  ☆104Updated 7 months ago
• Alignment-Lab-AI / datagen
  a pipeline for using api calls to agnostically convert unstructured data into structured training data
  ☆29Updated 3 months ago
• v-prgmr / mergekit
  Tools for merging pretrained large language models.
  ☆19Updated 7 months ago
• davanstrien / data-for-fine-tuning-llms
  ☆76Updated 7 months ago
• lancedb / ragged
  ☆18Updated 3 months ago
• arcee-ai / DAM
  ☆46Updated 2 months ago
• hamelsmu / ft-drift
  Check for data drift between two OpenAI multi-turn chat jsonl files.
  ☆37Updated 9 months ago
• replicate / cog-vllm
  Run LLMs on Replicate with vLLM
  ☆15Updated 3 months ago
• explodinggradients / Funtuner
  Supervised instruction finetuning for LLM with HF trainer and Deepspeed
  ☆34Updated last year
• huggingface / hf-endpoints-documentation
  ☆16Updated this week
• TuanaCelik / unstructuredio-haystack
  💙 Unstructured Data Connectors for Haystack 2.0
  ☆16Updated last year
• kevinwu23 / StanfordFineTuneBench
  ☆27Updated 2 months ago
• opendatahub-io / vllm-tgis-adapter
  vLLM adapter for a TGIS-compatible gRPC server.
  ☆15Updated this week
• stas00 / ml-ways
  ML/DL Math and Method notes
  ☆57Updated last year
• louisbrulenaudet / ragoon
  High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡
  ☆62Updated 2 months ago
• official-elinas / zeus-llm-trainer
  Zeus LLM Trainer is a rewrite of Stanford Alpaca aiming to be the trainer for all Large Language Models
  ☆70Updated last year
• axiomic-ai / axiomic
  Creating Generative AI Apps which work
  ☆16Updated 6 months ago