Alternatives and similar repositories for llm-perf-backend

Users that are interested in llm-perf-backend are comparing it to the libraries listed below

• IlyasMoutawwakil / py-txi
  A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.
  ☆32Updated 4 months ago
• hamelsmu / llama-inference
  experiments with inference on llama
  ☆103Updated last year
• Alignment-Lab-AI / datagen
  a pipeline for using api calls to agnostically convert unstructured data into structured training data
  ☆32Updated last year
• stas00 / ml-ways
  ML/DL Math and Method notes
  ☆66Updated 2 years ago
• aniketmaurya / fastserve-ai
  Machine Learning Serving focused on GenAI with simplicity as the top priority.
  ☆59Updated 3 weeks ago
• AnswerDotAI / ModernBERT-Instruct-mini-cookbook
  ☆53Updated 11 months ago
• rragundez / chunkdot
  Multi-threaded matrix multiplication and cosine similarity calculations for dense and sparse matrices. Appropriate for calculating the K …
  ☆86Updated last year
• premAI-io / benchmarks
  🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.
  ☆138Updated last year
• muellerzr / nbdistributed
  Seemless interface of using PyTOrch distributed with Jupyter notebooks
  ☆57Updated 4 months ago
• pacman100 / peft-codegen-25
  ☆23Updated 2 years ago
• chainyo / tensorshare
  🤝 Trade any tensors over the network
  ☆31Updated 2 years ago
• Preemo-Inc / text-generation-inference
  ☆198Updated last year
• AnswerDotAI / toolslm
  Tools to make language models a bit easier to use
  ☆64Updated last week
• teknium1 / LLM-Benchmark-Logs
  Just a bunch of benchmark logs for different LLMs
  ☆119Updated last year
• titanml / takeoff-community
  TitanML Takeoff Server is an optimization, compression and deployment platform that makes state of the art machine learning models access…
  ☆114Updated 2 years ago
• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆51Updated last year
• ChrisHayduk / qlora-multi-gpu
  QLoRA with Enhanced Multi GPU Support
  ☆37Updated 2 years ago
• huggingface / optimum-tpu
  Google TPU optimizations for transformers models
  ☆135Updated last week
• kevinwu23 / StanfordFineTuneBench
  ☆31Updated last year
• davanstrien / data-for-fine-tuning-llms
  ☆80Updated last year
• official-elinas / zeus-llm-trainer
  Zeus LLM Trainer is a rewrite of Stanford Alpaca aiming to be the trainer for all Large Language Models
  ☆70Updated 2 years ago
• s-smits / grpo-optuna
  Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna
  ☆59Updated 3 months ago
• louisbrulenaudet / ragoon
  High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡
  ☆69Updated 2 months ago
• Lightning-Universe / DiffusionWithAutoscaler
  DiffusionWithAutoscaler
  ☆29Updated last year
• substratusai / vllm-docker
  ☆67Updated 10 months ago
• Upaya07 / NeurIPS-llm-efficiency-challenge
  Code for NeurIPS LLM Efficiency Challenge
  ☆60Updated last year
• deployradiant / pychatml
  Chat Markup Language conversation library
  ☆55Updated 2 years ago
• huggingface / huggingface-inference-toolkit
  Hugging Face Inference Toolkit used to serve transformers, sentence-transformers, and diffusers models.
  ☆90Updated 3 weeks ago
• AblateIt / finetune-study
  Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.
  ☆83Updated 2 years ago
• rwightman / genalog
  Genalog is an open source, cross-platform python package allowing generation of synthetic document images with custom degradations and te…
  ☆44Updated 2 years ago