Alternatives and similar repositories for llm-perf-backend

Users that are interested in llm-perf-backend are comparing it to the libraries listed below

• IlyasMoutawwakil / py-txi
  A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.
  ☆33Updated last month
• chainyo / tensorshare
  🤝 Trade any tensors over the network
  ☆30Updated last year
• AnswerDotAI / ModernBERT-Instruct-mini-cookbook
  ☆47Updated 4 months ago
• hamelsmu / llama-inference
  experiments with inference on llama
  ☆104Updated last year
• weaviate-tutorials / Hurricane
  Writing Blog Posts with Generative Feedback Loops!
  ☆48Updated last year
• pacman100 / peft-codegen-25
  ☆23Updated last year
• aniketmaurya / fastserve-ai
  Machine Learning Serving focused on GenAI with simplicity as the top priority.
  ☆59Updated 2 months ago
• kevinwu23 / StanfordFineTuneBench
  ☆30Updated 7 months ago
• davanstrien / data-for-fine-tuning-llms
  ☆77Updated last year
• PrithivirajDamodaran / blitz-embed
  C++ inference wrappers for running blazing fast embedding services on your favourite serverless like AWS Lambda. By Prithivi Da, PRs welc…
  ☆22Updated last year
• substratusai / vllm-docker
  ☆62Updated 2 months ago
• Alignment-Lab-AI / datagen
  a pipeline for using api calls to agnostically convert unstructured data into structured training data
  ☆30Updated 9 months ago
• louisbrulenaudet / ragoon
  High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡
  ☆66Updated 7 months ago
• hamelsmu / ft-drift
  Check for data drift between two OpenAI multi-turn chat jsonl files.
  ☆37Updated last year
• bentoml / sentence-embedding-bento
  Sentence Embedding as a Service
  ☆15Updated last year
• enjalot / latent-data-modal
  Using modal.com to process FineWeb-edu data
  ☆20Updated 2 months ago
• rwightman / genalog
  Genalog is an open source, cross-platform python package allowing generation of synthetic document images with custom degradations and te…
  ☆42Updated last year
• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆49Updated 11 months ago
• datavistics / encoder-analysis
  Analysis on the cost of encoder based models
  ☆11Updated 4 months ago
• huggingface / kernel-builder
  👷 Build compute kernels
  ☆68Updated this week
• CarperAI / decontamination
  This repository contains code for cleaning your training data of benchmark data to help combat data snooping.
  ☆25Updated 2 years ago
• S1M0N38 / dspy-arxiv
  Explore the use of DSPy for extracting features from PDFs 🔎
  ☆40Updated last year
• explodinggradients / Funtuner
  Supervised instruction finetuning for LLM with HF trainer and Deepspeed
  ☆35Updated last year
• neoxelox / dspy-inspector
  DSPy program/pipeline inspector widget for Jupyter/VSCode Notebooks.
  ☆35Updated last year
• PrithivirajDamodaran / SPLADERunner
  Lite weight wrapper for the independent implementation of SPLADE++ models for search & retrieval pipelines. Models and Library created by…
  ☆31Updated 10 months ago
• interstellarninja / function-calling-eval
  A framework for evaluating function calls made by LLMs
  ☆37Updated 11 months ago
• v-prgmr / mergekit
  Tools for merging pretrained large language models.
  ☆19Updated last year
• langchain-ai / prompt-eval-recommendation
  Streamlit app for recommending eval functions using prompt diffs
  ☆27Updated last year
• CarperAI / squeakily
  A library for squeakily cleaning and filtering language datasets.
  ☆47Updated last year
• tensorchord / inference-benchmark
  Benchmark for machine learning model online serving (LLM, embedding, Stable-Diffusion, Whisper)
  ☆28Updated last year