Alternatives and similar repositories for Efficiently-Serving-LLMs

Users that are interested in Efficiently-Serving-LLMs are comparing it to the libraries listed below

• anyscale / e2e-llm-workflows
  Fine-tune an LLM to perform batch inference and online serving.
  ☆112Updated last month
• daniel-furman / sft-demos
  Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.
  ☆77Updated 9 months ago
• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆49Updated last year
• microsoft / llm-data-creation
  Model, Code & Data for the EMNLP'23 paper "Making Large Language Models Better Data Creators"
  ☆135Updated last year
• tcapelle / llm_recipes
  A set of scripts and notebooks on LLM finetunning and dataset creation
  ☆110Updated 9 months ago
• ibm-self-serve-assets / SuperKnowa
  Build Enterprise RAG (Retriver Augmented Generation) Pipelines to tackle various Generative AI use cases with LLM's by simply plugging co…
  ☆112Updated last year
• IlyasMoutawwakil / py-txi
  A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.
  ☆33Updated 2 months ago
• rajshah4 / LLM-Evaluation
  Sample notebooks and prompts for LLM evaluation
  ☆135Updated last month
• infocusp / llm_seminar_series
  Material for the series of seminars on Large Language Models
  ☆34Updated last year
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆79Updated 10 months ago
• patronus-ai / Lynx-hallucination-detection
  ☆41Updated last year
• philschmid / evaluate-llms
  Includes examples on how to evaluate LLMs
  ☆23Updated 8 months ago
• davanstrien / data-for-fine-tuning-llms
  ☆77Updated last year
• apple / ml-superposition-prompting
  ☆145Updated last year
• modal-labs / stopwatch
  A tool for benchmarking LLMs on Modal
  ☆40Updated last week
• mrmaheshrajput / productionizing-llms
  Code Repository for Blog - How to Productionize Large Language Models (LLMs)
  ☆11Updated last year
• NielsRogge / awesome-huggingface
  Repository containing awesome resources regarding Hugging Face tooling.
  ☆47Updated last year
• ali-bahrainian / RAG_best_practices
  ☆94Updated 4 months ago
• PrithivirajDamodaran / Route0x
  Low latency, High Accuracy, Custom Query routers for Humans and Agents. Built by Prithivi Da
  ☆105Updated 3 months ago
• hamelsmu / llama-inference
  experiments with inference on llama
  ☆104Updated last year
• CVxTz / llm-serve-tutorial
  ☆20Updated last year
• explodinggradients / Funtuner
  Supervised instruction finetuning for LLM with HF trainer and Deepspeed
  ☆35Updated 2 years ago
• alopatenko / LLMEvaluation
  A comprehensive guide to LLM evaluation methods designed to assist in identifying the most suitable evaluation techniques for various use…
  ☆128Updated 2 weeks ago
• withmartian / routerbench
  The code for the paper ROUTERBENCH: A Benchmark for Multi-LLM Routing System
  ☆130Updated last year
• Abonia1 / Fine-Tuning-LLMs-Key-Concepts-and-Terms
  Fine-tuning large language models (LLMs) is crucial for enhancing performance across domain-specific task applications. This comprehensiv…
  ☆12Updated 10 months ago
• terryyz / llm-benchmark
  A list of LLM benchmark frameworks.
  ☆68Updated last year
• alperiox / Compact-Language-Models-via-Pruning-and-Knowledge-Distillation
  Unofficial implementation of https://arxiv.org/pdf/2407.14679
  ☆46Updated 10 months ago
• januverma / transformers-stuff
  Codes, scripts, and notebooks on various aspects of transformer models.
  ☆27Updated 2 years ago
• anyscale / multimodal-ai
  Multimodal AI workloads: batch inference, model training and online serving.
  ☆22Updated last month
• TrelisResearch / install-guides
  Various installation guides for Large Language Models
  ☆71Updated 3 months ago