Alternatives and similar repositories for Efficiently-Serving-LLMs

Users that are interested in Efficiently-Serving-LLMs are comparing it to the libraries listed below

• anyscale / e2e-llm-workflows
  Fine-tune an LLM to perform batch inference and online serving.
  ☆112Updated 3 months ago
• IlyasMoutawwakil / py-txi
  A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.
  ☆33Updated 3 months ago
• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆49Updated last year
• infocusp / llm_seminar_series
  Material for the series of seminars on Large Language Models
  ☆34Updated last year
• daniel-furman / sft-demos
  Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.
  ☆78Updated 10 months ago
• explodinggradients / Funtuner
  Supervised instruction finetuning for LLM with HF trainer and Deepspeed
  ☆35Updated 2 years ago
• muellerzr / nbdistributed
  Seemless interface of using PyTOrch distributed with Jupyter notebooks
  ☆27Updated 2 months ago
• davanstrien / data-for-fine-tuning-llms
  ☆80Updated last year
• microsoft / llm-data-creation
  Model, Code & Data for the EMNLP'23 paper "Making Large Language Models Better Data Creators"
  ☆135Updated last year
• tcapelle / llm_recipes
  A set of scripts and notebooks on LLM finetunning and dataset creation
  ☆110Updated 11 months ago
• hamelsmu / llama-inference
  experiments with inference on llama
  ☆104Updated last year
• apple / ml-superposition-prompting
  ☆145Updated last year
• ibm-self-serve-assets / SuperKnowa
  Build Enterprise RAG (Retriver Augmented Generation) Pipelines to tackle various Generative AI use cases with LLM's by simply plugging co…
  ☆113Updated last year
• MoritzLaurer / synthetic-data-blog
  This is the reproduction repository for my 🤗 Hugging Face blog post on synthetic data
  ☆68Updated last year
• evidentlyai / community-examples
  Examples of using Evidently to evaluate, test and monitor ML models.
  ☆38Updated last month
• AhmedSSoliman / Llama2-CodeGen-Fine-Tuning-LLama-2
  ☆15Updated 2 years ago
• mrmaheshrajput / productionizing-llms
  Code Repository for Blog - How to Productionize Large Language Models (LLMs)
  ☆11Updated last year
• rajshah4 / LLM-Evaluation
  Sample notebooks and prompts for LLM evaluation
  ☆138Updated 2 months ago
• PrithivirajDamodaran / Route0x
  Low latency, High Accuracy, Custom Query routers for Humans and Agents. Built by Prithivi Da
  ☆113Updated 5 months ago
• CVxTz / llm-serve-tutorial
  ☆20Updated last year
• ThinamXx / Meta-llama
  Complete implementation of Llama2 with/without KV cache & inference 🚀
  ☆48Updated last year
• pacman100 / peft-codegen-25
  ☆23Updated 2 years ago
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆79Updated 11 months ago
• premAI-io / benchmarks
  🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.
  ☆137Updated last year
• patronus-ai / Lynx-hallucination-detection
  ☆43Updated last year
• vakyansh / gemma-experimentation
  Experimentation on google's gemma model
  ☆16Updated last year
• fw-ai / benchmark
  Benchmark suite for LLMs from Fireworks.ai
  ☆82Updated this week
• Logisx / AI-Senior
  🤖 AI Assistant fine-tuned to provide support for coding and design questions based on the latest trends in the industry.
  ☆17Updated last year
• AntonioGr7 / pratical-llms
  A collection of hand on notebook for LLMs practitioner
  ☆50Updated 7 months ago
• humza909 / LLM_Survey
  ☆86Updated last year