Alternatives and similar repositories for Efficiently-Serving-LLMs

Users that are interested in Efficiently-Serving-LLMs are comparing it to the libraries listed below

• anyscale / e2e-llm-workflows
  Fine-tune an LLM to perform batch inference and online serving.
  ☆113Updated 5 months ago
• tcapelle / llm_recipes
  A set of scripts and notebooks on LLM finetunning and dataset creation
  ☆110Updated last year
• IlyasMoutawwakil / py-txi
  A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.
  ☆33Updated last month
• CVxTz / llm-serve-tutorial
  ☆20Updated last year
• daniel-furman / sft-demos
  Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.
  ☆78Updated last year
• rajshah4 / LLM-Evaluation
  Sample notebooks and prompts for LLM evaluation
  ☆153Updated last week
• davanstrien / data-for-fine-tuning-llms
  ☆80Updated last year
• ThinamXx / Meta-llama
  Complete implementation of Llama2 with/without KV cache & inference 🚀
  ☆48Updated last year
• infocusp / llm_seminar_series
  Material for the series of seminars on Large Language Models
  ☆34Updated last year
• mrmaheshrajput / productionizing-llms
  Code Repository for Blog - How to Productionize Large Language Models (LLMs)
  ☆12Updated last year
• Abonia1 / Fine-Tuning-LLMs-Key-Concepts-and-Terms
  Fine-tuning large language models (LLMs) is crucial for enhancing performance across domain-specific task applications. This comprehensiv…
  ☆12Updated last year
• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆50Updated last year
• evidentlyai / community-examples
  Examples of using Evidently to evaluate, test and monitor ML models.
  ☆41Updated last month
• ibm-self-serve-assets / SuperKnowa
  Build Enterprise RAG (Retriver Augmented Generation) Pipelines to tackle various Generative AI use cases with LLM's by simply plugging co…
  ☆115Updated last year
• rashmimarganiatgithub / LLMS_Library_2023
  LLM_library is a comprehensive repository serves as a one-stop resource hands-on code, insightful summaries.
  ☆69Updated last year
• ayulockin / neurips-llm-efficiency-challenge
  Starter pack for NeurIPS LLM Efficiency Challenge 2023.
  ☆126Updated 2 years ago
• ali-bahrainian / RAG_best_practices
  ☆96Updated 7 months ago
• apple / ml-superposition-prompting
  ☆146Updated last year
• muellerzr / nbdistributed
  Seemless interface of using PyTOrch distributed with Jupyter notebooks
  ☆53Updated last month
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆79Updated last year
• microsoft / llm-data-creation
  Model, Code & Data for the EMNLP'23 paper "Making Large Language Models Better Data Creators"
  ☆134Updated 2 years ago
• explodinggradients / Funtuner
  Supervised instruction finetuning for LLM with HF trainer and Deepspeed
  ☆36Updated 2 years ago
• premAI-io / benchmarks
  🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.
  ☆139Updated last year
• pacman100 / peft-codegen-25
  ☆23Updated 2 years ago
• januverma / transformers-stuff
  Codes, scripts, and notebooks on various aspects of transformer models.
  ☆27Updated 2 years ago
• PrithivirajDamodaran / Route0x
  Low latency, High Accuracy, Custom Query routers for Humans and Agents. Built by Prithivi Da
  ☆117Updated 7 months ago
• huggingbench / huggingbench
  Find the optimal model serving solution for 🤗 Hugging Face models 🚀
  ☆44Updated 3 months ago
• ishandutta0098 / zero-to-lightning
  zero-to-lightning
  ☆31Updated last year
• hamelsmu / llama-inference
  experiments with inference on llama
  ☆103Updated last year
• amogkam / llama_index_ray
  Using LlamaIndex with Ray for productionizing LLM applications
  ☆71Updated 2 years ago