Alternatives and similar repositories for Efficiently-Serving-LLMs

Users that are interested in Efficiently-Serving-LLMs are comparing it to the libraries listed below

• anyscale / e2e-llm-workflows
  Fine-tune an LLM to perform batch inference and online serving.
  ☆112Updated 3 weeks ago
• tcapelle / llm_recipes
  A set of scripts and notebooks on LLM finetunning and dataset creation
  ☆111Updated 8 months ago
• IlyasMoutawwakil / py-txi
  A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.
  ☆33Updated last month
• daniel-furman / sft-demos
  Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.
  ☆77Updated 8 months ago
• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆49Updated 11 months ago
• CVxTz / llm-serve-tutorial
  ☆20Updated last year
• AntonioGr7 / pratical-llms
  A collection of hand on notebook for LLMs practitioner
  ☆48Updated 5 months ago
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆78Updated 9 months ago
• hamelsmu / llama-inference
  experiments with inference on llama
  ☆104Updated last year
• philschmid / evaluate-llms
  Includes examples on how to evaluate LLMs
  ☆23Updated 7 months ago
• rajshah4 / LLM-Evaluation
  Sample notebooks and prompts for LLM evaluation
  ☆135Updated 2 weeks ago
• snowflakedb / ArcticInference
  ☆159Updated this week
• gpu-mode / lecture2
  Obsolete version of CUDA-mode repo -- use cuda-mode/lectures instead
  ☆25Updated last year
• explodinggradients / Funtuner
  Supervised instruction finetuning for LLM with HF trainer and Deepspeed
  ☆35Updated last year
• hkproj / dpo-notes
  Notes on Direct Preference Optimization
  ☆19Updated last year
• PrithivirajDamodaran / Route0x
  Low latency, High Accuracy, Custom Query routers for Humans and Agents. Built by Prithivi Da
  ☆105Updated 2 months ago
• ThinamXx / Meta-llama
  Complete implementation of Llama2 with/without KV cache & inference 🚀
  ☆46Updated last year
• davanstrien / data-for-fine-tuning-llms
  ☆77Updated last year
• aniketmaurya / fastserve-ai
  Machine Learning Serving focused on GenAI with simplicity as the top priority.
  ☆59Updated 2 months ago
• mrmaheshrajput / productionizing-llms
  Code Repository for Blog - How to Productionize Large Language Models (LLMs)
  ☆11Updated last year
• rashmimarganiatgithub / LLMS_Library_2023
  LLM_library is a comprehensive repository serves as a one-stop resource hands-on code, insightful summaries.
  ☆69Updated last year
• Abonia1 / Fine-Tuning-LLMs-Key-Concepts-and-Terms
  Fine-tuning large language models (LLMs) is crucial for enhancing performance across domain-specific task applications. This comprehensiv…
  ☆12Updated 9 months ago
• oceanumeric / EnteRAG
  A RAG that can scale 🧑🏻‍💻
  ☆11Updated last year
• kylegallatin / recsim
  A framework for simulating e-commerce data and interactions that can be used to build recommendation systems
  ☆10Updated last year
• pacman100 / openhathi_instruct
  This repository contains the code for dataset curation and finetuning of instruct variant of the Bilingual OpenHathi model. The resultin…
  ☆23Updated last year
• hkproj / pytorch-transformer-distributed
  Distributed training (multi-node) of a Transformer model
  ☆71Updated last year
• alvarobartt / vertex-ai-huggingface
  🤗 Collection of examples on how to train, deploy and monitor HuggingFace models in Google Cloud Vertex AI
  ☆21Updated last year
• pacman100 / peft-codegen-25
  ☆23Updated last year
• stas00 / ml-ways
  ML/DL Math and Method notes
  ☆61Updated last year
• AI-Maker-Space / FastAPI-LLM-Model-Serving
  How to quickly serve an LLM using Fast API, Celery, and Redis
  ☆15Updated last year