Alternatives and similar repositories for Efficiently-Serving-LLMs

Users that are interested in Efficiently-Serving-LLMs are comparing it to the libraries listed below

• anyscale / e2e-llm-workflows
  Fine-tune an LLM to perform batch inference and online serving.
  ☆115Updated 7 months ago
• doubleshow / superlinked
  A compute framework for building Search, RAG, Recommendations and Analytics over complex (structured+unstructured) data, with ultra-modal…
  ☆12Updated last year
• IlyasMoutawwakil / py-txi
  A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.
  ☆32Updated 3 months ago
• daniel-furman / sft-demos
  Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.
  ☆78Updated last year
• tcapelle / llm_recipes
  A set of scripts and notebooks on LLM finetunning and dataset creation
  ☆113Updated last year
• mrmaheshrajput / productionizing-llms
  Code Repository for Blog - How to Productionize Large Language Models (LLMs)
  ☆12Updated last year
• infocusp / llm_seminar_series
  Material for the series of seminars on Large Language Models
  ☆34Updated last year
• hamelsmu / llama-inference
  experiments with inference on llama
  ☆103Updated last year
• premAI-io / benchmarks
  🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.
  ☆139Updated last year
• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆51Updated last year
• ThinamXx / Meta-llama
  Complete implementation of Llama2 with/without KV cache & inference 🚀
  ☆49Updated last year
• rashmimarganiatgithub / LLMS_Library_2023
  LLM_library is a comprehensive repository serves as a one-stop resource hands-on code, insightful summaries.
  ☆69Updated 2 years ago
• ibm-self-serve-assets / SuperKnowa
  Build Enterprise RAG (Retriver Augmented Generation) Pipelines to tackle various Generative AI use cases with LLM's by simply plugging co…
  ☆117Updated last year
• AhmedSSoliman / Llama2-CodeGen-Fine-Tuning-LLama-2
  ☆15Updated 2 years ago
• muellerzr / nbdistributed
  Seemless interface of using PyTOrch distributed with Jupyter notebooks
  ☆57Updated 3 months ago
• CVxTz / llm-serve-tutorial
  ☆20Updated last year
• microsoft / llm-data-creation
  Model, Code & Data for the EMNLP'23 paper "Making Large Language Models Better Data Creators"
  ☆137Updated 2 years ago
• rasbt / LLM-finetuning-scripts
  ☆218Updated last year
• patronus-ai / Lynx-hallucination-detection
  ☆43Updated last year
• davanstrien / data-for-fine-tuning-llms
  ☆80Updated last year
• ayulockin / neurips-llm-efficiency-challenge
  Starter pack for NeurIPS LLM Efficiency Challenge 2023.
  ☆129Updated 2 years ago
• NielsRogge / awesome-huggingface
  Repository containing awesome resources regarding Hugging Face tooling.
  ☆48Updated last year
• vibrantlabsai / Funtuner
  Supervised instruction finetuning for LLM with HF trainer and Deepspeed
  ☆36Updated 2 years ago
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆80Updated last year
• anyscale / ray-summit-2023-training
  ☆89Updated 2 years ago
• huggingbench / huggingbench
  Find the optimal model serving solution for 🤗 Hugging Face models 🚀
  ☆45Updated 5 months ago
• pacman100 / peft-codegen-25
  ☆23Updated 2 years ago
• stas00 / ml-ways
  ML/DL Math and Method notes
  ☆65Updated 2 years ago
• fw-ai / benchmark
  Benchmark suite for LLMs from Fireworks.ai
  ☆84Updated last month
• januverma / transformers-stuff
  Codes, scripts, and notebooks on various aspects of transformer models.
  ☆27Updated 2 years ago