Alternatives and similar repositories for Efficiently-Serving-LLMs:

Users that are interested in Efficiently-Serving-LLMs are comparing it to the libraries listed below

• explodinggradients / Funtuner
  Supervised instruction finetuning for LLM with HF trainer and Deepspeed
  ☆34Updated last year
• Zefty / rag-end2end-retriever
  ☆20Updated 3 years ago
• AhmedSSoliman / Llama2-CodeGen-Fine-Tuning-LLama-2
  ☆16Updated last year
• andysingal / LLMops
  purpose of this repo is to Implement LLMOPs as shared in Deeplearning AI course
  ☆10Updated this week
• kylegallatin / recsim
  A framework for simulating e-commerce data and interactions that can be used to build recommendation systems
  ☆10Updated last year
• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆49Updated 8 months ago
• pacman100 / peft-codegen-25
  ☆24Updated last year
• neural-maze / locust_example
  Running load tests on a FastAPI application using Locust
  ☆13Updated this week
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆76Updated 6 months ago
• davanstrien / data-for-fine-tuning-llms
  ☆76Updated 9 months ago
• Sakil786 / -meta_llama_2finetuned_text_generation_summarization
  meta_llama_2finetuned_text_generation_summarization
  ☆21Updated last year
• mrmaheshrajput / productionizing-llms
  Code Repository for Blog - How to Productionize Large Language Models (LLMs)
  ☆11Updated last year
• IlyasMoutawwakil / py-txi
  A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.
  ☆34Updated 3 months ago
• CVxTz / llm-serve-tutorial
  ☆20Updated 11 months ago
• oceanumeric / EnteRAG
  A RAG that can scale 🧑🏻‍💻
  ☆11Updated 10 months ago
• PrithivirajDamodaran / SPLADERunner
  Lite weight wrapper for the independent implementation of SPLADE++ models for search & retrieval pipelines. Models and Library created by…
  ☆29Updated 7 months ago
• aws-samples / llm-evaluation-methodology
  ☆42Updated 5 months ago
• krypticmouse / matryoshka-representation-learning
  PyTorch implementation for MRL
  ☆18Updated last year
• philschmid / evaluate-llms
  Includes examples on how to evaluate LLMs
  ☆22Updated 4 months ago
• weaviate-tutorials / Hurricane
  Writing Blog Posts with Generative Feedback Loops!
  ☆47Updated last year
• lancedb / ragged
  ☆19Updated 5 months ago
• AI-Maker-Space / Chainlit-Event-AIM
  A Chainlit App Used to Showcase: Async, Caching, Additional Chainlit Methods, and more!
  ☆11Updated 6 months ago
• anyscale / e2e-llm-workflows
  End-to-End LLM Guide
  ☆104Updated 8 months ago
• nbroad1881 / strideformer
  Using short models to classify long texts
  ☆21Updated 2 years ago
• vakyansh / gemma-experimentation
  Experimentation on google's gemma model
  ☆16Updated last year
• Ashufet / Complex-PDF-RAG-Agent-using-QueryPipeline-from-Scratch_Llamaparse_OS-LLM
  ☆41Updated last year
• davanstrien / haiku-dpo
  Using open source LLMs to build synthetic datasets for direct preference optimization
  ☆59Updated last year
• rajshah4 / LLM-Evaluation
  Sample notebooks and prompts for LLM evaluation
  ☆124Updated 4 months ago
• Logisx / AI-Senior
  🤖 AI Assistant fine-tuned to provide support for coding and design questions based on the latest trends in the industry.
  ☆16Updated last year
• Abonia1 / Fine-Tuning-LLMs-Key-Concepts-and-Terms
  Fine-tuning large language models (LLMs) is crucial for enhancing performance across domain-specific task applications. This comprehensiv…
  ☆12Updated 6 months ago