Alternatives and similar repositories for FastAPI-LLM-Model-Serving:

Users that are interested in FastAPI-LLM-Model-Serving are comparing it to the libraries listed below

• anyscale / e2e-llm-workflows
  Fine-tune an LLM to perform batch inference and online serving.
  ☆109Updated last week
• ibm-self-serve-assets / SuperKnowa
  Build Enterprise RAG (Retriver Augmented Generation) Pipelines to tackle various Generative AI use cases with LLM's by simply plugging co…
  ☆109Updated 9 months ago
• jayita13 / GenerativeAI
  GenAI Experimentation
  ☆58Updated this week
• peremartra / FinLLMOpt
  Optimized Large Language Models for Financial Applications – Efficient, Scalable, and Domain-Specific AI for Finance.
  ☆46Updated 3 weeks ago
• AI-Maker-Space / Fine-tuning-LLM-Resources
  A collection of fine-tuning notebooks!
  ☆27Updated last year
• rajshah4 / LLM-Evaluation
  Sample notebooks and prompts for LLM evaluation
  ☆124Updated last week
• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆49Updated 9 months ago
• neural-maze / locust_example
  Running load tests on a FastAPI application using Locust
  ☆15Updated last month
• tcapelle / llm_recipes
  A set of scripts and notebooks on LLM finetunning and dataset creation
  ☆106Updated 7 months ago
• FSoft-AI4Code / XMainframe
  Language Model for Mainframe Modernization
  ☆51Updated 8 months ago
• AntonioGr7 / pratical-llms
  A collection of hand on notebook for LLMs practitioner
  ☆47Updated 3 months ago
• apple / ml-superposition-prompting
  ☆143Updated 9 months ago
• ayulockin / neurips-llm-efficiency-challenge
  Starter pack for NeurIPS LLM Efficiency Challenge 2023.
  ☆124Updated last year
• TrelisResearch / install-guides
  Various installation guides for Large Language Models
  ☆69Updated this week
• aishwaryaprabhat / goku
  GenAIOps on Kubernetes: A collection of reference architectures for running GenAI at scale on Kubernetes using OSS tooling
  ☆129Updated 5 months ago
• huggingbench / huggingbench
  Find the optimal model serving solution for 🤗 Hugging Face models 🚀
  ☆43Updated last year
• Sakil786 / LLM-PlayLab
  This playlab encompasses a multitude of projects crafted through the utilization of Large Language Models, showcasing the versatility and…
  ☆118Updated last week
• marib00 / llamaindex-embedding-lora
  ☆29Updated last year
• decodingml / articles-code
  💻 Decoding ML articles hub: Hands-on articles with code on production-grade ML
  ☆129Updated last month
• arcee-ai / EvolKit
  EvolKit is an innovative framework designed to automatically enhance the complexity of instructions used for fine-tuning Large Language M…
  ☆213Updated 5 months ago
• Pleias / Various-Finetuning
  Set of scripts to finetune LLMs
  ☆37Updated last year
• rasbt / RAGs
  RAGs: Simple implementations of Retrieval Augmented Generation (RAG) Systems
  ☆100Updated 3 months ago
• srivatsan88 / sector
  ☆18Updated 4 months ago
• amogkam / llama_index_ray
  Using LlamaIndex with Ray for productionizing LLM applications
  ☆71Updated last year
• djliden / llmops-examples
  Example code and notebooks related to mlflow, llmops, etc.
  ☆42Updated 9 months ago
• pavannagula / User-Centric-RAG-Using-Llamaindex-Multi-Agent-System-and-Qdrant
  This project involves using llamaindex Multi Agents concierge system and Qdrant vector database to customize the RAG application with use…
  ☆50Updated 8 months ago
• PrithivirajDamodaran / Route0x
  Low latency, High Accuracy, Custom Query routers for Humans and Agents. Built by Prithivi Da
  ☆102Updated 3 weeks ago
• georgesung / LLM-WikipediaQA
  Document Q&A on Wikipedia articles using LLMs
  ☆75Updated last year
• ksm26 / Finetuning-Large-Language-Models
  Unlock the potential of finetuning Large Language Models (LLMs). Learn from industry expert, and discover when to apply finetuning, data …
  ☆56Updated last year
• lorenzejay / contract-analysis-use-case
  ☆34Updated last month