Alternatives and similar repositories for FastAPI-LLM-Model-Serving

Users that are interested in FastAPI-LLM-Model-Serving are comparing it to the libraries listed below

• anyscale / e2e-llm-workflows
  Fine-tune an LLM to perform batch inference and online serving.
  ☆111Updated last week
• AntonioGr7 / pratical-llms
  A collection of hand on notebook for LLMs practitioner
  ☆47Updated 4 months ago
• PrithivirajDamodaran / Route0x
  Low latency, High Accuracy, Custom Query routers for Humans and Agents. Built by Prithivi Da
  ☆105Updated 2 months ago
• ibm-self-serve-assets / SuperKnowa
  Build Enterprise RAG (Retriver Augmented Generation) Pipelines to tackle various Generative AI use cases with LLM's by simply plugging co…
  ☆110Updated 10 months ago
• jayita13 / GenerativeAI
  GenAI Experimentation
  ☆57Updated last month
• djliden / llmops-examples
  Example code and notebooks related to mlflow, llmops, etc.
  ☆43Updated 11 months ago
• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆49Updated 10 months ago
• deepset-ai / rag-with-nvidia-nims
  🚀 Use NVIDIA NIMs with Haystack pipelines
  ☆31Updated 9 months ago
• amogkam / llama_index_ray
  Using LlamaIndex with Ray for productionizing LLM applications
  ☆71Updated last year
• AI-Maker-Space / Fine-tuning-LLM-Resources
  A collection of fine-tuning notebooks!
  ☆27Updated last year
• jjovalle99 / DSPy-Text2SQL
  DSPY on action with OpenSource LLMs.
  ☆70Updated last year
• sachink1729 / Healthcare-AI-Assistant-Medical-Data-Qdrant-Dspy-Groq
  Building Private Healthcare AI Assistant for Clinics Using Qdrant Hybrid Cloud, DSPy and Groq - Llama3
  ☆22Updated last year
• MuhammadBinUsman03 / Real-Time-3-pipeline-LLM-Financial-Advisor
  3-Pipeline LLMOps Financial advisor. Steaming pipeline deployed on AWS, 24/7 collects, embeds live-data into QdrantDB. Training pipeline …
  ☆23Updated last month
• georgesung / LLM-WikipediaQA
  Document Q&A on Wikipedia articles using LLMs
  ☆78Updated last year
• valohai / mistral-example
  ☆18Updated 3 weeks ago
• mrmaheshrajput / productionizing-llms
  Code Repository for Blog - How to Productionize Large Language Models (LLMs)
  ☆11Updated last year
• flowaicom / flow-judge
  Code for evaluating with Flow-Judge-v0.1 - an open-source, lightweight (3.8B) language model optimized for LLM system evaluations. Crafte…
  ☆70Updated 7 months ago
• premAI-io / benchmarks
  🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.
  ☆137Updated 10 months ago
• tcapelle / llm_recipes
  A set of scripts and notebooks on LLM finetunning and dataset creation
  ☆111Updated 8 months ago
• AIAnytime / rag-evaluator
  A library for evaluating Retrieval-Augmented Generation (RAG) systems (The traditional ways).
  ☆35Updated 9 months ago
• vincentclaes / classification-with-llm
  How far can we go with an LLM for a classification problem
  ☆25Updated 6 months ago
• Laksh-star / Medium_Articles
  All code related to medium articles
  ☆17Updated 2 weeks ago
• Pleias / Various-Finetuning
  Set of scripts to finetune LLMs
  ☆37Updated last year
• aniketmaurya / Agents
  Build Agentic workflows with function calling using open LLMs
  ☆26Updated this week
• decodingml / articles-code
  💻 Decoding ML articles hub: Hands-on articles with code on production-grade ML
  ☆131Updated 3 months ago
• evidentlyai / community-examples
  Examples of using Evidently to evaluate, test and monitor ML models.
  ☆28Updated last week
• lancedb / ragged
  ☆19Updated 7 months ago
• AssemblyAI-Community / rag-langchain-audio-data
  Retrieval Augmented Generation (RAG) on audio data with LangChain
  ☆14Updated last year
• jjovalle99 / agentic-design-patterns
  ☆14Updated last year
• rajshah4 / LLM-Evaluation
  Sample notebooks and prompts for LLM evaluation
  ☆131Updated this week