Alternatives and similar repositories for llm-inference:

Users that are interested in llm-inference are comparing it to the libraries listed below

• anakin87 / mistral-haystack
  Mistral + Haystack: build RAG pipelines that rock 🤘
  ☆100Updated last year
• aigeek0x0 / rag-with-langchain-colbert-and-ragatouille
  Build a Streamlit Chatbot using Langchain, ColBERT, Ragatouille, and ChromaDB
  ☆118Updated last year
• AymenKallala / RAG_Maestro
  Building a chatbot powered with a RAG pipeline to read,summarize and quote the most relevant papers related to the user query.
  ☆166Updated 10 months ago
• run-llama / llamaindex_aws_ingestion
  ☆88Updated last year
• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆49Updated 7 months ago
• Sakil786 / LLM-PlayLab
  This playlab encompasses a multitude of projects crafted through the utilization of Large Language Models, showcasing the versatility and…
  ☆95Updated this week
• katanaml / llm-ollama-llamaindex-invoice-cpu
  Data extraction with LLM on CPU
  ☆112Updated last year
• run-llama / ai-engineer-workshop
  ☆184Updated last year
• andrewnguonly / ChatAbstractions
  LangChain chat model abstractions for dynamic failover, load balancing, chaos engineering, and more!
  ☆80Updated last year
• AhmedSSoliman / Llama2-CodeGen-Fine-Tuning-LLama-2
  ☆16Updated last year
• PrithivirajDamodaran / Route0x
  Low latency, High Accuracy, Custom Query routers for Humans and Agents. Built by Prithivi Da
  ☆94Updated 2 months ago
• anyscale / e2e-llm-workflows
  End-to-End LLM Guide
  ☆103Updated 8 months ago
• davanstrien / data-for-fine-tuning-llms
  ☆76Updated 8 months ago
• metaswang / bao
  Chat Bot with LLM and Fact Reference. RAG(Retrieval Augmented Generation) and LangChain backed
  ☆128Updated 10 months ago
• shoggoth13 / agents-deconstructed
  ☆57Updated last year
• rajshah4 / LLM-Evaluation
  Sample notebooks and prompts for LLM evaluation
  ☆120Updated 3 months ago
• hwchase17 / sql-qa
  ☆45Updated last year
• Ashufet / Complex-PDF-RAG-Agent-using-QueryPipeline-from-Scratch_Llamaparse_OS-LLM
  ☆41Updated 11 months ago
• timho102003 / NewsGPT
  ☆221Updated last year
• katanaml / llm-ollama-invoice-cpu
  Data extraction with LLM on CPU
  ☆85Updated last year
• arcee-ai / DALM
  Domain Adapted Language Modeling Toolkit - E2E RAG
  ☆314Updated 3 months ago
• weaviate / st-weaviate-connection
  A python package that provides a custom streamlit connection to query data from weaviate, the AI native vector database
  ☆53Updated 7 months ago
• Sentdex / Together-API-Basics
  Some information for working with the Together inference API for Open Source AI models
  ☆57Updated last year
• hwchase17 / conversation-qa-gradio
  ☆51Updated last year
• llamaapi / llamaapi-python
  ☆91Updated last year
• AI-ANK / RAGArch
  RAGArch is a Streamlit-based application that empowers users to experiment with various components and parameters of Retrieval-Augmented …
  ☆84Updated last year
• wenqiglantz / edd-recursive-doc-agent-vs-metadata-replacement
  Applying Evaluation Driven Development (EDD) to aid in the design decision of RAG pipelines
  ☆31Updated last year
• ravi03071991 / KT_Generator
  Repository of the code base for KT Generation process that we worked at Google Cloud and Searce GenAI Hackathon.
  ☆74Updated last year
• tahreemrasul / semantic_research_engine
  A semantic research engine to get relevant papers based on a user query. Application frontend with Chainlit Copilot. Observability with L…
  ☆81Updated 9 months ago
• NirantK / agentai
  Text to Python Objects via a LLM Function Call
  ☆56Updated 11 months ago