Alternatives and similar repositories for llm-inference:

Users that are interested in llm-inference are comparing it to the libraries listed below

• anakin87 / mistral-haystack
  Mistral + Haystack: build RAG pipelines that rock 🤘
  ☆103Updated last year
• AymenKallala / RAG_Maestro
  Building a chatbot powered with a RAG pipeline to read,summarize and quote the most relevant papers related to the user query.
  ☆166Updated 11 months ago
• run-llama / llamaindex_aws_ingestion
  ☆88Updated last year
• aigeek0x0 / rag-with-langchain-colbert-and-ragatouille
  Build a Streamlit Chatbot using Langchain, ColBERT, Ragatouille, and ChromaDB
  ☆119Updated last year
• ravi03071991 / KT_Generator
  Repository of the code base for KT Generation process that we worked at Google Cloud and Searce GenAI Hackathon.
  ☆74Updated last year
• mallahyari / llm-hub
  A curated collection of interesting applications, repos, and tutorials using large language models (LLM) like GPT-3
  ☆141Updated last year
• PrithivirajDamodaran / Route0x
  Low latency, High Accuracy, Custom Query routers for Humans and Agents. Built by Prithivi Da
  ☆101Updated this week
• katanaml / llm-ollama-llamaindex-invoice-cpu
  Data extraction with LLM on CPU
  ☆112Updated last year
• metaswang / bao
  Chat Bot with LLM and Fact Reference. RAG(Retrieval Augmented Generation) and LangChain backed
  ☆128Updated 11 months ago
• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆49Updated 8 months ago
• premAI-io / challenge-with-langchain
  ☆40Updated last year
• andrewnguonly / ChatAbstractions
  LangChain chat model abstractions for dynamic failover, load balancing, chaos engineering, and more!
  ☆80Updated last year
• katanaml / llm-ollama-invoice-cpu
  Data extraction with LLM on CPU
  ☆85Updated last year
• jayita13 / GenerativeAI
  GenAI Experimentation
  ☆58Updated 2 months ago
• katanaml / llm-mistral-invoice-cpu
  Data extraction with LLM on CPU
  ☆266Updated last year
• davanstrien / data-for-fine-tuning-llms
  ☆76Updated 9 months ago
• georgesung / LLM-WikipediaQA
  Document Q&A on Wikipedia articles using LLMs
  ☆75Updated last year
• hwchase17 / conversation-qa-gradio
  ☆51Updated last year
• BeastByteAI / agent_dingo
  A microframework for creating simple AI agents.
  ☆91Updated 8 months ago
• louisbrulenaudet / ragoon
  High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡
  ☆67Updated 5 months ago
• neuralmagic / examples
  Notebooks using the Neural Magic libraries 📓
  ☆42Updated 8 months ago
• amogkam / llama_index_ray
  Using LlamaIndex with Ray for productionizing LLM applications
  ☆71Updated last year
• Ashufet / Complex-PDF-RAG-Agent-using-QueryPipeline-from-Scratch_Llamaparse_OS-LLM
  ☆41Updated last year
• AntonioGr7 / pratical-llms
  A collection of hand on notebook for LLMs practitioner
  ☆47Updated 2 months ago
• AI-ANK / RAGArch
  RAGArch is a Streamlit-based application that empowers users to experiment with various components and parameters of Retrieval-Augmented …
  ☆84Updated last year
• shoggoth13 / agents-deconstructed
  ☆57Updated last year
• wandb / wandbot
  wandbot is a technical support bot for Weights & Biases' AI developer tools that can run in Discord, Slack, ChatGPT and Zendesk
  ☆291Updated last month
• fadynakhla / dr-claude
  Anthropic Claude2 Hackathon:Building MCTS with Claude for optimal action prediction during patient/doctor interactions.
  ☆104Updated last year
• raphaelmansuy / digital_palace
  My Digital Palace - A Personal Journal for Reflection - A place to store all my thoughts
  ☆48Updated 3 weeks ago
• zrizvi93 / trevorhack
  ☆45Updated 11 months ago