Alternatives and similar repositories for llm-inference

Users that are interested in llm-inference are comparing it to the libraries listed below

• AymenKallala / RAG_Maestro
  Building a chatbot powered with a RAG pipeline to read,summarize and quote the most relevant papers related to the user query.
  ☆168Updated last year
• anakin87 / mistral-haystack
  Mistral + Haystack: build RAG pipelines that rock 🤘
  ☆105Updated last year
• katanaml / llm-ollama-llamaindex-invoice-cpu
  Data extraction with LLM on CPU
  ☆112Updated last year
• ravi03071991 / KT_Generator
  Repository of the code base for KT Generation process that we worked at Google Cloud and Searce GenAI Hackathon.
  ☆74Updated last year
• katanaml / llm-mistral-invoice-cpu
  Data extraction with LLM on CPU
  ☆268Updated last year
• aigeek0x0 / rag-with-langchain-colbert-and-ragatouille
  Build a Streamlit Chatbot using Langchain, ColBERT, Ragatouille, and ChromaDB
  ☆122Updated last year
• run-llama / llamaindex_aws_ingestion
  ☆89Updated last year
• timho102003 / NewsGPT
  ☆222Updated last year
• fadynakhla / dr-claude
  Anthropic Claude2 Hackathon:Building MCTS with Claude for optimal action prediction during patient/doctor interactions.
  ☆105Updated last year
• georgesung / LLM-WikipediaQA
  Document Q&A on Wikipedia articles using LLMs
  ☆78Updated last year
• hwchase17 / conversation-qa-gradio
  ☆52Updated 2 years ago
• shroominic / fastui-chat
  💬 minimalistic ChatBot Interface in pure python
  ☆225Updated last year
• run-llama / ai-engineer-workshop
  ☆185Updated last year
• ccurme / yolopandas
  ☆199Updated 2 years ago
• marklysze / LlamaIndex-RAG-WSL-CUDA
  Examples of RAG using Llamaindex with local LLMs - Gemma, Mixtral 8x7B, Llama 2, Mistral 7B, Orca 2, Phi-2, Neural 7B
  ☆129Updated last year
• katanaml / llm-ollama-invoice-cpu
  Data extraction with LLM on CPU
  ☆85Updated last year
• aniketmaurya / fastserve-ai
  Machine Learning Serving focused on GenAI with simplicity as the top priority.
  ☆59Updated last month
• Renumics / renumics-rag
  Visualization for a Retrieval-Augmented Generation (RAG) Assistant 🤖❤️📚
  ☆192Updated 8 months ago
• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆49Updated last year
• llmco / llamaapi-python
  ☆93Updated last year
• arcee-ai / DALM
  Domain Adapted Language Modeling Toolkit - E2E RAG
  ☆327Updated 9 months ago
• metaswang / bao
  Chat Bot with LLM and Fact Reference. RAG(Retrieval Augmented Generation) and LangChain backed
  ☆129Updated last year
• Pan-ML / panml
  PanML is a high level generative AI/ML development and analysis library designed for ease of use and fast experimentation.
  ☆117Updated 2 years ago
• katanaml / llm-rag-invoice-cpu
  Data extraction with LLM on CPU
  ☆68Updated last year
• neuml / txtinstruct
  📚 Datasets and models for instruction-tuning
  ☆238Updated last year
• BeastByteAI / agent_dingo
  A microframework for creating simple AI agents.
  ☆91Updated last year
• BerriAI / bettertest
  ☆75Updated last year
• hwchase17 / langchain-gradio-template
  ☆137Updated 2 years ago
• ssheng / BentoChain
  A voice-enabled chatbot application built using of 🦜️🔗 LangChain, text-to-speech, and speech-to-text models from 🤗 Hugging Face, and …
  ☆195Updated last year
• weaviate / generator9000
  Web App for generating synthetic data
  ☆48Updated 11 months ago