Alternatives and similar repositories for llm-inference

Users that are interested in llm-inference are comparing it to the libraries listed below

• anakin87 / mistral-haystack
  Mistral + Haystack: build RAG pipelines that rock 🤘
  ☆106Updated last year
• AymenKallala / RAG_Maestro
  Building a chatbot powered with a RAG pipeline to read,summarize and quote the most relevant papers related to the user query.
  ☆166Updated last year
• katanaml / llm-ollama-llamaindex-invoice-cpu
  Data extraction with LLM on CPU
  ☆112Updated last year
• hwchase17 / conversation-qa-gradio
  ☆53Updated 2 years ago
• aigeek0x0 / rag-with-langchain-colbert-and-ragatouille
  Build a Streamlit Chatbot using Langchain, ColBERT, Ragatouille, and ChromaDB
  ☆123Updated last year
• aniketmaurya / fastserve-ai
  Machine Learning Serving focused on GenAI with simplicity as the top priority.
  ☆59Updated 2 months ago
• run-llama / ai-engineer-workshop
  ☆187Updated 2 years ago
• llmco / llamaapi-python
  ☆93Updated 2 years ago
• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆51Updated last year
• ravi03071991 / KT_Generator
  Repository of the code base for KT Generation process that we worked at Google Cloud and Searce GenAI Hackathon.
  ☆76Updated 2 years ago
• katanaml / llm-mistral-invoice-cpu
  Data extraction with LLM on CPU
  ☆270Updated last year
• davanstrien / data-for-fine-tuning-llms
  ☆80Updated last year
• titanml / takeoff-community
  TitanML Takeoff Server is an optimization, compression and deployment platform that makes state of the art machine learning models access…
  ☆114Updated last year
• katanaml / llm-ollama-invoice-cpu
  Data extraction with LLM on CPU
  ☆85Updated 2 years ago
• PrithivirajDamodaran / Route0x
  Low latency, High Accuracy, Custom Query routers for Humans and Agents. Built by Prithivi Da
  ☆119Updated 8 months ago
• georgesung / LLM-WikipediaQA
  Document Q&A on Wikipedia articles using LLMs
  ☆79Updated 2 years ago
• run-llama / llamaindex_aws_ingestion
  ☆90Updated last year
• aigeek0x0 / zephyr-7b-alpha-langchain-chatbot
  Chat with PDF using Zephyr 7B Alpha, Langchain, ChromaDB, and Gradio with Free Google Colab
  ☆137Updated last year
• neuml / txtinstruct
  📚 Datasets and models for instruction-tuning
  ☆238Updated 2 years ago
• andrewnguonly / ChatAbstractions
  LangChain chat model abstractions for dynamic failover, load balancing, chaos engineering, and more!
  ☆84Updated last year
• weaviate / generator9000
  Web App for generating synthetic data
  ☆49Updated last year
• fadynakhla / dr-claude
  Anthropic Claude2 Hackathon:Building MCTS with Claude for optimal action prediction during patient/doctor interactions.
  ☆106Updated 2 years ago
• timho102003 / NewsGPT
  ☆223Updated 2 years ago
• katanaml / llm-rag-invoice-cpu
  Data extraction with LLM on CPU
  ☆68Updated 2 years ago
• hwchase17 / ai-engineer
  ☆103Updated 2 years ago
• Renumics / renumics-rag
  Visualization for a Retrieval-Augmented Generation (RAG) Assistant 🤖❤️📚
  ☆195Updated last week
• amogkam / llama_index_ray
  Using LlamaIndex with Ray for productionizing LLM applications
  ☆71Updated 2 years ago
• BeastByteAI / agent_dingo
  A microframework for creating simple AI agents.
  ☆94Updated last year
• ccurme / yolopandas
  ☆200Updated 2 years ago
• aniketmaurya / discord-llm-bot
  Fun project: LLM powered RAG Discord Bot that works seamlessly on CPU
  ☆32Updated 2 years ago