Alternatives and similar repositories for llm-inference

Users that are interested in llm-inference are comparing it to the libraries listed below

• anakin87 / mistral-haystack
  Mistral + Haystack: build RAG pipelines that rock 🤘
  ☆105Updated last year
• AymenKallala / RAG_Maestro
  Building a chatbot powered with a RAG pipeline to read,summarize and quote the most relevant papers related to the user query.
  ☆167Updated last year
• aigeek0x0 / rag-with-langchain-colbert-and-ragatouille
  Build a Streamlit Chatbot using Langchain, ColBERT, Ragatouille, and ChromaDB
  ☆119Updated last year
• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆49Updated 10 months ago
• muellerzr / minimal-trainer-zoo
  Minimal example scripts of the Hugging Face Trainer, focused on staying under 150 lines
  ☆196Updated last year
• run-llama / llamaindex_aws_ingestion
  ☆89Updated last year
• PrithivirajDamodaran / Route0x
  Low latency, High Accuracy, Custom Query routers for Humans and Agents. Built by Prithivi Da
  ☆105Updated 2 months ago
• katanaml / llm-ollama-llamaindex-invoice-cpu
  Data extraction with LLM on CPU
  ☆113Updated last year
• Pan-ML / panml
  PanML is a high level generative AI/ML development and analysis library designed for ease of use and fast experimentation.
  ☆117Updated last year
• aniketmaurya / fastserve-ai
  Machine Learning Serving focused on GenAI with simplicity as the top priority.
  ☆57Updated last month
• ravi03071991 / KT_Generator
  Repository of the code base for KT Generation process that we worked at Google Cloud and Searce GenAI Hackathon.
  ☆74Updated last year
• shroominic / fastui-chat
  💬 minimalistic ChatBot Interface in pure python
  ☆224Updated 10 months ago
• rashmimarganiatgithub / LLMS_Library_2023
  LLM_library is a comprehensive repository serves as a one-stop resource hands-on code, insightful summaries.
  ☆69Updated last year
• katanaml / llm-mistral-invoice-cpu
  Data extraction with LLM on CPU
  ☆265Updated last year
• andrewnguonly / ChatAbstractions
  LangChain chat model abstractions for dynamic failover, load balancing, chaos engineering, and more!
  ☆81Updated last year
• hwchase17 / conversation-qa-gradio
  ☆52Updated last year
• aniketmaurya / python-project-template
  A template to kick-start your Python project ✨🚀
  ☆51Updated 5 months ago
• AI-ANK / RAGArch
  RAGArch is a Streamlit-based application that empowers users to experiment with various components and parameters of Retrieval-Augmented …
  ☆85Updated last year
• AntonioGr7 / pratical-llms
  A collection of hand on notebook for LLMs practitioner
  ☆47Updated 4 months ago
• arcee-ai / DALM
  Domain Adapted Language Modeling Toolkit - E2E RAG
  ☆321Updated 6 months ago
• Ashufet / Complex-PDF-RAG-Agent-using-QueryPipeline-from-Scratch_Llamaparse_OS-LLM
  ☆42Updated last year
• davanstrien / data-for-fine-tuning-llms
  ☆77Updated 11 months ago
• neuralmagic / examples
  Notebooks using the Neural Magic libraries 📓
  ☆41Updated 10 months ago
• titanml / takeoff-community
  TitanML Takeoff Server is an optimization, compression and deployment platform that makes state of the art machine learning models access…
  ☆114Updated last year
• weaviate / st-weaviate-connection
  A python package that provides a custom streamlit connection to query data from weaviate, the AI native vector database
  ☆55Updated 10 months ago
• joshuasundance-swca / langchain-research-assistant-docker
  docker setup to run the LangChain research-assistant template using langserve
  ☆45Updated last week
• ThinamXx / Meta-llama
  Complete implementation of Llama2 with/without KV cache & inference 🚀
  ☆46Updated last year
• mallahyari / llm-hub
  A curated collection of interesting applications, repos, and tutorials using large language models (LLM) like GPT-3
  ☆140Updated last year
• AIAnytime / Fine-Tuning-Multimodal-LLM
  Fine Tuning Multimodal LLM "Idefics 9B" on Pokemon Go Dataset available on Hugging Face.
  ☆19Updated last year
• tcapelle / llm_recipes
  A set of scripts and notebooks on LLM finetunning and dataset creation
  ☆111Updated 8 months ago