Alternatives and similar repositories for llm-inference:

Users that are interested in llm-inference are comparing it to the libraries listed below

• AymenKallala / RAG_Maestro
  Building a chatbot powered with a RAG pipeline to read,summarize and quote the most relevant papers related to the user query.
  ☆165Updated 9 months ago
• run-llama / llamaindex_aws_ingestion
  ☆88Updated last year
• anakin87 / mistral-haystack
  Mistral + Haystack: build RAG pipelines that rock 🤘
  ☆100Updated 11 months ago
• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆48Updated 6 months ago
• aigeek0x0 / rag-with-langchain-colbert-and-ragatouille
  Build a Streamlit Chatbot using Langchain, ColBERT, Ragatouille, and ChromaDB
  ☆118Updated last year
• marklysze / LlamaIndex-RAG-WSL-CUDA
  Examples of RAG using Llamaindex with local LLMs - Gemma, Mixtral 8x7B, Llama 2, Mistral 7B, Orca 2, Phi-2, Neural 7B
  ☆120Updated 11 months ago
• ravi03071991 / KT_Generator
  Repository of the code base for KT Generation process that we worked at Google Cloud and Searce GenAI Hackathon.
  ☆74Updated last year
• run-llama / ai-engineer-workshop
  ☆184Updated last year
• katanaml / llm-ollama-llamaindex-invoice-cpu
  Data extraction with LLM on CPU
  ☆112Updated last year
• hwchase17 / conversation-qa-gradio
  ☆51Updated last year
• Ashufet / Complex-PDF-RAG-Agent-using-QueryPipeline-from-Scratch_Llamaparse_OS-LLM
  ☆41Updated 10 months ago
• rasbt / LLM-finetuning-scripts
  ☆198Updated 11 months ago
• andrewnguonly / ChatAbstractions
  LangChain chat model abstractions for dynamic failover, load balancing, chaos engineering, and more!
  ☆79Updated last year
• anyscale / e2e-llm-workflows
  End-to-End LLM Guide
  ☆99Updated 6 months ago
• PrithivirajDamodaran / Route0x
  Low latency, High Accuracy, Custom Query routers for Humans and Agents. Built by Prithivi Da
  ☆91Updated last month
• muellerzr / minimal-trainer-zoo
  Minimal example scripts of the Hugging Face Trainer, focused on staying under 150 lines
  ☆196Updated 8 months ago
• zrizvi93 / trevorhack
  ☆45Updated 9 months ago
• mickymultani / RAG-with-Cross-Encoder-Reranker
  Testing speed and accuracy of RAG with, and without Cross Encoder Reranker.
  ☆48Updated last year
• ritun16 / chain-of-verification
  This repository implements the chain of verification paper by Meta AI
  ☆160Updated last year
• BeastByteAI / agent_dingo
  A microframework for creating simple AI agents.
  ☆91Updated 5 months ago
• fadynakhla / dr-claude
  Anthropic Claude2 Hackathon:Building MCTS with Claude for optimal action prediction during patient/doctor interactions.
  ☆107Updated last year
• AhmedSSoliman / Llama2-CodeGen-Fine-Tuning-LLama-2
  ☆16Updated last year
• eugeneyan / visualizing-finetunes
  ☆77Updated 8 months ago
• Pan-ML / panml
  PanML is a high level generative AI/ML development and analysis library designed for ease of use and fast experimentation.
  ☆115Updated last year
• shoggoth13 / agents-deconstructed
  ☆57Updated last year
• llamaapi / llamaapi-python
  ☆91Updated last year
• wenqiglantz / edd-recursive-doc-agent-vs-metadata-replacement
  Applying Evaluation Driven Development (EDD) to aid in the design decision of RAG pipelines
  ☆31Updated last year
• rahulnyk / research_agent
  ☆99Updated 9 months ago
• aniketmaurya / discord-llm-bot
  Fun project: LLM powered RAG Discord Bot that works seamlessly on CPU
  ☆32Updated last year
• davanstrien / data-for-fine-tuning-llms
  ☆76Updated 7 months ago