aniketmaurya / llm-inferenceLinks
Large Language Model (LLM) Inference API and Chatbot
β126Updated last year
Alternatives and similar repositories for llm-inference
Users that are interested in llm-inference are comparing it to the libraries listed below
Sorting:
- Building a chatbot powered with a RAG pipeline to read,summarize and quote the most relevant papers related to the user query.β168Updated last year
- Mistral + Haystack: build RAG pipelines that rock π€β105Updated last year
- Repository of the code base for KT Generation process that we worked at Google Cloud and Searce GenAI Hackathon.β74Updated last year
- Anthropic Claude2 Hackathon:Building MCTS with Claude for optimal action prediction during patient/doctor interactions.β105Updated last year
- β89Updated last year
- Data extraction with LLM on CPUβ113Updated last year
- TitanML Takeoff Server is an optimization, compression and deployment platform that makes state of the art machine learning models accessβ¦β114Updated last year
- β222Updated last year
- β52Updated 2 years ago
- Machine Learning Serving focused on GenAI with simplicity as the top priority.β59Updated 3 weeks ago
- Data extraction with LLM on CPUβ268Updated last year
- Document Q&A on Wikipedia articles using LLMsβ78Updated last year
- β199Updated 2 years ago
- Build a Streamlit Chatbot using Langchain, ColBERT, Ragatouille, and ChromaDBβ122Updated last year
- A microframework for creating simple AI agents.β91Updated last year
- β185Updated last year
- β48Updated last year
- LangChain chat model abstractions for dynamic failover, load balancing, chaos engineering, and more!β82Updated last year
- Visualization for a Retrieval-Augmented Generation (RAG) Assistant π€β€οΈπβ191Updated 7 months ago
- Data extraction with LLM on CPUβ85Updated last year
- β77Updated last year
- Chat with PDF using Zephyr 7B Alpha, Langchain, ChromaDB, and Gradio with Free Google Colabβ136Updated last year
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absoluteβ¦β49Updated last year
- Low latency, High Accuracy, Custom Query routers for Humans and Agents. Built by Prithivi Daβ111Updated 4 months ago
- β92Updated last year
- PanML is a high level generative AI/ML development and analysis library designed for ease of use and fast experimentation.β117Updated 2 years ago
- π¬ minimalistic ChatBot Interface in pure pythonβ225Updated last year
- RAGArch is a Streamlit-based application that empowers users to experiment with various components and parameters of Retrieval-Augmented β¦β85Updated last year
- π Datasets and models for instruction-tuningβ238Updated last year
- Domain Adapted Language Modeling Toolkit - E2E RAGβ325Updated 8 months ago