aniketmaurya / llm-inferenceLinks
Large Language Model (LLM) Inference API and Chatbot
☆126Updated last year
Alternatives and similar repositories for llm-inference
Users that are interested in llm-inference are comparing it to the libraries listed below
Sorting:
- Building a chatbot powered with a RAG pipeline to read,summarize and quote the most relevant papers related to the user query.☆168Updated last year
- Mistral + Haystack: build RAG pipelines that rock 🤘☆105Updated last year
- Data extraction with LLM on CPU☆112Updated last year
- Data extraction with LLM on CPU☆269Updated last year
- Repository of the code base for KT Generation process that we worked at Google Cloud and Searce GenAI Hackathon.☆76Updated 2 years ago
- ☆52Updated 2 years ago
- ☆223Updated last year
- Build a Streamlit Chatbot using Langchain, ColBERT, Ragatouille, and ChromaDB☆122Updated last year
- 📚 Datasets and models for instruction-tuning☆238Updated last year
- Data extraction with LLM on CPU☆85Updated last year
- Anthropic Claude2 Hackathon:Building MCTS with Claude for optimal action prediction during patient/doctor interactions.☆105Updated 2 years ago
- ☆80Updated last year
- ☆185Updated last year
- ☆199Updated 2 years ago
- Chat with PDF using Zephyr 7B Alpha, Langchain, ChromaDB, and Gradio with Free Google Colab☆136Updated last year
- TitanML Takeoff Server is an optimization, compression and deployment platform that makes state of the art machine learning models access…☆114Updated last year
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆49Updated last year
- Examples of RAG using Llamaindex with local LLMs - Gemma, Mixtral 8x7B, Llama 2, Mistral 7B, Orca 2, Phi-2, Neural 7B☆129Updated last year
- ☆93Updated last year
- 💬 minimalistic ChatBot Interface in pure python☆225Updated last year
- PanML is a high level generative AI/ML development and analysis library designed for ease of use and fast experimentation.☆117Updated 2 years ago
- Chat Bot with LLM and Fact Reference. RAG(Retrieval Augmented Generation) and LangChain backed☆129Updated last year
- ☆89Updated last year
- Domain Adapted Language Modeling Toolkit - E2E RAG☆327Updated 10 months ago
- LangChain chat model abstractions for dynamic failover, load balancing, chaos engineering, and more!☆84Updated last year
- RAGArch is a Streamlit-based application that empowers users to experiment with various components and parameters of Retrieval-Augmented …☆85Updated last year
- Low latency, High Accuracy, Custom Query routers for Humans and Agents. Built by Prithivi Da☆117Updated 5 months ago
- Data extraction with LLM on CPU☆68Updated last year
- Visualization for a Retrieval-Augmented Generation (RAG) Assistant 🤖❤️📚☆192Updated 8 months ago
- ☆30Updated last year