aniketmaurya / llm-inferenceLinks
Large Language Model (LLM) Inference API and Chatbot
☆126Updated last year
Alternatives and similar repositories for llm-inference
Users that are interested in llm-inference are comparing it to the libraries listed below
Sorting:
- Building a chatbot powered with a RAG pipeline to read,summarize and quote the most relevant papers related to the user query.☆168Updated last year
- Mistral + Haystack: build RAG pipelines that rock 🤘☆106Updated last year
- Data extraction with LLM on CPU☆112Updated last year
- Repository of the code base for KT Generation process that we worked at Google Cloud and Searce GenAI Hackathon.☆76Updated 2 years ago
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆50Updated last year
- ☆186Updated 2 years ago
- ☆223Updated 2 years ago
- Data extraction with LLM on CPU☆268Updated last year
- Anthropic Claude2 Hackathon:Building MCTS with Claude for optimal action prediction during patient/doctor interactions.☆106Updated 2 years ago
- ☆52Updated 2 years ago
- 💬 minimalistic ChatBot Interface in pure python☆227Updated last year
- Build a Streamlit Chatbot using Langchain, ColBERT, Ragatouille, and ChromaDB☆122Updated last year
- TitanML Takeoff Server is an optimization, compression and deployment platform that makes state of the art machine learning models access…☆114Updated last year
- ☆93Updated 2 years ago
- Machine Learning Serving focused on GenAI with simplicity as the top priority.☆58Updated last month
- ☆89Updated last year
- Document Q&A on Wikipedia articles using LLMs☆79Updated 2 years ago
- ☆199Updated 2 years ago
- Data extraction with LLM on CPU☆84Updated last year
- 📚 Datasets and models for instruction-tuning☆237Updated 2 years ago
- Chat with PDF using Zephyr 7B Alpha, Langchain, ChromaDB, and Gradio with Free Google Colab☆137Updated last year
- LangChain chat model abstractions for dynamic failover, load balancing, chaos engineering, and more!☆83Updated last year
- Domain Adapted Language Modeling Toolkit - E2E RAG☆330Updated last year
- ☆80Updated last year
- Visualization for a Retrieval-Augmented Generation (RAG) Assistant 🤖❤️📚☆194Updated 2 weeks ago
- Text to Python Objects via a LLM Function Call☆58Updated last year
- Chat Bot with LLM and Fact Reference. RAG(Retrieval Augmented Generation) and LangChain backed☆129Updated last year
- ☆73Updated last year
- ☆57Updated 2 years ago
- Data extraction with LLM on CPU☆68Updated 2 years ago