zilliztech / GPTCache
Semantic cache for LLMs. Fully integrated with LangChain and llama_index.
☆7,503Updated 6 months ago
Alternatives and similar repositories for GPTCache:
Users that are interested in GPTCache are comparing it to the libraries listed below
- A library of data loaders for LLMs made by the community -- to be used with LlamaIndex and/or LangChain☆3,474Updated last year
- Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls)☆11,970Updated this week
- ☆5,824Updated last week
- ☆3,314Updated last year
- LlamaIndex is the leading framework for building LLM-powered agents over your data.☆40,881Updated this week
- 😎 Awesome list of tools and projects with the awesome LangChain framework☆8,209Updated last week
- the AI-native open-source embedding database☆19,226Updated this week
- LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath☆9,365Updated 8 months ago
- A language for constraint-guided and efficient LLM programming.☆3,889Updated 10 months ago
- NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.☆4,614Updated this week
- Plug in and Play Implementation of Tree of Thoughts: Deliberate Problem Solving with Large Language Models that Elevates Model Reasoning …☆4,478Updated 5 months ago
- ☆21,336Updated 5 months ago
- AI PDF chatbot agent built with LangChain & LangGraph☆15,361Updated last month
- A guidance language for controlling large language models.☆20,017Updated this week
- OpenLLaMA, a permissively licensed open source reproduction of Meta AI’s LLaMA 7B trained on the RedPajama dataset☆7,472Updated last year
- 🥷 Run AI-agents with an API☆5,736Updated last week
- Adding guardrails to large language models.☆4,780Updated this week
- Prompt Engineering | Prompt Versioning | Use GPT or other prompt based models to get structured output. Join our discord for Prompt-Engin…☆3,466Updated 2 months ago
- Supercharge Your LLM Application Evaluations 🚀☆8,730Updated last week
- [ICLR 2024] Efficient Streaming Language Models with Attention Sinks☆6,848Updated 9 months ago
- Overview and tutorial of the LangChain Library☆7,042Updated 8 months ago
- The ChatGPT Retrieval Plugin lets you easily find personal or work documents by asking questions in natural language.☆21,161Updated 9 months ago
- Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.☆11,098Updated this week
- SkyPilot: Run AI and batch jobs on any infra (Kubernetes or 16+ clouds). Get unified execution, cost savings, and high GPU availability v…☆7,642Updated this week
- [EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which ach…☆5,004Updated last month
- PDF GPT allows you to chat with the contents of your PDF file by using GPT capabilities. The most effective open source solution to turn …☆7,107Updated last month
- ✨ AI agents that spark joy☆5,605Updated this week
- Open source libraries and APIs to build custom preprocessing pipelines for labeling, training, or production machine learning pipelines.☆10,814Updated this week
- Home of StarCoder: fine-tuning & inference!☆7,406Updated last year
- ☆2,150Updated 7 months ago