zilliztech / GPTCacheLinks
Semantic cache for LLMs. Fully integrated with LangChain and llama_index.
☆7,794Updated 3 months ago
Alternatives and similar repositories for GPTCache
Users that are interested in GPTCache are comparing it to the libraries listed below
Sorting:
- ☆6,120Updated last week
- A library of data loaders for LLMs made by the community -- to be used with LlamaIndex and/or LangChain☆3,477Updated last year
- ☆3,376Updated 2 years ago
- A guidance language for controlling large language models.☆20,847Updated last week
- Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls)☆12,479Updated last week
- 😎 Awesome list of tools and projects with the awesome LangChain framework☆8,873Updated 2 months ago
- ☆21,888Updated 11 months ago
- Plug in and Play Implementation of Tree of Thoughts: Deliberate Problem Solving with Large Language Models that Elevates Model Reasoning …☆4,546Updated 2 months ago
- The Official Python Client for Lamini's API☆2,543Updated 6 months ago
- Adding guardrails to large language models.☆5,817Updated last week
- NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.☆5,159Updated this week
- Python package for easily interfacing with chat apps, with robust features and minimal code complexity.☆3,521Updated last year
- A language for constraint-guided and efficient LLM programming.☆4,069Updated 5 months ago
- [EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which ach…☆5,499Updated 7 months ago
- AutoChain: Build lightweight, extensible, and testable LLM Agents☆1,861Updated last year
- 👾 Open source implementation of the ChatGPT Code Interpreter☆3,857Updated 11 months ago
- Prompt Engineering | Prompt Versioning | Use GPT or other prompt based models to get structured output. Join our discord for Prompt-Engin…☆4,344Updated 8 months ago
- LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath☆9,454Updated 4 months ago
- ☆2,161Updated last year
- Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.☆17,160Updated 10 months ago
- Let ChatGPT teach your own chatbot in hours with a single GPU!☆3,170Updated last year
- Numbers every LLM developer should know☆4,260Updated last year
- Home of StarCoder: fine-tuning & inference!☆7,464Updated last year
- An awesome & curated list of best LLMOps tools for developers☆5,352Updated last month
- LLM(😽)☆1,684Updated 8 months ago
- Purpose-trained models that secure your applications and keep them compliant — with low-latency, production-ready performance.☆6,214Updated this week
- Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.☆11,857Updated last week
- LlamaIndex is the leading framework for building LLM-powered agents over your data.☆44,778Updated this week
- JARVIS, a system to connect LLMs with ML community. Paper: https://arxiv.org/pdf/2303.17580.pdf☆24,410Updated 2 months ago
- Overview and tutorial of the LangChain Library☆7,271Updated last year