zilliztech / GPTCache
Semantic cache for LLMs. Fully integrated with LangChain and llama_index.
☆7,468Updated 6 months ago
Alternatives and similar repositories for GPTCache:
Users that are interested in GPTCache are comparing it to the libraries listed below
- A library of data loaders for LLMs made by the community -- to be used with LlamaIndex and/or LangChain☆3,471Updated last year
- Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls)☆11,909Updated this week
- ☆3,306Updated last year
- ☆5,771Updated last week
- Large Language Model Text Generation Inference☆9,905Updated this week
- LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath☆9,358Updated 7 months ago
- A guidance language for controlling large language models.☆19,918Updated this week
- The ChatGPT Retrieval Plugin lets you easily find personal or work documents by asking questions in natural language.☆21,148Updated 8 months ago
- Home of StarCoder: fine-tuning & inference!☆7,394Updated last year
- the AI-native open-source embedding database☆18,652Updated this week
- Instruct-tune LLaMA on consumer hardware☆18,842Updated 7 months ago
- Plug in and Play Implementation of Tree of Thoughts: Deliberate Problem Solving with Large Language Models that Elevates Model Reasoning …☆4,466Updated 4 months ago
- NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.☆4,533Updated this week
- LlamaIndex is the leading framework for building LLM-powered agents over your data.☆40,106Updated this week
- QLoRA: Efficient Finetuning of Quantized LLMs☆10,322Updated 9 months ago
- 😎 Awesome list of tools and projects with the awesome LangChain framework☆8,103Updated 2 weeks ago
- The Official Python Client for Lamini's API☆2,525Updated this week
- OpenLLaMA, a permissively licensed open source reproduction of Meta AI’s LLaMA 7B trained on the RedPajama dataset☆7,462Updated last year
- Python package for easily interfacing with chat apps, with robust features and minimal code complexity.☆3,503Updated 8 months ago
- The RedPajama-Data repository contains code for preparing large datasets for training large language models.☆4,678Updated 3 months ago
- A language for constraint-guided and efficient LLM programming.☆3,864Updated 9 months ago
- ☆21,229Updated 4 months ago
- [EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which ach…☆4,957Updated last week
- 👾 Open source implementation of the ChatGPT Code Interpreter☆3,825Updated 4 months ago
- Prompt Engineering | Prompt Versioning | Use GPT or other prompt based models to get structured output. Join our discord for Prompt-Engin…☆3,435Updated last month
- Universal LLM Deployment Engine with ML Compilation☆20,220Updated this week
- LangChain & LangGraph AI PDF chatbot agent☆15,215Updated last month
- ☆2,149Updated 6 months ago
- Adding guardrails to large language models.☆4,646Updated last week
- Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Ad…☆6,040Updated 6 months ago