Alternatives and similar repositories for LLMLingua

Users that are interested in LLMLingua are comparing it to the libraries listed below

• AnswerDotAI / RAGatouille
  Easily use and train state of the art late-interaction retrieval methods (ColBERT) in any RAG pipeline. Designed for modularity and ease-…
  ☆3,496Updated last month
• explodinggradients / ragas
  Supercharge Your LLM Application Evaluations 🚀
  ☆9,535Updated this week
• dottxt-ai / outlines
  Structured Text Generation
  ☆11,843Updated this week
• arcee-ai / mergekit
  Tools for merging pretrained large language models.
  ☆5,829Updated this week
• huggingface / text-generation-inference
  Large Language Model Text Generation Inference
  ☆10,236Updated this week
• lm-sys / RouteLLM
  A framework for serving and evaluating LLM routers - save LLM costs without compromising quality
  ☆4,034Updated 10 months ago
• axolotl-ai-cloud / axolotl
  Go ahead and axolotl questions
  ☆9,610Updated this week
• eth-sri / lmql
  A language for constraint-guided and efficient LLM programming.
  ☆3,961Updated 3 weeks ago
• run-llama / llama-hub
  A library of data loaders for LLMs made by the community -- to be used with LlamaIndex and/or LangChain
  ☆3,478Updated last year
• MeetKai / functionary
  Chat language model that can use tools and interpret the results
  ☆1,563Updated this week
• aurelio-labs / semantic-router
  Superfast AI decision making and intelligent processing of multi-modal data.
  ☆2,634Updated last month
• mit-han-lab / streaming-llm
  [ICLR 2024] Efficient Streaming Language Models with Attention Sinks
  ☆6,906Updated 11 months ago
• noamgat / lm-format-enforcer
  Enforce the output format (JSON Schema, Regex etc) of a language model
  ☆1,820Updated 3 months ago
• guardrails-ai / guardrails
  Adding guardrails to large language models.
  ☆5,104Updated 2 weeks ago
• argilla-io / distilabel
  Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifi…
  ☆2,757Updated last week
• zilliztech / GPTCache
  Semantic cache for LLMs. Fully integrated with LangChain and llama_index.
  ☆7,595Updated 9 months ago
• ianarawjo / ChainForge
  An open-source visual programming environment for battle-testing prompts to LLMs.
  ☆2,649Updated last month
• huggingface / text-embeddings-inference
  A blazing fast inference solution for text embeddings models
  ☆3,696Updated this week
• langroid / langroid
  Harness LLMs with Multi-Agent Programming
  ☆3,402Updated this week
• SqueezeAILab / LLMCompiler
  [ICML 2024] LLMCompiler: An LLM Compiler for Parallel Function Calling
  ☆1,698Updated 11 months ago
• ShishirPatil / gorilla
  Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls)
  ☆12,165Updated this week
• huggingface / alignment-handbook
  Robust recipes to align language models with human and AI preferences
  ☆5,223Updated last month
• predibase / lorax
  Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
  ☆3,024Updated last month
• gkamradt / LLMTest_NeedleInAHaystack
  Doing simple retrieval from LLM models at various context lengths to measure accuracy
  ☆1,889Updated 10 months ago
• microsoft / LMOps
  General technology for enabling AI capabilities w/ LLMs and MLLMs
  ☆4,031Updated last week
• pytorch / torchtune
  PyTorch native post-training library
  ☆5,273Updated this week
• letta-ai / letta
  Letta (formerly MemGPT) is the stateful agents framework with memory, reasoning, and context management.
  ☆16,917Updated this week
• run-llama / llama_cloud_services
  Knowledge Agents and Management in the Cloud
  ☆4,014Updated this week
• OpenBMB / ToolBench
  [ICLR'24 spotlight] An open platform for training, serving, and evaluating large language model for tool learning.
  ☆5,114Updated last month
• princeton-nlp / tree-of-thought-llm
  [NeurIPS 2023] Tree of Thoughts: Deliberate Problem Solving with Large Language Models
  ☆5,387Updated 5 months ago