Alternatives and similar repositories for LLMLingua

Users that are interested in LLMLingua are comparing it to the libraries listed below

• AnswerDotAI / RAGatouille
  Easily use and train state of the art late-interaction retrieval methods (ColBERT) in any RAG pipeline. Designed for modularity and ease-…
  ☆3,581Updated 2 months ago
• lm-sys / RouteLLM
  A framework for serving and evaluating LLM routers - save LLM costs without compromising quality
  ☆4,115Updated 11 months ago
• microsoft / promptbench
  A unified evaluation framework for large language models
  ☆2,663Updated 2 weeks ago
• aurelio-labs / semantic-router
  Superfast AI decision making and intelligent processing of multi-modal data.
  ☆2,681Updated last week
• MeetKai / functionary
  Chat language model that can use tools and interpret the results
  ☆1,572Updated this week
• AkariAsai / self-rag
  This includes the original implementation of SELF-RAG: Learning to Retrieve, Generate and Critique through self-reflection by Akari Asai,…
  ☆2,139Updated last year
• explodinggradients / ragas
  Supercharge Your LLM Application Evaluations 🚀
  ☆9,998Updated this week
• langroid / langroid
  Harness LLMs with Multi-Agent Programming
  ☆3,501Updated this week
• noamgat / lm-format-enforcer
  Enforce the output format (JSON Schema, Regex etc) of a language model
  ☆1,848Updated 4 months ago
• Eladlev / AutoPrompt
  A framework for prompt tuning using Intent-based Prompt Calibration
  ☆2,701Updated 3 months ago
• mit-han-lab / streaming-llm
  [ICLR 2024] Efficient Streaming Language Models with Attention Sinks
  ☆6,936Updated last year
• arcee-ai / mergekit
  Tools for merging pretrained large language models.
  ☆6,092Updated last week
• SqueezeAILab / LLMCompiler
  [ICML 2024] LLMCompiler: An LLM Compiler for Parallel Function Calling
  ☆1,718Updated last year
• guardrails-ai / guardrails
  Adding guardrails to large language models.
  ☆5,302Updated last week
• pytorch / torchtune
  PyTorch native post-training library
  ☆5,361Updated this week
• IntelLabs / fastRAG
  Efficient Retrieval Augmentation and Generation Framework
  ☆1,593Updated 6 months ago
• gkamradt / LLMTest_NeedleInAHaystack
  Doing simple retrieval from LLM models at various context lengths to measure accuracy
  ☆1,940Updated 11 months ago
• zilliztech / GPTCache
  Semantic cache for LLMs. Fully integrated with LangChain and llama_index.
  ☆7,649Updated 2 weeks ago
• predibase / lorax
  Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
  ☆3,327Updated 2 months ago
• neulab / prompt2model
  prompt2model - Generate Deployable Models from Natural Language Instructions
  ☆2,005Updated 6 months ago
• ray-project / llm-applications
  A comprehensive guide to building RAG-based LLM applications for production.
  ☆1,807Updated 11 months ago
• argilla-io / distilabel
  Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifi…
  ☆2,816Updated this week
• spcl / graph-of-thoughts
  Official Implementation of "Graph of Thoughts: Solving Elaborate Problems with Large Language Models"
  ☆2,432Updated 7 months ago
• THUDM / AgentBench
  A Comprehensive Benchmark to Evaluate LLMs as Agents (ICLR'24)
  ☆2,697Updated 5 months ago
• huggingface / text-embeddings-inference
  A blazing fast inference solution for text embeddings models
  ☆3,816Updated 2 weeks ago
• eth-sri / lmql
  A language for constraint-guided and efficient LLM programming.
  ☆4,011Updated 2 months ago
• huggingface / text-generation-inference
  Large Language Model Text Generation Inference
  ☆10,352Updated this week
• S-LoRA / S-LoRA
  S-LoRA: Serving Thousands of Concurrent LoRA Adapters
  ☆1,843Updated last year
• aiwaves-cn / agents
  An Open-source Framework for Data-centric, Self-evolving Autonomous Language Agents
  ☆5,656Updated 10 months ago
• huggingface / alignment-handbook
  Robust recipes to align language models with human and AI preferences
  ☆5,280Updated this week