Alternatives and similar repositories for LLMLingua

Users that are interested in LLMLingua are comparing it to the libraries listed below

• lm-sys / RouteLLM
  A framework for serving and evaluating LLM routers - save LLM costs without compromising quality
  ☆4,442Updated last year
• AnswerDotAI / RAGatouille
  Easily use and train state of the art late-interaction retrieval methods (ColBERT) in any RAG pipeline. Designed for modularity and ease-…
  ☆3,789Updated 6 months ago
• aurelio-labs / semantic-router
  Superfast AI decision making and intelligent processing of multi-modal data.
  ☆2,933Updated 2 weeks ago
• microsoft / promptbench
  A unified evaluation framework for large language models
  ☆2,761Updated last month
• Eladlev / AutoPrompt
  A framework for prompt tuning using Intent-based Prompt Calibration
  ☆2,868Updated this week
• MeetKai / functionary
  Chat language model that can use tools and interpret the results
  ☆1,588Updated 3 weeks ago
• SqueezeAILab / LLMCompiler
  [ICML 2024] LLMCompiler: An LLM Compiler for Parallel Function Calling
  ☆1,796Updated last year
• microsoft / TaskWeaver
  The first "code-first" agent framework for seamlessly planning and executing data analytics tasks.
  ☆6,025Updated this week
• arcee-ai / mergekit
  Tools for merging pretrained large language models.
  ☆6,533Updated last week
• predibase / lorax
  Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
  ☆3,552Updated 6 months ago
• vibrantlabsai / ragas
  Supercharge Your LLM Application Evaluations 🚀
  ☆11,597Updated last week
• AkariAsai / self-rag
  This includes the original implementation of SELF-RAG: Learning to Retrieve, Generate and Critique through self-reflection by Akari Asai,…
  ☆2,261Updated last year
• mit-han-lab / streaming-llm
  [ICLR 2024] Efficient Streaming Language Models with Attention Sinks
  ☆7,142Updated last year
• neulab / prompt2model
  prompt2model - Generate Deployable Models from Natural Language Instructions
  ☆2,008Updated 11 months ago
• Codium-ai / AlphaCodium
  Official implementation for the paper: "Code Generation with AlphaCodium: From Prompt Engineering to Flow Engineering""
  ☆3,905Updated last year
• langroid / langroid
  Harness LLMs with Multi-Agent Programming
  ☆3,790Updated last week
• gkamradt / LLMTest_NeedleInAHaystack
  Doing simple retrieval from LLM models at various context lengths to measure accuracy
  ☆2,091Updated last year
• noamgat / lm-format-enforcer
  Enforce the output format (JSON Schema, Regex etc) of a language model
  ☆1,962Updated 3 months ago
• axolotl-ai-cloud / axolotl
  Go ahead and axolotl questions
  ☆10,911Updated this week
• NVIDIA-NeMo / Guardrails
  NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.
  ☆5,345Updated last week
• IntelLabs / fastRAG
  Efficient Retrieval Augmentation and Generation Framework
  ☆1,748Updated 10 months ago
• langchain-ai / langserve
  LangServe 🦜️🏓
  ☆2,221Updated last month
• hegelai / prompttools
  Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chro…
  ☆2,975Updated last year
• argilla-io / distilabel
  Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifi…
  ☆2,956Updated this week
• ray-project / llm-applications
  A comprehensive guide to building RAG-based LLM applications for production.
  ☆1,842Updated last year
• microsoft / LMOps
  General technology for enabling AI capabilities w/ LLMs and MLLMs
  ☆4,217Updated this week
• run-llama / llama_deploy
  Deploy your agentic worfklows to production
  ☆2,065Updated this week
• huggingface / text-embeddings-inference
  A blazing fast inference solution for text embeddings models
  ☆4,252Updated 3 weeks ago
• xlang-ai / OpenAgents
  [COLM 2024] OpenAgents: An Open Platform for Language Agents in the Wild
  ☆4,625Updated last year
• mistralai / mistral-finetune
  ☆3,039Updated 2 weeks ago