Alternatives and similar repositories for LLMLingua

Users that are interested in LLMLingua are comparing it to the libraries listed below

• lm-sys / RouteLLM
  A framework for serving and evaluating LLM routers - save LLM costs without compromising quality
  ☆4,568Updated last year
• AnswerDotAI / RAGatouille
  Easily use and train state of the art late-interaction retrieval methods (ColBERT) in any RAG pipeline. Designed for modularity and ease-…
  ☆3,849Updated 8 months ago
• aurelio-labs / semantic-router
  Superfast AI decision making and intelligent processing of multi-modal data.
  ☆3,250Updated 2 months ago
• guardrails-ai / guardrails
  Adding guardrails to large language models.
  ☆6,372Updated 2 weeks ago
• noamgat / lm-format-enforcer
  Enforce the output format (JSON Schema, Regex etc) of a language model
  ☆1,986Updated 5 months ago
• microsoft / promptbench
  A unified evaluation framework for large language models
  ☆2,773Updated 2 weeks ago
• dottxt-ai / outlines
  Structured Outputs
  ☆13,370Updated this week
• MeetKai / functionary
  Chat language model that can use tools and interpret the results
  ☆1,590Updated 2 months ago
• gkamradt / LLMTest_NeedleInAHaystack
  Doing simple retrieval from LLM models at various context lengths to measure accuracy
  ☆2,159Updated last year
• langroid / langroid
  Harness LLMs with Multi-Agent Programming
  ☆3,874Updated this week
• NVIDIA-NeMo / Guardrails
  NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.
  ☆5,584Updated last week
• run-llama / llama_cloud_services
  Knowledge Agents and Management in the Cloud
  ☆4,231Updated last week
• Eladlev / AutoPrompt
  A framework for prompt tuning using Intent-based Prompt Calibration
  ☆2,918Updated 2 months ago
• huggingface / text-embeddings-inference
  A blazing fast inference solution for text embeddings models
  ☆4,445Updated last week
• axolotl-ai-cloud / axolotl
  Go ahead and axolotl questions
  ☆11,251Updated this week
• eth-sri / lmql
  A language for constraint-guided and efficient LLM programming.
  ☆4,143Updated 8 months ago
• argilla-io / distilabel
  Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifi…
  ☆3,074Updated last week
• microsoft / LMOps
  General technology for enabling AI capabilities w/ LLMs and MLLMs
  ☆4,277Updated last month
• 1rgs / jsonformer
  A Bulletproof Way to Generate Structured JSON from Language Models
  ☆4,898Updated last year
• run-llama / llama_deploy
  Deploy your agentic worfklows to production
  ☆2,073Updated last week
• mit-han-lab / streaming-llm
  [ICLR 2024] Efficient Streaming Language Models with Attention Sinks
  ☆7,182Updated last year
• huggingface / alignment-handbook
  Robust recipes to align language models with human and AI preferences
  ☆5,489Updated 4 months ago
• AkariAsai / self-rag
  This includes the original implementation of SELF-RAG: Learning to Retrieve, Generate and Critique through self-reflection by Akari Asai,…
  ☆2,315Updated last year
• arcee-ai / mergekit
  Tools for merging pretrained large language models.
  ☆6,761Updated last week
• SqueezeAILab / LLMCompiler
  [ICML 2024] LLMCompiler: An LLM Compiler for Parallel Function Calling
  ☆1,823Updated last year
• stanford-futuredata / ColBERT
  ColBERT: state-of-the-art neural search (SIGIR'20, TACL'21, NeurIPS'21, NAACL'22, CIKM'22, ACL'23, EMNLP'23)
  ☆3,770Updated 3 months ago
• predibase / lorax
  Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
  ☆3,705Updated 8 months ago
• zilliztech / GPTCache
  Semantic cache for LLMs. Fully integrated with LangChain and llama_index.
  ☆7,926Updated 6 months ago
• embeddings-benchmark / mteb
  MTEB: Massive Text Embedding Benchmark
  ☆3,106Updated this week
• ray-project / llm-applications
  A comprehensive guide to building RAG-based LLM applications for production.
  ☆1,848Updated last year