Alternatives and similar repositories for RULER:

Users that are interested in RULER are comparing it to the libraries listed below

• datamllab / LongLM
  [ICML'24 Spotlight] LLM Maybe LongLM: Self-Extend LLM Context Window Without Tuning
  ☆634Updated 7 months ago
• apoorvumang / prompt-lookup-decoding
  ☆493Updated 4 months ago
• punica-ai / punica
  Serving multiple LoRA finetuned LLM as one
  ☆1,012Updated 8 months ago
• hao-ai-lab / LookaheadDecoding
  [ICML 2024] Break the Sequential Dependency of LLM Inference Using Lookahead Decoding
  ☆1,179Updated 3 months ago
• aphrodite-engine / aphrodite-engine
  Large-scale LLM inference engine
  ☆1,232Updated last week
• Leeroo-AI / mergoo
  A library for easily merging multiple LLM experts, and efficiently train the merged LLM.
  ☆426Updated 4 months ago
• gkamradt / LLMTest_NeedleInAHaystack
  Doing simple retrieval from LLM models at various context lengths to measure accuracy
  ☆1,654Updated 5 months ago
• arcee-ai / DistillKit
  An Open Source Toolkit For LLM Distillation
  ☆425Updated last week
• jquesnelle / yarn
  YaRN: Efficient Context Window Extension of Large Language Models
  ☆1,398Updated 9 months ago
• vllm-project / llm-compressor
  Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM
  ☆851Updated this week
• argilla-io / distilabel
  Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifi…
  ☆1,879Updated this week
• lmarena / arena-hard-auto
  Arena-Hard-Auto: An automatic LLM benchmark.
  ☆708Updated 2 weeks ago
• huggingface / lighteval
  Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends
  ☆970Updated this week
• tomaarsen / attention_sinks
  Extend existing LLMs way beyond the original training length with constant memory usage, without retraining
  ☆684Updated 9 months ago
• huggingface / cosmopedia
  ☆484Updated last month
• mobiusml / hqq
  Official implementation of Half-Quadratic Quantization (HQQ)
  ☆732Updated this week
• microsoft / MInference
  [NeurIPS'24 Spotlight] To speed up Long-context LLMs' inference, approximate and dynamic sparse calculate the attention, which reduces in…
  ☆874Updated 2 weeks ago
• NousResearch / Hermes-Function-Calling
  ☆774Updated 4 months ago
• prometheus-eval / prometheus-eval
  Evaluate your LLM's response with Prometheus and GPT4 💯
  ☆841Updated last week
• SafeAILab / EAGLE
  Official Implementation of EAGLE-1 (ICML'24) and EAGLE-2 (EMNLP'24)
  ☆912Updated 2 weeks ago
• huggingface / nanotron
  Minimalistic large language model 3D-parallelism training
  ☆1,386Updated this week
• kvcache-ai / ktransformers
  A Flexible Framework for Experiencing Cutting-edge LLM Inference Optimizations
  ☆832Updated 2 months ago
• noamgat / lm-format-enforcer
  Enforce the output format (JSON Schema, Regex etc) of a language model
  ☆1,666Updated 3 months ago
• chujiezheng / chat_templates
  Chat Templates for 🤗 HuggingFace Large Language Models
  ☆588Updated last month
• casper-hansen / AutoAWQ
  AutoAWQ implements the AWQ algorithm for 4-bit quantization with a 2x speedup during inference. Documentation:
  ☆1,885Updated 2 weeks ago
• trotsky1997 / MathBlackBox
  ☆996Updated last month
• RahulSChand / gpu_poor
  Calculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization
  ☆1,199Updated last month
• Cornell-RelaxML / quip-sharp
  ☆515Updated 2 months ago
• ContextualAI / gritlm
  Generative Representational Instruction Tuning
  ☆584Updated 2 months ago
• microsoft / VPTQ
  VPTQ, A Flexible and Extreme low-bit quantization algorithm
  ☆561Updated this week