Alternatives and similar repositories for lorax

Users that are interested in lorax are comparing it to the libraries listed below

• argilla-io / distilabel
  Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifi…
  ☆2,867Updated this week
• huggingface / datatrove
  Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.
  ☆2,563Updated last week
• S-LoRA / S-LoRA
  S-LoRA: Serving Thousands of Concurrent LoRA Adapters
  ☆1,852Updated last year
• huggingface / nanotron
  Minimalistic large language model 3D-parallelism training
  ☆2,180Updated this week
• arcee-ai / mergekit
  Tools for merging pretrained large language models.
  ☆6,231Updated 2 weeks ago
• noamgat / lm-format-enforcer
  Enforce the output format (JSON Schema, Regex etc) of a language model
  ☆1,883Updated last week
• huggingface / lighteval
  Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends
  ☆1,866Updated this week
• pytorch / torchtune
  PyTorch native post-training library
  ☆5,458Updated this week
• axolotl-ai-cloud / axolotl
  Go ahead and axolotl questions
  ☆10,324Updated this week
• mistralai / mistral-finetune
  ☆3,006Updated 11 months ago
• AnswerDotAI / RAGatouille
  Easily use and train state of the art late-interaction retrieval methods (ColBERT) in any RAG pipeline. Designed for modularity and ease-…
  ☆3,656Updated 3 months ago
• vllm-project / llm-compressor
  Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM
  ☆1,903Updated this week
• lm-sys / RouteLLM
  A framework for serving and evaluating LLM routers - save LLM costs without compromising quality
  ☆4,245Updated last year
• IntelLabs / fastRAG
  Efficient Retrieval Augmentation and Generation Framework
  ☆1,657Updated 7 months ago
• michaelfeil / infinity
  Infinity is a high-throughput, low-latency serving engine for text-embeddings, reranking models, clip, clap and colpali
  ☆2,415Updated this week
• codelion / optillm
  Optimizing inference proxy for LLMs
  ☆2,812Updated last week
• AnswerDotAI / rerankers
  A lightweight, low-dependency, unified API to use all common reranking and cross-encoder models.
  ☆1,526Updated 3 months ago
• aphrodite-engine / aphrodite-engine
  Large-scale LLM inference engine
  ☆1,537Updated this week
• stanfordnlp / pyreft
  Stanford NLP Python library for Representation Finetuning (ReFT)
  ☆1,508Updated 6 months ago
• bespokelabsai / curator
  Synthetic data curation for post-training and structured data extraction
  ☆1,491Updated last month
• casper-hansen / AutoAWQ
  AutoAWQ implements the AWQ algorithm for 4-bit quantization with a 2x speedup during inference. Documentation:
  ☆2,235Updated 3 months ago
• gkamradt / LLMTest_NeedleInAHaystack
  Doing simple retrieval from LLM models at various context lengths to measure accuracy
  ☆1,998Updated last year
• mlabonne / llm-datasets
  Curated list of datasets and tools for post-training.
  ☆3,608Updated last month
• NVIDIA-NeMo / Curator
  Scalable data pre processing and curation toolkit for LLMs
  ☆1,124Updated this week
• Lightning-AI / LitServe
  The easiest way to deploy agents, MCP servers, models, RAG, pipelines and more. No MLOps. No YAML.
  ☆3,524Updated 2 weeks ago
• NousResearch / Hermes-Function-Calling
  ☆1,066Updated 11 months ago
• allenai / open-instruct
  AllenAI's post-training codebase
  ☆3,144Updated this week
• huggingface / evaluation-guidebook
  Sharing both practical insights and theoretical knowledge about LLM evaluation that we gathered while managing the Open LLM Leaderboard a…
  ☆1,552Updated 7 months ago
• deepspeedai / DeepSpeed-MII
  MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.
  ☆2,051Updated 2 months ago
• e-p-armstrong / augmentoolkit
  Create Custom LLMs
  ☆1,727Updated 2 weeks ago