Manage scalable open LLM inference endpoints in Slurm clusters
☆296Jul 11, 2024Updated 2 years ago
Alternatives and similar repositories for llm-swarm
Users that are interested in llm-swarm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆578Nov 20, 2024Updated last year
- Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends☆2,579Oct 29, 2026Updated last week
- Easily embed, cluster and semantically label text datasets☆610Mar 28, 2024Updated 2 years ago
- Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.☆3,416Updated this week
- Minimalistic large language model 3D-parallelism training☆2,855Oct 8, 2026Updated 3 weeks ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifi…☆3,450Updated this week
- Robust recipes to align language models with human and AI preferences☆5,711Sep 23, 2026Updated last month
- Tools for merging pretrained large language models.☆7,436Updated this week
- A pytorch quantization backend for optimum☆1,056Oct 26, 2026Updated last week
- A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.☆32Sep 19, 2025Updated last year
- A bagel, with everything.☆327Apr 11, 2024Updated 2 years ago
- Experiments with generating opensource language model assistants☆97May 14, 2023Updated 3 years ago
- Automated Identification of Redundant Layer Blocks for Pruning in Large Language Models☆269Apr 23, 2024Updated 2 years ago
- Large Language Model Text Generation Inference☆10,881Mar 21, 2026Updated 7 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- S-LoRA: Serving Thousands of Concurrent LoRA Adapters☆1,923Jan 21, 2024Updated 2 years ago
- Scaling Data-Constrained Language Models☆352Jun 28, 2025Updated last year
- Automatically evaluate your LLMs in Google Colab☆699May 7, 2024Updated 2 years ago
- Scripts to convert datasets from various sources to Hugging Face Datasets.☆57Oct 26, 2022Updated 4 years ago
- Minimal sharded dataset loaders, decoders, and utils for multi-modal document, image, and text datasets.☆162Apr 3, 2024Updated 2 years ago
- Using short models to classify long texts☆22Mar 8, 2023Updated 3 years ago
- 🏋️ A unified multi-backend utility for benchmarking Transformers, Timm, PEFT, Diffusers and Sentence-Transformers with full support of O…☆341Oct 14, 2026Updated 3 weeks ago
- Data and tools for generating and inspecting OLMo pre-training data.☆1,562Aug 24, 2026Updated 2 months ago
- Deita: Data-Efficient Instruction Tuning for Alignment [ICLR2024]☆609Dec 9, 2024Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- AllenAI's post-training codebase☆3,924Updated this week
- ☆1,203Jan 10, 2026Updated 9 months ago
- [ICLR 2025] Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothing. Your efficient and high-quality synthetic data …☆899Mar 17, 2025Updated last year
- Efficient few-shot learning with Sentence Transformers☆2,864Updated this week
- 🚀 Accelerate inference and training of 🤗 Transformers, Diffusers, TIMM and Sentence Transformers with easy to use hardware optimization…☆3,518Updated this week
- Train transformer language models with reinforcement learning.☆19,675Updated this week
- Argilla is a collaboration tool for AI engineers and domain experts to build high-quality datasets☆5,193Updated this week
- Automatically derive Python dunder methods for your Rust code☆25Sep 24, 2026Updated last month
- Implementation of the training framework proposed in Self-Rewarding Language Model, from MetaAI☆1,413Apr 11, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Simple and efficient pytorch-native transformer training and inference (batched)☆78Apr 2, 2024Updated 2 years ago
- Let's build better datasets, together!☆276Updated this week
- A framework for few-shot evaluation of language models.☆14,407Updated this week
- This is our own implementation of 'Layer Selective Rank Reduction'☆240Sep 29, 2026Updated last month
- DataComp for Language Models☆1,479Sep 9, 2025Updated last year
- What's In My Big Data (WIMBD) - a toolkit for analyzing large text datasets☆229Nov 16, 2024Updated last year
- A modular RL library to fine-tune language models to human preferences☆2,400Mar 1, 2024Updated 2 years ago