huggingface / llm-swarmLinks
Manage scalable open LLM inference endpoints in Slurm clusters
☆260Updated 11 months ago
Alternatives and similar repositories for llm-swarm
Users that are interested in llm-swarm are comparing it to the libraries listed below
Sorting:
- EvolKit is an innovative framework designed to automatically enhance the complexity of instructions used for fine-tuning Large Language M…☆223Updated 7 months ago
- Positional Skip-wise Training for Efficient Context Window Extension of LLMs to Extremely Length (ICLR 2024)☆203Updated last year
- ☆520Updated 7 months ago
- Multipack distributed sampler for fast padding-free training of LLMs☆191Updated 10 months ago
- BABILong is a benchmark for LLM evaluation using the needle-in-a-haystack approach.☆203Updated last month
- The official evaluation suite and dynamic data release for MixEval.☆242Updated 7 months ago
- Let's build better datasets, together!☆259Updated 6 months ago
- Experiments on speculative sampling with Llama models☆128Updated 2 years ago
- Code for the paper "Rethinking Benchmark and Contamination for Language Models with Rephrased Samples"☆303Updated last year
- experiments with inference on llama☆104Updated last year
- PyTorch building blocks for the OLMo ecosystem☆234Updated this week