allenai / OLMo
Modeling, training, eval, and inference code for OLMo
☆5,560Updated this week
Alternatives and similar repositories for OLMo:
Users that are interested in OLMo are comparing it to the libraries listed below
- Tools for merging pretrained large language models.☆5,614Updated this week
- PyTorch native post-training library☆5,138Updated this week
- LMDeploy is a toolkit for compressing, deploying, and serving LLMs.☆6,274Updated this week
- ☆4,077Updated 11 months ago
- AllenAI's post-training codebase☆2,939Updated this week
- Train transformer language models with reinforcement learning.☆13,559Updated this week
- SGLang is a fast serving framework for large language models and vision language models.☆13,829Updated this week
- An efficient, flexible and full-featured toolkit for fine-tuning LLM (InternLM2, Llama3, Phi3, Qwen, Mistral, ...)☆4,520Updated 3 weeks ago
- A framework for few-shot evaluation of language models.☆8,815Updated last week
- Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.☆5,940Updated 3 weeks ago
- [ICLR 2024] Efficient Streaming Language Models with Attention Sinks☆6,872Updated 9 months ago
- Go ahead and axolotl questions☆9,258Updated this week
- OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, …☆5,279Updated this week
- LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalabili…☆3,187Updated this week
- Large Language Model Text Generation Inference☆10,081Updated this week
- A PyTorch native library for large-scale model training☆3,665Updated this week
- a state-of-the-art-level open visual language model | 多模态预训练模型☆6,507Updated 11 months ago
- [MLSys 2024 Best Paper Award] AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration☆2,970Updated 3 weeks ago
- The official repo of Qwen-VL (通义千问-VL) chat & pretrained large vision language model proposed by Alibaba Cloud.☆5,842Updated 8 months ago
- An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.☆4,826Updated 3 weeks ago
- 20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.☆12,064Updated last week
- Retrieval and Retrieval-augmented LLMs☆9,524Updated 3 weeks ago
- Training LLMs with QLoRA + FSDP☆1,476Updated 5 months ago
- Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifi…☆2,671Updated last week
- Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 500+ LLMs (Qwen3, Qwen3-MoE, Llama4, InternLM3, GLM4, Mistral, Yi1.5, DeepSeek-R1, ...) an…☆7,328Updated this week
- The official PyTorch implementation of Google's Gemma models☆5,430Updated last month
- verl: Volcano Engine Reinforcement Learning for LLMs☆7,475Updated this week
- Fast and memory-efficient exact attention☆17,192Updated this week
- Data and tools for generating and inspecting OLMo pre-training data.☆1,205Updated last week
- Accessible large language models via k-bit quantization for PyTorch.☆6,972Updated this week