BestAnHongjun / SentenceVAELinks
Enable Next-sentence Prediction for Large Language Models with Faster Speed, Higher Accuracy and Longer Context
β32Updated 9 months ago
Alternatives and similar repositories for SentenceVAE
Users that are interested in SentenceVAE are comparing it to the libraries listed below
Sorting:
- [NeurIPS-2024] π Scaling Laws with Vocabulary: Larger Models Deserve Larger Vocabularies https://arxiv.org/abs/2407.13623β84Updated 8 months ago
- The this is the official implementation of "DAPE: Data-Adaptive Positional Encoding for Length Extrapolation"β38Updated 7 months ago
- Code for paper "Patch-Level Training for Large Language Models"β86Updated 6 months ago
- PyTorch implementation of StableMask (ICML'24)β13Updated 11 months ago
- Optimizing Anytime Reasoning via Budget Relative Policy Optimizationβ36Updated last week
- [ICLR 2024] CLEX: Continuous Length Extrapolation for Large Language Modelsβ77Updated last year
- [ICLR 2025] LongPO: Long Context Self-Evolution of Large Language Models through Short-to-Long Preference Optimizationβ37Updated 3 months ago
- β17Updated 5 months ago
- Codebase for Instruction Following without Instruction Tuningβ34Updated 8 months ago
- A Large-Scale, High-Quality Math Dataset for Reinforcement Learning in Language Modelsβ57Updated 3 months ago
- This repo contains evaluation code for the paper "MileBench: Benchmarking MLLMs in Long Context"β34Updated 10 months ago
- The official implementation for Gated Attention for Large Language Models: Non-linearity, Sparsity, and Attention-Sink-Freeβ40Updated 3 weeks ago
- Code for preprint "Metadata Conditioning Accelerates Language Model Pre-training (MeCo)"β39Updated last month
- β105Updated 2 months ago
- Implementation for the paper "The Surprising Effectiveness of Negative Reinforcement in LLM Reasoning"β27Updated this week
- β89Updated last week
- Long Context Extension and Generalization in LLMsβ56Updated 8 months ago
- [ArXiv] V2PE: Improving Multimodal Long-Context Capability of Vision-Language Models with Variable Visual Position Encodingβ47Updated 5 months ago
- [NAACL 2025] A Closer Look into Mixture-of-Experts in Large Language Modelsβ52Updated 4 months ago
- [ICLR 2023] "Sparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers" by Tianlong Chen*, Zhenyu Zhang*, Ajay Jaiswalβ¦β51Updated 2 years ago
- RM-R1: Unleashing the Reasoning Potential of Reward Modelsβ97Updated this week
- [NeurIPS 2024] | An Efficient Recipe for Long Context Extension via Middle-Focused Positional Encodingβ18Updated 7 months ago
- [NeurIPS 2024] A Novel Rank-Based Metric for Evaluating Large Language Modelsβ46Updated last week
- NoisyRollout: Reinforcing Visual Reasoning with Data Augmentationβ65Updated this week
- β59Updated 9 months ago
- The official code of "VL-Rethinker: Incentivizing Self-Reflection of Vision-Language Models with Reinforcement Learning"β103Updated 2 weeks ago
- The source code of "Merging Experts into One: Improving Computational Efficiency of Mixture of Experts (EMNLP 2023)":β38Updated last year
- [NeurIPS 2024 Main Track] Code for the paper titled "Instruction Tuning With Loss Over Instructions"β37Updated last year
- Official code of *Virgo: A Preliminary Exploration on Reproducing o1-like MLLM*β103Updated last week
- Code for paper "Diffusion Language Models Can Perform Many Tasks with Scaling and Instruction-Finetuning"β78Updated last year