OpenEvaByte / evabyte
EvaByte: Efficient Byte-level Language Models at Scale
☆85Updated last week
Alternatives and similar repositories for evabyte:
Users that are interested in evabyte are comparing it to the libraries listed below
- ☆111Updated last month
- OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.☆168Updated 2 months ago
- ☆74Updated 7 months ago
- ☆60Updated 11 months ago
- Functional Benchmarks and the Reasoning Gap☆84Updated 5 months ago
- This is the official repository for Inheritune.☆109Updated last month
- Repository for the paper Stream of Search: Learning to Search in Language☆142Updated last month
- Train your own SOTA deductive reasoning model☆81Updated 3 weeks ago
- Language models scale reliably with over-training and on downstream tasks☆96Updated 11 months ago
- Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.☆165Updated 2 weeks ago
- Benchmark and research code for the paper SWEET-RL Training Multi-Turn LLM Agents onCollaborative Reasoning Tasks☆83Updated last week
- Replicating O1 inference-time scaling laws☆83Updated 3 months ago
- Positional Skip-wise Training for Efficient Context Window Extension of LLMs to Extremely Length (ICLR 2024)☆205Updated 10 months ago
- Experiments for efforts to train a new and improved t5☆77Updated 11 months ago
- PyTorch implementation of models from the Zamba2 series.☆178Updated 2 months ago
- A repository for research on medium sized language models.☆76Updated 10 months ago
- ☆48Updated 4 months ago
- ☆87Updated 6 months ago
- This repo is based on https://github.com/jiaweizzhao/GaLore☆26Updated 6 months ago
- ☆32Updated 9 months ago
- Code for NeurIPS'24 paper 'Grokked Transformers are Implicit Reasoners: A Mechanistic Journey to the Edge of Generalization'☆186Updated 3 months ago
- Code repository for the c-BTM paper☆106Updated last year
- ☆40Updated 3 weeks ago
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆103Updated 4 months ago
- Code for Zero-Shot Tokenizer Transfer☆125Updated 2 months ago
- Evaluating LLMs with fewer examples☆147Updated 11 months ago
- ☆160Updated 2 weeks ago
- The official repo for "LLoCo: Learning Long Contexts Offline"☆116Updated 9 months ago
- Code for PHATGOOSE introduced in "Learning to Route Among Specialized Experts for Zero-Shot Generalization"☆82Updated last year
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆55Updated 6 months ago