magicproduct / hash-hop
Long context evaluation for large language models
☆208Updated 2 months ago
Alternatives and similar repositories for hash-hop
Users that are interested in hash-hop are comparing it to the libraries listed below
Sorting:
- OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.☆172Updated 4 months ago
- Experiments on speculative sampling with Llama models☆126Updated last year
- ☆125Updated last month
- prime-rl is a codebase for decentralized RL training at scale☆211Updated this week
- Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters☆126Updated 5 months ago
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆120Updated last week
- EvaByte: Efficient Byte-level Language Models at Scale☆97Updated 3 weeks ago
- Repo for "LoLCATs: On Low-Rank Linearizing of Large Language Models"☆233Updated 3 months ago
- Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.☆173Updated 2 months ago
- ☆111Updated 4 months ago
- Code for the paper "QMoE: Practical Sub-1-Bit Compression of Trillion-Parameter Models".☆274Updated last year
- smolLM with Entropix sampler on pytorch☆151Updated 6 months ago
- MiniHF is an inference, human preference data collection, and fine-tuning tool for local language models. It is intended to help the user…☆170Updated this week
- Train your own SOTA deductive reasoning model☆92Updated 2 months ago
- Code for the paper "Rethinking Benchmark and Contamination for Language Models with Rephrased Samples"☆302Updated last year
- Multipack distributed sampler for fast padding-free training of LLMs☆189Updated 9 months ago
- Memory layers use a trainable key-value lookup mechanism to add extra parameters to a model without increasing FLOPs. Conceptually, spars…☆327Updated 5 months ago
- Extract full next-token probabilities via language model APIs☆244Updated last year
- An easy-to-understand framework for LLM samplers that rewind and revise generated tokens☆140Updated 2 months ago
- Official repo for Learning to Reason for Long-Form Story Generation☆53Updated 3 weeks ago
- Exploring Applications of GRPO☆212Updated last week
- Repository for the paper Stream of Search: Learning to Search in Language☆146Updated 3 months ago
- Just a bunch of benchmark logs for different LLMs☆118Updated 9 months ago
- Understand and test language model architectures on synthetic tasks.☆194Updated 2 months ago
- Cold Compress is a hackable, lightweight, and open-source toolkit for creating and benchmarking cache compression methods built on top of…☆131Updated 9 months ago
- ☆129Updated last month
- SkyRL-v0: Train Real-World Long-Horizon Agents via Reinforcement Learning☆261Updated this week
- Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.☆199Updated 10 months ago
- An efficent implementation of the method proposed in "The Era of 1-bit LLMs"☆154Updated 7 months ago
- Positional Skip-wise Training for Efficient Context Window Extension of LLMs to Extremely Length (ICLR 2024)☆204Updated 11 months ago