magicproduct / hash-hop
Long context evaluation for large language models
☆201Updated last month
Alternatives and similar repositories for hash-hop:
Users that are interested in hash-hop are comparing it to the libraries listed below
- OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.☆169Updated 2 months ago
- Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters☆125Updated 4 months ago
- Code for NeurIPS'24 paper 'Grokked Transformers are Implicit Reasoners: A Mechanistic Journey to the Edge of Generalization'☆186Updated 4 months ago
- A Collection of Competitive Text-Based Games for Language Model Evaluation and Reinforcement Learning☆102Updated this week
- Experiments on speculative sampling with Llama models☆125Updated last year
- An easy-to-understand framework for LLM samplers that rewind and revise generated tokens☆138Updated last month
- A comprehensive repository of reasoning tasks for LLMs (and beyond)☆426Updated 6 months ago
- Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.☆166Updated 3 weeks ago
- Manage scalable open LLM inference endpoints in Slurm clusters☆253Updated 8 months ago
- Single File, Single GPU, From Scratch, Efficient, Full Parameter Tuning library for "RL for LLMs"☆119Updated this week
- Draw more samples☆187Updated 9 months ago
- an implementation of Self-Extend, to expand the context window via grouped attention☆119Updated last year
- ModuleFormer is a MoE-based architecture that includes two different types of experts: stick-breaking attention heads and feedforward exp…☆217Updated 11 months ago
- Just a bunch of benchmark logs for different LLMs☆119Updated 8 months ago
- Code for the paper "Rethinking Benchmark and Contamination for Language Models with Rephrased Samples"☆300Updated last year
- ☆106Updated 3 months ago
- Multipack distributed sampler for fast padding-free training of LLMs☆186Updated 7 months ago
- PyTorch implementation of models from the Zamba2 series.☆178Updated 2 months ago
- EvaByte: Efficient Byte-level Language Models at Scale☆85Updated 2 weeks ago
- 🌾 OAT: A research-friendly framework for LLM online alignment, including preference learning, reinforcement learning, etc.☆306Updated last week
- ☆163Updated 3 weeks ago
- Repo for "LoLCATs: On Low-Rank Linearizing of Large Language Models"☆229Updated 2 months ago
- Public repository for "The Surprising Effectiveness of Test-Time Training for Abstract Reasoning"☆302Updated 4 months ago
- MiniHF is an inference, human preference data collection, and fine-tuning tool for local language models. It is intended to help the user…☆169Updated this week
- An efficent implementation of the method proposed in "The Era of 1-bit LLMs"☆153Updated 5 months ago
- Train your own SOTA deductive reasoning model☆81Updated 3 weeks ago
- Model Activity VIsualiser☆109Updated this week
- Code to reproduce "Transformers Can Do Arithmetic with the Right Embeddings", McLeish et al (NeurIPS 2024)☆187Updated 10 months ago
- an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)☆91Updated 3 weeks ago
- PyTorch building blocks for the OLMo ecosystem☆186Updated this week