magicproduct / hash-hop
Long context evaluation for large language models
☆185Updated this week
Related projects ⓘ
Alternatives and complementary repositories for hash-hop
- A comprehensive repository of reasoning tasks for LLMs (and beyond)☆273Updated last month
- Repo for "LoLCATs: On Low-Rank Linearizing of Large Language Models"☆171Updated 3 weeks ago
- Experiments on speculative sampling with Llama models☆117Updated last year
- ☆101Updated last month
- A simple unified framework for evaluating LLMs☆138Updated this week
- Just a bunch of benchmark logs for different LLMs☆113Updated 3 months ago
- ☆465Updated 2 months ago
- an implementation of Self-Extend, to expand the context window via grouped attention☆118Updated 10 months ago
- ModuleFormer is a MoE-based architecture that includes two different types of experts: stick-breaking attention heads and feedforward exp…☆216Updated 6 months ago
- Multipack distributed sampler for fast padding-free training of LLMs☆175Updated 3 months ago
- Code for NeurIPS'24 paper 'Grokked Transformers are Implicit Reasoners: A Mechanistic Journey to the Edge of Generalization'☆160Updated last month
- Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters☆104Updated last month
- PyTorch implementation of models from the Zamba2 series.☆158Updated 2 months ago
- Manage scalable open LLM inference endpoints in Slurm clusters☆237Updated 3 months ago
- batched loras☆336Updated last year
- ☆99Updated 3 months ago
- Code repository for the c-BTM paper☆105Updated last year
- Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.☆119Updated 2 weeks ago
- A bagel, with everything.☆312Updated 6 months ago
- Code for exploring Based models from "Simple linear attention language models balance the recall-throughput tradeoff"☆212Updated 2 months ago
- Code for the paper "Rethinking Benchmark and Contamination for Language Models with Rephrased Samples"☆292Updated 10 months ago
- ☆411Updated last year
- Positional Skip-wise Training for Efficient Context Window Extension of LLMs to Extremely Length (ICLR 2024)☆200Updated 5 months ago
- Understand and test language model architectures on synthetic tasks.☆161Updated 6 months ago
- code for training & evaluating Contextual Document Embedding models☆92Updated this week
- Code to reproduce "Transformers Can Do Arithmetic with the Right Embeddings", McLeish et al (NeurIPS 2024)☆176Updated 5 months ago
- Automated Identification of Redundant Layer Blocks for Pruning in Large Language Models☆194Updated 6 months ago
- Code for the paper "QMoE: Practical Sub-1-Bit Compression of Trillion-Parameter Models".☆261Updated last year
- An easy-to-understand framework for LLM samplers that rewind and revise generated tokens☆105Updated last week
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆83Updated last week