magicproduct / hash-hop
Long context evaluation for large language models
☆200Updated last week
Alternatives and similar repositories for hash-hop:
Users that are interested in hash-hop are comparing it to the libraries listed below
- OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.☆167Updated last month
- Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters☆117Updated 3 months ago
- An easy-to-understand framework for LLM samplers that rewind and revise generated tokens☆131Updated last week
- an implementation of Self-Extend, to expand the context window via grouped attention☆118Updated last year
- PyTorch implementation of models from the Zamba2 series.☆177Updated last month
- Experiments on speculative sampling with Llama models☆125Updated last year
- A comprehensive repository of reasoning tasks for LLMs (and beyond)☆421Updated 5 months ago
- Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".☆189Updated this week
- Repo for "LoLCATs: On Low-Rank Linearizing of Large Language Models"☆218Updated last month
- An efficent implementation of the method proposed in "The Era of 1-bit LLMs"☆154Updated 4 months ago
- MiniHF is an inference, human preference data collection, and fine-tuning tool for local language models. It is intended to help the user…☆165Updated this week
- ☆100Updated 2 months ago
- Code for NeurIPS'24 paper 'Grokked Transformers are Implicit Reasoners: A Mechanistic Journey to the Edge of Generalization'☆183Updated 3 months ago
- ☆109Updated last week
- Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.☆195Updated 7 months ago
- Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.☆163Updated 2 weeks ago
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆99Updated 3 months ago
- ☆122Updated 2 weeks ago
- Multipack distributed sampler for fast padding-free training of LLMs☆184Updated 6 months ago
- Code for Paper: Training Software Engineering Agents and Verifiers with SWE-Gym☆369Updated this week
- Code for the paper "QMoE: Practical Sub-1-Bit Compression of Trillion-Parameter Models".☆268Updated last year
- Code to reproduce "Transformers Can Do Arithmetic with the Right Embeddings", McLeish et al (NeurIPS 2024)☆186Updated 9 months ago
- Memory layers use a trainable key-value lookup mechanism to add extra parameters to a model without increasing FLOPs. Conceptually, spars…☆301Updated 2 months ago
- Code repository for the c-BTM paper☆105Updated last year
- Code for exploring Based models from "Simple linear attention language models balance the recall-throughput tradeoff"☆222Updated 2 weeks ago
- DeMo: Decoupled Momentum Optimization☆181Updated 3 months ago
- Extract full next-token probabilities via language model APIs☆231Updated last year
- A simple unified framework for evaluating LLMs☆199Updated last month