HazyResearch / embroidLinks
Embroid: Unsupervised Prediction Smoothing Can Improve Few-Shot Classification
☆11Updated 2 years ago
Alternatives and similar repositories for embroid
Users that are interested in embroid are comparing it to the libraries listed below
Sorting:
- Engineering the state of RNN language models (Mamba, RWKV, etc.)☆32Updated last year
- Source-to-Source Debuggable Derivatives in Pure Python☆15Updated last year
- Minimum Description Length probing for neural network representations☆20Updated 9 months ago
- ☆57Updated last year
- ☆52Updated last year
- Embedding Recycling for Language models☆38Updated 2 years ago
- Implementation of the model: "Reka Core, Flash, and Edge: A Series of Powerful Multimodal Language Models" in PyTorch☆28Updated 3 weeks ago
- Using FlexAttention to compute attention with different masking patterns☆47Updated last year
- Official repository of paper "RNNs Are Not Transformers (Yet): The Key Bottleneck on In-context Retrieval"☆27Updated last year
- Aioli: A unified optimization framework for language model data mixing☆28Updated 10 months ago
- The repository contains code for Adaptive Data Optimization☆28Updated 11 months ago
- Code for our paper Resources and Evaluations for Multi-Distribution Dense Information Retrieval☆15Updated last year
- Triton Implementation of HyperAttention Algorithm☆48Updated last year
- Code for the arXiv preprint "The Unreasonable Effectiveness of Easy Training Data"☆48Updated last year
- JAX/Flax implementation of the Hyena Hierarchy☆34Updated 2 years ago
- Adding new tasks to T0 without catastrophic forgetting☆33Updated 3 years ago
- ☆20Updated last year
- Understanding the correlation between different LLM benchmarks☆29Updated last year
- This is a new metric that can be used to evaluate faithfulness of text generated by LLMs. The work behind this repository can be found he…☆31Updated 2 years ago
- Reference implementation for Reward-Augmented Decoding: Efficient Controlled Text Generation With a Unidirectional Reward Model☆43Updated last month
- Implementation of "LM-Infinite: Simple On-the-Fly Length Generalization for Large Language Models"☆39Updated last year
- A repository for research on medium sized language models.☆78Updated last year
- ☆26Updated last year
- Official repository for the paper "Approximating Two-Layer Feedforward Networks for Efficient Transformers"☆38Updated 5 months ago
- Implementation of the paper: "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention" from Google in pyTO…☆56Updated 3 weeks ago
- Scripts for downloading and pre-processing the `proof-pile`, a high quality dataset of mathematical text and code.☆21Updated 2 years ago
- Q-Probe: A Lightweight Approach to Reward Maximization for Language Models☆41Updated last year
- Codes and files for the paper Are Emergent Abilities in Large Language Models just In-Context Learning☆33Updated 10 months ago
- Blog post☆17Updated last year
- ☆13Updated 5 months ago