haileyschoelkopf / triton-index
See https://github.com/cuda-mode/triton-index/ instead!
☆11Updated 6 months ago
Related projects ⓘ
Alternatives and complementary repositories for triton-index
- QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…☆34Updated last year
- Engineering the state of RNN language models (Mamba, RWKV, etc.)☆32Updated 5 months ago
- Training hybrid models for dummies.☆15Updated 2 weeks ago
- ☆20Updated last year
- [NeurIPS 2023] Sparse Modular Activation for Efficient Sequence Modeling☆35Updated 11 months ago
- ☆26Updated 4 months ago
- A place to store reusable transformer components of my own creation or found on the interwebs☆43Updated this week
- My explorations into editing the knowledge and memories of an attention network☆34Updated last year
- [WIP] Transformer to embed Danbooru labelsets☆13Updated 7 months ago
- ☆45Updated 9 months ago
- Training and evaluation code for the paper "Headless Language Models: Learning without Predicting with Contrastive Weight Tying" (https:/…☆23Updated 6 months ago
- ☆38Updated 6 months ago
- Repository containing the SPIN experiments on the DIBT 10k ranked prompts☆22Updated 8 months ago
- This repository contains code for cleaning your training data of benchmark data to help combat data snooping.☆25Updated last year
- Minimum Description Length probing for neural network representations☆16Updated last week
- Utilities for PyTorch distributed☆23Updated last year
- ☆20Updated last year
- ☆18Updated last month
- Collection of autoregressive model implementation☆66Updated last week
- Triton Implementation of HyperAttention Algorithm☆46Updated 11 months ago
- Simple (fast) transformer inference in PyTorch with torch.compile + lit-llama code☆10Updated last year
- Simple and efficient pytorch-native transformer training and inference (batched)☆61Updated 7 months ago
- Code for the note "NF4 Isn't Information Theoretically Optimal (and that's Good)☆18Updated last year
- Code for the examples presented in the talk "Training a Llama in your backyard: fine-tuning very large models on consumer hardware" given…☆14Updated last year
- Embedding Recycling for Language models☆38Updated last year
- Utilities for Training Very Large Models☆56Updated last month
- ☆50Updated last week