srush / drop7
☆18Updated last year
Alternatives and similar repositories for drop7:
Users that are interested in drop7 are comparing it to the libraries listed below
- Minimum Description Length probing for neural network representations☆19Updated 3 months ago
- Engineering the state of RNN language models (Mamba, RWKV, etc.)☆32Updated 11 months ago
- ☆21Updated 4 months ago
- ☆19Updated last month
- See https://github.com/cuda-mode/triton-index/ instead!☆11Updated 11 months ago
- DiCE: The Infinitely Differentiable Monte-Carlo Estimator☆31Updated last year
- ☆11Updated this week
- Source-to-Source Debuggable Derivatives in Pure Python☆15Updated last year
- Code for the paper "Function-Space Learning Rates"☆19Updated 2 weeks ago
- ☆13Updated 2 months ago
- Jax like function transformation engine but micro, microjax☆31Updated 6 months ago
- Automatically take good care of your preemptible TPUs☆36Updated last year
- LayerNorm(SmallInit(Embedding)) in a Transformer to improve convergence☆60Updated 3 years ago
- Implementation of a holodeck, written in Pytorch☆17Updated last year
- My explorations into editing the knowledge and memories of an attention network☆34Updated 2 years ago
- Implementation of Spectral State Space Models☆16Updated last year
- [NeurIPS 2023] Sparse Modular Activation for Efficient Sequence Modeling☆36Updated last year
- ☆60Updated 3 years ago
- QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…☆34Updated last year
- Code associated to papers on superposition (in ML interpretability)☆27Updated 2 years ago
- Train a SmolLM-style llm on fineweb-edu in JAX/Flax with an assortment of optimizers.☆17Updated last month
- Latent Diffusion Language Models☆68Updated last year
- A scalable implementation of diffusion and flow-matching with XGBoost models, applied to calorimeter data.☆18Updated 6 months ago
- Closed-form polynomial approximations to neural networks☆13Updated 3 months ago
- ☆11Updated 11 months ago
- An attempt to merge ESBN with Transformers, to endow Transformers with the ability to emergently bind symbols☆15Updated 3 years ago
- ☆33Updated 7 months ago
- RWKV model implementation☆37Updated last year
- Code for minimum-entropy coupling.☆31Updated 10 months ago
- code for paper "Accessing higher dimensions for unsupervised word translation"☆21Updated last year