NousResearch / StripedHyenaTrainer
☆60Updated last year
Alternatives and similar repositories for StripedHyenaTrainer:
Users that are interested in StripedHyenaTrainer are comparing it to the libraries listed below
- ☆22Updated last year
- Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna☆39Updated last month
- ☆27Updated 8 months ago
- ☆49Updated last year
- ☆79Updated 11 months ago
- Simple GRPO scripts and configurations.☆59Updated last month
- an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)☆91Updated 3 weeks ago
- Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.☆82Updated last year
- NanoGPT (124M) quality in 2.67B tokens☆28Updated last month
- A library for squeakily cleaning and filtering language datasets.☆46Updated last year
- Simplex Random Feature attention, in PyTorch☆74Updated last year
- a pipeline for using api calls to agnostically convert unstructured data into structured training data☆30Updated 6 months ago
- Collection of autoregressive model implementation☆83Updated last month
- ☆48Updated last year
- Train your own SOTA deductive reasoning model☆81Updated 3 weeks ago
- gzip Predicts Data-dependent Scaling Laws☆34Updated 10 months ago
- ☆48Updated 4 months ago
- A MAD laboratory to improve AI architecture designs 🧪☆108Updated 3 months ago
- Code repository for the c-BTM paper☆106Updated last year
- Experiments for efforts to train a new and improved t5☆77Updated 11 months ago
- ☆53Updated last year
- ☆32Updated 9 months ago
- Using multiple LLMs for ensemble Forecasting☆16Updated last year
- Public Inflection Benchmarks☆68Updated last year
- ☆38Updated 8 months ago
- ☆92Updated last year
- Explorations into the proposal from the paper "Grokfast, Accelerated Grokking by Amplifying Slow Gradients"☆98Updated 3 months ago
- A repository for research on medium sized language models.☆76Updated 10 months ago
- Repository containing the SPIN experiments on the DIBT 10k ranked prompts☆24Updated last year
- ☆76Updated 8 months ago