Elluran / concentration_notebooksLinks
☆11Updated last year
Alternatives and similar repositories for concentration_notebooks
Users that are interested in concentration_notebooks are comparing it to the libraries listed below
Sorting:
- Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks☆31Updated last year
- Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna☆59Updated 3 months ago
- look how they massacred my boy☆63Updated last year
- Simple GRPO scripts and configurations.☆59Updated last year
- Repository containing the SPIN experiments on the DIBT 10k ranked prompts☆23Updated last year
- Latent Large Language Models☆19Updated last year
- Set of scripts to finetune LLMs☆38Updated last year
- ☆45Updated 2 years ago
- Cerule - A Tiny Mighty Vision Model☆68Updated 3 months ago
- inference code for mixtral-8x7b-32kseqlen☆105Updated 2 years ago
- Using modal.com to process FineWeb-edu data☆20Updated 10 months ago
- Using multiple LLMs for ensemble Forecasting☆16Updated 2 years ago
- An introduction to LLM Sampling☆79Updated last year
- ☆40Updated last year
- ☆137Updated last year
- Just a bunch of benchmark logs for different LLMs☆119Updated last year
- an implementation of Self-Extend, to expand the context window via grouped attention☆119Updated 2 years ago
- ☆62Updated 2 years ago
- ☆56Updated last year
- ☆15Updated 2 years ago
- [WIP] Transformer to embed Danbooru labelsets☆13Updated last year
- Small and Efficient Mathematical Reasoning LLMs☆73Updated 2 years ago
- ☆15Updated 9 months ago
- ☆68Updated last year
- Modeling code for a BitNet b1.58 Llama-style model.☆25Updated last year
- An easy-to-understand framework for LLM samplers that rewind and revise generated tokens☆150Updated last month
- ☆39Updated 6 months ago
- Official homepage for "Self-Harmonized Chain of Thought" (NAACL 2025)☆92Updated last year
- A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.☆34Updated last year
- alternative way to calculating self attention☆18Updated last year