YuchenJin / llm.c
LLM training in simple, raw C/CUDA
☆12Updated last month
Related projects ⓘ
Alternatives and complementary repositories for llm.c
- A place to store reusable transformer components of my own creation or found on the interwebs☆43Updated this week
- Learning to Retrieve by Trying - Source code for Grounding by Trying: LLMs with Reinforcement Learning-Enhanced Retrieval☆24Updated last week
- ☆38Updated this week
- DPO, but faster 🚀☆20Updated 2 weeks ago
- ☆36Updated 3 months ago
- QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…☆34Updated last year
- PyTorch implementation for MRL☆18Updated 8 months ago
- ☆44Updated 2 months ago
- ☆22Updated last year
- ☆39Updated 9 months ago
- Efficient Dictionary Learning with Switch Sparse Autoencoders (SAEs)☆13Updated last month
- ☆26Updated 4 months ago
- Collection of autoregressive model implementation☆66Updated last week
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆46Updated 2 months ago
- ☆61Updated 2 months ago
- ☆44Updated 2 months ago
- A repository for research on medium sized language models.☆74Updated 5 months ago
- Jax like function transformation engine but micro, microjax☆26Updated 2 weeks ago
- Clean RL implementation using MLX☆26Updated 8 months ago
- BPE modification that implements removing of the intermediate tokens during tokenizer training.☆22Updated 2 months ago
- gzip Predicts Data-dependent Scaling Laws☆32Updated 5 months ago
- ReBase: Training Task Experts through Retrieval Based Distillation