druidowm / OccamLLM
☆13Updated 6 months ago
Alternatives and similar repositories for OccamLLM:
Users that are interested in OccamLLM are comparing it to the libraries listed below
- LLM training in simple, raw C/CUDA☆14Updated 4 months ago
- prime-rl is a codebase for decentralized RL training at scale☆79Updated this week
- Synthetic data generation and benchmark implementation for "Episodic Memories Generation and Evaluation Benchmark for Large Language Mode…☆41Updated 2 weeks ago
- ☆38Updated 9 months ago
- ☆73Updated this week
- ☆20Updated 5 months ago
- Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna☆39Updated 2 months ago
- Sparse autoencoders for Contra text embedding models☆25Updated last year
- ☆43Updated last year
- ☆60Updated 2 weeks ago
- [ACL 2024] Do Large Language Models Latently Perform Multi-Hop Reasoning?☆63Updated last month
- Entropy Based Sampling and Parallel CoT Decoding☆17Updated 6 months ago
- NanoGPT (124M) quality in 2.67B tokens☆28Updated last week
- Synthetic data derived by templating, few shot prompting, transformations on public domain corpora, and monte carlo tree search.☆32Updated 2 months ago
- ☆80Updated 3 months ago
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆55Updated 7 months ago
- Simplex Random Feature attention, in PyTorch☆74Updated last year
- ☆48Updated last year
- Testing paligemma2 finetuning on reasoning dataset☆18Updated 4 months ago
- Simple GRPO scripts and configurations.☆58Updated 2 months ago
- ☆27Updated 9 months ago
- look how they massacred my boy☆63Updated 6 months ago
- Train your own SOTA deductive reasoning model☆88Updated last month
- Code and data for the paper "Why think step by step? Reasoning emerges from the locality of experience"☆60Updated 3 weeks ago
- train entropix like a champ!☆20Updated 6 months ago
- ☆22Updated last year
- Train a SmolLM-style llm on fineweb-edu in JAX/Flax with an assortment of optimizers.☆17Updated last month
- ☆11Updated 9 months ago
- ☆48Updated 5 months ago
- EvaByte: Efficient Byte-level Language Models at Scale☆88Updated last week