kyegomez / OpenStrawberry
An open source replication of the stawberry method that leverages Monte Carlo Search with PPO and or DPO
☆27Updated this week
Alternatives and similar repositories for OpenStrawberry:
Users that are interested in OpenStrawberry are comparing it to the libraries listed below
- Train a SmolLM-style llm on fineweb-edu in JAX/Flax with an assortment of optimizers.☆17Updated last week
- implementation of https://arxiv.org/pdf/2312.09299☆20Updated 7 months ago
- BUD-E (Buddy) is an open-source voice assistant framework that facilitates seamless interaction with AI models and APIs, enabling the cre…☆17Updated 4 months ago
- Training hybrid models for dummies.☆20Updated last month
- Nexusflow function call, tool use, and agent benchmarks.☆19Updated 2 months ago
- GoldFinch and other hybrid transformer components☆43Updated 6 months ago
- [WIP] Transformer to embed Danbooru labelsets☆13Updated 10 months ago
- ☆48Updated 3 months ago
- Latent Large Language Models☆17Updated 5 months ago
- A repository for research on medium sized language models.☆76Updated 8 months ago
- ☆49Updated 11 months ago
- Alpha-Zero Connect Four NN trained via self play☆13Updated 4 months ago
- ☆14Updated 4 months ago
- A list of language models with permissive licenses such as MIT or Apache 2.0☆24Updated 3 months ago
- BH hackathon☆14Updated 10 months ago
- A single repo with all scripts and utils to train / fine-tune the Mamba model with or without FIM☆50Updated 10 months ago
- alternative way to calculating self attention☆18Updated 8 months ago
- My Implementation of Q-Sparse: All Large Language Models can be Fully Sparsely-Activated☆31Updated 6 months ago
- Implementation of Spectral State Space Models☆16Updated 11 months ago
- Modified Beam Search with periodical restart☆12Updated 5 months ago
- entropix style sampling + GUI☆25Updated 3 months ago
- The simplest, fastest repository for training/finetuning medium-sized xLSTMs.☆39Updated 8 months ago