SonicCodes / subcloningLinks
implementation of https://arxiv.org/pdf/2312.09299
☆21Updated last year
Alternatives and similar repositories for subcloning
Users that are interested in subcloning are comparing it to the libraries listed below
Sorting:
- An open source replication of the stawberry method that leverages Monte Carlo Search with PPO and or DPO☆29Updated 2 weeks ago
- Latent Large Language Models☆19Updated last year
- [WIP] Transformer to embed Danbooru labelsets☆13Updated last year
- ☆50Updated last year
- ☆63Updated last year
- ☆24Updated last year
- https://x.com/BlinkDL_AI/status/1884768989743882276☆28Updated 7 months ago
- ☆18Updated last year
- Collection of autoregressive model implementation☆85Updated 8 months ago
- GoldFinch and other hybrid transformer components☆45Updated last year
- ☆27Updated 2 years ago
- Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit☆63Updated 2 years ago
- Training hybrid models for dummies.☆29Updated last month
- A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.☆35Updated last year
- Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna☆59Updated 2 months ago
- Lightweight package that tracks and summarizes code changes using LLMs (Large Language Models)☆34Updated 9 months ago
- ☆40Updated last year
- ☆34Updated last year
- BH hackathon☆14Updated last year
- ☆27Updated last year
- Modeling code for a BitNet b1.58 Llama-style model.☆25Updated last year
- This library supports evaluating disparities in generated image quality, diversity, and consistency between geographic regions.☆20Updated last year
- ☆32Updated last year
- A repository for research on medium sized language models.☆77Updated last year
- ☆19Updated 3 weeks ago
- Implementation of the Mamba SSM with hf_integration.☆56Updated last year
- ☆30Updated last year
- ☆27Updated last year
- ☆39Updated last year
- JAX Scalify: end-to-end scaled arithmetics☆17Updated last year