SonicCodes / subcloning
implementation of https://arxiv.org/pdf/2312.09299
☆19Updated 4 months ago
Related projects ⓘ
Alternatives and complementary repositories for subcloning
- Training hybrid models for dummies.☆15Updated 3 weeks ago
- Latent Large Language Models☆16Updated 3 months ago
- This library supports evaluating disparities in generated image quality, diversity, and consistency between geographic regions.☆20Updated 5 months ago
- BH hackathon☆14Updated 7 months ago
- An open source replication of the stawberry method that leverages Monte Carlo Search with PPO and or DPO☆22Updated this week
- ☆13Updated 8 months ago
- ☆24Updated 11 months ago
- ☆27Updated last year
- GoldFinch and other hybrid transformer components☆40Updated 4 months ago
- ☆30Updated 11 months ago
- ☆11Updated last month
- My personal implementation of the model from "Qwen-VL: A Frontier Large Vision-Language Model with Versatile Abilities", they haven't rel…☆11Updated 9 months ago
- Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit☆63Updated last year
- Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and min…☆23Updated last week
- ☆18Updated last month
- [WIP] Transformer to embed Danbooru labelsets☆13Updated 7 months ago
- ☆15Updated 11 months ago
- ☆28Updated 11 months ago
- ☆22Updated last month
- ☆15Updated 8 months ago
- Implementation of SelfExtend from the paper "LLM Maybe LongLM: Self-Extend LLM Context Window Without Tuning" from Pytorch and Zeta☆13Updated last week
- Repository with which to explore k-diffusion and diffusers, and within which changes to said packages may be tested.☆55Updated 9 months ago
- A list of language models with permissive licenses such as MIT or Apache 2.0☆24Updated 2 weeks ago
- ☆22Updated last year
- ☆26Updated 8 months ago
- ☆49Updated 8 months ago
- A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.☆33Updated 8 months ago
- A clone of OpenAI's Tokenizer page for HuggingFace Models☆44Updated last year