☆22Nov 9, 2024Updated 2 years ago
Alternatives and similar repositories for SOAP
Users that are interested in SOAP are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- LayerNorm(SmallInit(Embedding)) in a Transformer to improve convergence☆61Feb 21, 2022Updated 4 years ago
- A library for unit scaling in PyTorch☆137Jul 11, 2025Updated last year
- Code for the paper Don't Pay Attention☆60Sep 25, 2025Updated last year
- sigma-MoE layer☆21Jan 5, 2024Updated 2 years ago
- Reproducible encoder downstream fine-tune eval harness☆11Jul 27, 2026Updated 3 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Latest Weight Averaging (NeurIPS HITY 2022)☆34Jun 20, 2023Updated 3 years ago
- ☆52Jan 28, 2024Updated 2 years ago
- HomebrewNLP in JAX flavour for maintable TPU-Training☆50Jan 20, 2024Updated 2 years ago
- Efficient optimizers☆340Sep 9, 2026Updated 2 months ago
- [EMNLP 2022] Language Model Pre-Training with Sparse Latent Typing☆14Feb 10, 2023Updated 3 years ago
- Mamba SSM architecture for packed data☆10Jul 1, 2024Updated 2 years ago
- Standalone Gemma 4 PyTorch Model using Claude Code☆15Jul 26, 2026Updated 3 months ago
- Code publication to the paper "Normalized Attention Without Probability Cage"☆17Aug 24, 2026Updated 2 months ago
- Very minimal implementation of DEER☆14Jul 6, 2026Updated 4 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆22Jun 4, 2026Updated 5 months ago
- We introduce the LLAMA1 Test Set, a comprehensive open-domain world knowledge QA dataset for evaluating question-answering systems. We pr…☆23Mar 14, 2024Updated 2 years ago
- This repository includes various baseline techniques for label-free model evaluation task for the VDU2023 competition.☆19Mar 8, 2023Updated 3 years ago
- A Scheduler for Batched LLM Inference☆19Oct 5, 2025Updated last year
- For optimization algorithm research and development.☆585Oct 23, 2026Updated 3 weeks ago
- Official implementation of 'A Large-Scale Exploration of mu-Transfer' (CoRR 2024)☆32Jun 5, 2025Updated last year
- A collection of utilities that everyone should have.☆10Jul 16, 2025Updated last year
- Experiments to assess SPADE on different LLM pipelines.☆18Apr 7, 2024Updated 2 years ago
- ☆13Oct 12, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Distributed SDDMM Kernel☆13Jul 8, 2022Updated 4 years ago
- supporting pytorch FSDP for optimizers☆85Dec 8, 2024Updated last year
- Normalize CJK characters in text☆14Sep 30, 2025Updated last year
- triton ops☆15Aug 18, 2026Updated 3 months ago
- ☆14Jan 14, 2026Updated 10 months ago
- Porting Postgres Server to WASM [WIP]☆16Mar 6, 2021Updated 5 years ago
- This repository, deepspeed-grpo-qlora-vllm, provides a complete framework for fine-tuning LLMs using Group Relative Policy Optimization (…☆13Jul 15, 2025Updated last year
- Alignment examples for Interspeech 2024☆29Oct 5, 2026Updated last month
- imgsys backend☆46Jun 23, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Synthetic data derived by templating, few shot prompting, transformations on public domain corpora, and monte carlo tree search.☆35Oct 8, 2025Updated last year
- Zeta implementation of a reusable and plug in and play feedforward from the paper "Exponentially Faster Language Modeling"☆16Nov 11, 2024Updated 2 years ago
- Minimal but scalable implementation of large language models in JAX☆34Nov 28, 2025Updated 11 months ago
- Code for exploring Based models from "Simple linear attention language models balance the recall-throughput tradeoff"☆260Jun 6, 2025Updated last year
- Cloning the Mac's built-in speech synthesizer☆12May 20, 2025Updated last year
- realtime local churn monitor for git branch diffs☆10Mar 6, 2026Updated 8 months ago
- The tiniest in-browser terminal you've ever seen.☆14Mar 26, 2017Updated 9 years ago
Are these results useful?