A sumary of MoE experimental setups across a number of different papers.
☆16Feb 16, 2023Updated 3 years ago
Alternatives and similar repositories for moe-paper-models
Users that are interested in moe-paper-models are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆17Jun 24, 2024Updated last year
- Two Stones Hit One Bird: Bilevel Positional Encoding for Better Length Extrapolation, ICML 2024☆24Jun 26, 2024Updated last year
- [NeurIPS 2022] Your Transformer May Not be as Powerful as You Expect (official implementation)☆34Aug 6, 2023Updated 2 years ago
- Where I create DAS Nodes that utilize a Secure Kademlia DHT Discv5 overlay☆16May 5, 2023Updated 3 years ago
- ☆15Nov 5, 2025Updated 7 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Repository for opt-out requests.☆10Mar 25, 2024Updated 2 years ago
- JAX implementation of LLaMA, aiming to train LLaMA on Google Cloud TPU☆14Jul 22, 2023Updated 2 years ago
- Official implementation of Panacea: A foundation model for clinical trial design, recruitment, search, and summarization.☆21Dec 24, 2024Updated last year
- ☆14Feb 9, 2021Updated 5 years ago
- ☆12Sep 2, 2021Updated 4 years ago
- Simple (fast) transformer inference in PyTorch with torch.compile + lit-llama code☆10Aug 29, 2023Updated 2 years ago
- Write events for TensorBoard☆13Apr 27, 2026Updated last month
- [WIP] Compound lending proxy☆14Jul 14, 2020Updated 5 years ago
- Feature Decay Algorithms☆11Mar 5, 2014Updated 12 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Use LoRA technique to improve training Large Language Model☆13Jul 25, 2023Updated 2 years ago
- DiT (training + flow matching) in Jax☆12Jan 5, 2025Updated last year
- Code for PII detection and redaction in code datasets☆15Jan 24, 2023Updated 3 years ago
- Benchmarking tool for assessing LLM models' performance across different hardwares☆17Dec 8, 2023Updated 2 years ago
- [ICML 2023] SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models☆11Dec 13, 2023Updated 2 years ago
- docker for UTH-BERT: https://ai-health.m.u-tokyo.ac.jp/uth-bert☆14Mar 24, 2023Updated 3 years ago
- Coursera Corpus Mining and Multistage Fine-Tuning for Improving Lectures Translation☆15Aug 27, 2024Updated last year
- Code for the NeurIPS 2020 paper "Improved analysis of clippind algorithms for non-convex optimization", including various clipping algori…☆10Feb 17, 2021Updated 5 years ago
- Prabhupadavani: A Code-mixed Speech Translation Data for 25 languages☆13Oct 12, 2022Updated 3 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- ☆18Jun 19, 2023Updated 2 years ago
- 京大工学部電気電子工学科の卒論をマークダウンで書くための一式☆12Jan 13, 2021Updated 5 years ago
- FLOPS counter for all your GPU benchmarking needs☆13Aug 8, 2024Updated last year
- 詳説ディープラーニング(生成モデル編)