BFloat16 Fused Adam Operator for PyTorch
☆20Nov 16, 2024Updated last year
Alternatives and similar repositories for bf16_fused_adam
Users that are interested in bf16_fused_adam are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆20Apr 1, 2024Updated 2 years ago
- One RL Platform is all you need -- Event-driven fully distributed reinforcement learning framework☆21Oct 25, 2023Updated 2 years ago
- Code for paper Evolving Connectivity for Spiking Neural Networks☆22Oct 23, 2023Updated 2 years ago
- Hacks for PyTorch☆19Apr 18, 2023Updated 3 years ago
- ☆14Dec 22, 2024Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Official implementation for DenseMixer: Improving MoE Post-Training with Precise Router Gradient☆68Aug 3, 2025Updated last year
- Mixture of A Million Experts☆56Jul 30, 2024Updated 2 years ago
- Experimental GPU language with meta-programming☆32Sep 6, 2024Updated last year
- ☆12Apr 26, 2024Updated 2 years ago
- ☆21Jun 12, 2025Updated last year
- An attempt at a SVD inpainting pipeline☆50Dec 24, 2023Updated 2 years ago
- ☆22Sep 3, 2024Updated last year
- Mixed precision training from scratch with Tensors and CUDA☆30May 14, 2024Updated 2 years ago
- Transformers components but in Triton☆34May 9, 2025Updated last year
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Visual Question Answering System☆11Nov 13, 2019Updated 6 years ago
- Multipack distributed sampler for fast padding-free training of LLMs☆207Aug 10, 2024Updated 2 years ago
- Read and write tensorboard data using Rust☆23Feb 4, 2024Updated 2 years ago
- Self-contained Python lib with zero-dependencies that give you a unified device properties for gpu, cpu, and npu. No more calling separat…☆16Aug 5, 2026Updated last week
- Using FlexAttention to compute attention with different masking patterns☆47Sep 22, 2024Updated last year
- A repository to unravel the language of GPUs, making their kernel conversations easy to understand☆213Jun 1, 2025Updated last year
- ☆16Jan 3, 2023Updated 3 years ago
- Official repository for "BLEUBERI: BLEU is a surprisingly effective reward for instruction following"☆32Jun 5, 2025Updated last year
- ☆18Aug 24, 2024Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Convert any image into a Region Adjacency Graph (RAG)☆12Apr 27, 2020Updated 6 years ago
- Model Predictive Controller for Autonomous Driving implemented using ROS and C++☆105Jun 14, 2020Updated 6 years ago
- Fork of HyenaDNA, a long-range genomic foundation model built with Hyena☆10Aug 14, 2023Updated 3 years ago
- Cheatsheet for slurm command lines☆12Mar 6, 2026Updated 5 months ago
- Official implementation of Language Models as Compilers: Simulating the Execution Of Pseudocode Improves Algorithmic Reasoning in Languag…☆23Apr 8, 2024Updated 2 years ago
- An llm wrapper for OpenAI☆13Dec 14, 2024Updated last year
- Ultra-low-latency, high-throughput multiprocess transport over SHM and mmap. LMAX-Disruptor-style cross-process ring substrate.☆18Aug 6, 2026Updated last week
- Text To Speech Demo in ReactJS Application using Azure Avatar AI Service.☆35Mar 19, 2024Updated 2 years ago
- The official repo for "VisualWebInstruct: Scaling up Multimodal Instruction Data through Web Search" [EMNLP25]☆39Feb 1, 2026Updated 6 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆10Dec 19, 2024Updated last year
- Inference code for LLaMA models☆42Mar 13, 2023Updated 3 years ago
- Source code for "SimCKP: Simple Contrastive Learning of Keyphrase Representations", Findings of EMNLP 2023☆12Jun 20, 2025Updated last year
- Instant Neural Graphics Primitives from scratch, zero dependencies. Learning by doing.☆10Aug 18, 2023Updated 2 years ago
- An experiment to see if chatgpt can improve the output of the stanford alpaca dataset☆12Mar 29, 2023Updated 3 years ago
- Zeus LLM Trainer is a rewrite of Stanford Alpaca aiming to be the trainer for all Large Language Models☆69Aug 27, 2023Updated 2 years ago
- Create synthetic datasets from scratch using AI-powered generation. Define topics, customize prompts, and generate high-quality reasoning…☆32Jul 23, 2026Updated 3 weeks ago