tutorial for training a BPE tokenizer on multiple GPUs
☆13May 5, 2025Updated last year
Alternatives and similar repositories for gpu_bpe
Users that are interested in gpu_bpe are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A coding agent harness built specifically for Motif-3☆77Updated this week
- code for EMNLP 2024 paper: Interpreting Arithmetic Mechanism in Large Language Models through Comparative Neuron Analysis☆12Nov 17, 2024Updated last year
- Paper dataset for "Factored Verification: Detecting and Reducing Hallucination in Summaries of Academic Papers"☆13Oct 20, 2024Updated last year
- BasedMUD is a DikuMUD/Merc/ROM/QuickMUD/BaseMUD derived MUD with MTH telnet support☆17Jul 24, 2022Updated 4 years ago
- Self-normalizing neural network implemented in PyTorch.☆12Apr 3, 2019Updated 7 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Transformers components but in Triton☆34May 9, 2025Updated last year
- A library for mechanistic anomaly detection☆22Jan 9, 2025Updated last year
- Code for paper https://arxiv.org/abs/2501.00522☆15Apr 28, 2025Updated last year
- CS341 for Spring 2024☆11Jul 15, 2024Updated 2 years ago
- Benchmark scripts for comparing different tokenizers and sentence segmenters of German☆12Feb 27, 2023Updated 3 years ago
- ☆17Jul 15, 2026Updated 3 months ago
- This repository contains the complete Verilog implementation and supporting tools for a cycle-accurate, dual-issue pipelined multimedia p…☆28May 6, 2025Updated last year
- you can you up, no bb. 自学 python 编程过程中的挑战、笔记及我的践友们。☆20Nov 27, 2019Updated 6 years ago
- A sophisticated, JARVIS-inspired voice assistant with passive listening, natural language processing, and a British accent.☆20Oct 25, 2025Updated 11 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- This repo contains the code for the ACCV 2020 paper Motion Prediction using Temporal Inception Module.☆19Jun 17, 2022Updated 4 years ago
- Unlock the groundbreaking advances of deep learning with this extensively revised new edition of the bestselling original. Learn directly…☆10Feb 27, 2023Updated 3 years ago
- KoCommonGEN v2: A Benchmark for Navigating Korean Commonsense Reasoning Challenges in Large Language Models☆25Aug 24, 2024Updated 2 years ago
- Streamlit app that allows users to search for similar artworks based on an uploaded image or a text description☆13Jun 20, 2024Updated 2 years ago
- An opinionated SvelteKit 2, Svelte 5 and ShadCN starter for building Firebase-authenticated apps.☆23Dec 23, 2025Updated 9 months ago
- A barely barebone NumPy implementation of Hierarchical Temporal Memory.☆11Mar 26, 2023Updated 3 years ago
- The code for "VISTA: Enhancing Long-Duration and High-Resolution Video Understanding by VIdeo SpatioTemporal Augmentation" [CVPR2025]☆20Feb 27, 2025Updated last year
- A lightweight, extensible, fully offline development platform and agent/workflow toolkit for the AI era, with an intuitive TUI, easy depl…☆358Updated this week
- Peer 2 peer distributed/serverless computing solution.Define the problem , the way workers to solve it, code dependencies. Then the most …☆34Sep 5, 2025Updated last year
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Guided meditation assistant, using scheduled messages with LLaMA☆10Nov 28, 2024Updated last year
- This is a plugin for Premiere Pro, which provídes an automated way to update timecodes / start times of media (clips) in your projects.☆11Jul 22, 2026Updated 2 months ago
- Calculate allowed interactions in QED☆10Nov 2, 2022Updated 3 years ago
- Atomistic foundation models for materials simulation and discovery. Research previews from Kairos Materials.☆55Oct 2, 2026Updated 2 weeks ago
- unofficial implementation of MUVERA: Multi-Vector Retrieval via Fixed Dimensional Encodings☆15Feb 18, 2026Updated 8 months ago
- [ACL-IJCNLP 2021] "EarlyBERT: Efficient BERT Training via Early-bird Lottery Tickets" by Xiaohan Chen, Yu Cheng, Shuohang Wang, Zhe Gan, …☆18Dec 30, 2021Updated 4 years ago
- ☆15Jan 16, 2024Updated 2 years ago
- A pure-rust port of tiktoken.☆17Nov 9, 2024Updated last year
- Deep Generative Models course, 2025☆10Jun 5, 2025Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Generating Captions via Perceiver-Resampler Cross-Attention Networks☆18Dec 20, 2022Updated 3 years ago
- End-to-end project training and building AI models / LLMs to detect AI-written text☆48Sep 1, 2026Updated last month
- A plug-and-play tool for visualizing attention-score heatmap in generative LLMs. Easy to customize for your own need.☆53May 16, 2024Updated 2 years ago
- ☆25Apr 8, 2024Updated 2 years ago
- A pronunciation trainer w/ Python.☆16Sep 28, 2025Updated last year
- Simple and ready configuration for neovim(nvim) with LSP. Inited with rust and go support☆11Feb 14, 2022Updated 4 years ago
- ☆40Oct 8, 2026Updated last week