Techniques used to run BLOOM at inference in parallel
☆36Oct 21, 2022Updated 4 years ago
Alternatives and similar repositories for transformers_bloom_parallel
Users that are interested in transformers_bloom_parallel are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆12Oct 10, 2026Updated 3 weeks ago
- Unified Sparse Library Wrapper Based on cuSPARSE☆12May 24, 2022Updated 4 years ago
- source code for paper "Refining BERT Embeddings for Document Hashing via Mutual Information Maximization"☆12Jun 14, 2023Updated 3 years ago
- Fast inference of Instruct tuned LLaMa on your personal devices.☆23Mar 16, 2023Updated 3 years ago
- Teacher - student distillation using DeepSpeed☆20Oct 7, 2022Updated 4 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Code for "A Unified Model for Joint Chinese Word Segmentation and Dependency Parsing"☆39May 24, 2022Updated 4 years ago
- ☆18Sep 9, 2026Updated last month
- Hugging Face and Pyserini interoperability☆20May 18, 2023Updated 3 years ago
- littlefs module for Zephyr, not a mirror of the official littlefs repository☆19Aug 18, 2026Updated 2 months ago
- A scalable automated alignment method for large language models. Resources for "Aligning Large Language Models via Self-Steering Optimiza…☆20Nov 21, 2024Updated last year
- Red Hat Certified optional operator for secondary schedulers☆22Updated this week
- For the paper: "Semi-Supervised Structured Prediction with Neural CRF Autoencoder"☆26Aug 7, 2017Updated 9 years ago
- ENGINE: Energy-Based Inference Networks for Non-Autoregressive Machine Translation☆25Oct 2, 2020Updated 6 years ago
- Implementation of the paper "LFQ: Online Learning of Per-Flow Queuing Policies Using Deep Reinforcement Learning", Contact: Maximilian Ba…☆17Nov 24, 2022Updated 3 years ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- A curated list of tokenizer libraries for blazing-fast NLP processing.☆14Apr 10, 2025Updated last year
- Testing DeepSpeed integration in 🤗 Accelerate☆12Jun 28, 2022Updated 4 years ago
- A Streamlit app to add structured tags to a dataset card☆23Jun 30, 2022Updated 4 years ago
- aka "Bayesian Methods for Hackers": An introduction to Bayesian methods + probabilistic programming with a computation/understanding-firs…☆10Oct 28, 2013Updated 13 years ago
- ☆32Jun 16, 2021Updated 5 years ago
- [Mlsys'22] Understanding gnn computational graph: A coordinated computation, io, and memory perspective☆22Sep 11, 2023Updated 3 years ago
- ☆10Apr 7, 2020Updated 6 years ago
- ☆28Nov 18, 2022Updated 3 years ago
- ☆10Oct 27, 2022Updated 4 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Sequence modeling with Mega.☆300Jan 28, 2023Updated 3 years ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆16Jul 31, 2026Updated 3 months ago
- Implementation of the algorithm described in "Multi-sentence compression: Finding shortest paths in word graphs" by Katja Filippova.☆13Apr 27, 2015Updated 11 years ago
- Easy Scheduler是一个分布式工作流任务调度系统，主要解决数据研发ETL错综复杂的依赖关系，而不能直观监控任务健康状态等问题。Easy Scheduler以DAG流式的方式将Task组装起来，可实时监控任务的运行状态，同时支持重试、从指定节点恢复失败、暂停及Kil…☆10Apr 9, 2019Updated 7 years ago
- Repository for out-of-tree scheduler plugins based on scheduler framework.☆11Jul 4, 2026Updated 3 months ago
- Train your own GPT2!☆14Apr 11, 2023Updated 3 years ago
- [ICML 2023] Exploring the Benefits of Training Expert Language Models over Instruction Tuning☆98Apr 26, 2023Updated 3 years ago
- A tiny BERT for low-resource monolingual models☆32Dec 24, 2025Updated 10 months ago
- ☆15Apr 10, 2023Updated 3 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Ongoing research training transformer language models at scale, including: BERT & GPT-2☆1,449Mar 20, 2024Updated 2 years ago
- QDrant-NLP☆12Aug 30, 2022Updated 4 years ago
- My Implementation of Q-Sparse: All Large Language Models can be Fully Sparsely-Activated☆36Aug 14, 2024Updated 2 years ago
- Autoscaling components for Kubernetes☆22Oct 23, 2026Updated last week
- Notebooks and other course materials for Emory QTM 340 (Fall 2022)☆12Dec 13, 2022Updated 3 years ago
- JAX implementation of "Fine-Tuning Language Models with Just Forward Passes"☆19Jun 10, 2023Updated 3 years ago
- decontamination☆40Oct 17, 2026Updated 2 weeks ago