Techniques used to run BLOOM at inference in parallel
☆37Oct 21, 2022Updated 3 years ago
Alternatives and similar repositories for transformers_bloom_parallel
Users that are interested in transformers_bloom_parallel are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆39Oct 3, 2022Updated 3 years ago
- ☆66Aug 2, 2022Updated 3 years ago
- Unified Sparse Library Wrapper Based on cuSPARSE☆12May 24, 2022Updated 4 years ago
- Fast Inference Solutions for BLOOM☆566Oct 9, 2024Updated last year
- Context Hub Runtime Environment (CHRE)☆11Mar 13, 2026Updated 4 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Teacher - student distillation using DeepSpeed☆20Oct 7, 2022Updated 3 years ago
- ☆17Jun 18, 2026Updated last month
- ☆15Jul 17, 2026Updated last week
- SparseGPT + GPTQ Compression of LLMs like LLaMa, OPT, Pythia☆42Mar 13, 2023Updated 3 years ago
- Testing DeepSpeed integration in 🤗 Accelerate☆11Jun 28, 2022Updated 4 years ago
- Hugging Face and Pyserini interoperability☆20May 18, 2023Updated 3 years ago
- A scalable automated alignment method for large language models. Resources for "Aligning Large Language Models via Self-Steering Optimiza…☆20Nov 21, 2024Updated last year
- Linux /proc data in a consistent, parsed format.☆10Mar 28, 2016Updated 10 years ago
- Shell scripting language☆12Apr 29, 2016Updated 10 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A Streamlit app to add structured tags to a dataset card☆23Jun 30, 2022Updated 4 years ago
- ☆32Jun 16, 2021Updated 5 years ago
- Sequence modeling with Mega.☆303Jan 28, 2023Updated 3 years ago
- Implementation of the algorithm described in "Multi-sentence compression: Finding shortest paths in word graphs" by Katja Filippova.☆12Apr 27, 2015Updated 11 years ago
- HAL for Infineon ICs☆19Updated this week
- Dynet-based Biaffine Parser☆33Jan 9, 2019Updated 7 years ago
- decontamination☆35Mar 4, 2026Updated 4 months ago
- Falcon: A library to use Cosmos conveniently☆13Aug 10, 2019Updated 6 years ago
- Ongoing research training transformer language models at scale, including: BERT & GPT-2☆1,448Mar 20, 2024Updated 2 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- [ICML 2023] Exploring the Benefits of Training Expert Language Models over Instruction Tuning☆99Apr 26, 2023Updated 3 years ago
- SNTPv4 client designed for embedded devices.☆27Jul 10, 2026Updated 2 weeks ago
- ☆15Apr 10, 2023Updated 3 years ago
- ☆15Oct 24, 2023Updated 2 years ago
- Deep Learning Benchmark Results (RTX 2080 TI vs. RTX 2070)☆16Oct 27, 2018Updated 7 years ago
- My Implementation of Q-Sparse: All Large Language Models can be Fully Sparsely-Activated☆37Aug 14, 2024Updated last year
- mbedtls module for Zephyr, this is not a mirror of the official mbedtls repository.☆27Updated this week
- Implementation for ACL 2024 paper "Meta-Task Prompting Elicits Embeddings from Large Language Models"☆12Jul 25, 2024Updated 2 years ago
- Benchmark of common hash functions☆10Sep 15, 2019Updated 6 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- 나무위키덤프에서 정제된 텍스트를 얻기 위한 NamuwikiExtractor☆19Feb 27, 2022Updated 4 years ago
- ☆11Nov 27, 2022Updated 3 years ago
- ☆10Feb 2, 2023Updated 3 years ago
- JAX implementation of "Fine-Tuning Language Models with Just Forward Passes"☆19Jun 10, 2023Updated 3 years ago
- An annotated implementation of the Hyena Hierarchy paper☆34May 28, 2023Updated 3 years ago
- Distributed Multi-GPU GNN Framework☆36Jun 26, 2020Updated 6 years ago
- ☆11Mar 24, 2026Updated 4 months ago