Teacher - student distillation using DeepSpeed
☆20Oct 7, 2022Updated 3 years ago
Alternatives and similar repositories for distill-bloom-deepspeed
Users that are interested in distill-bloom-deepspeed are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Implementation of the algorithm described in "Multi-sentence compression: Finding shortest paths in word graphs" by Katja Filippova.☆13Apr 27, 2015Updated 11 years ago
- All-in-one repository for Fine-tuning & Pretraining (Large) Language Models☆15Mar 8, 2023Updated 3 years ago
- Techniques used to run BLOOM at inference in parallel☆36Oct 21, 2022Updated 3 years ago
- On-the-fly Definition Augmentation of LLMs for Biomedical NER☆14Apr 14, 2025Updated last year
- Train your own GPT2!☆14Apr 11, 2023Updated 3 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Directed masked autoencoders☆14Mar 25, 2026Updated 6 months ago
- ☆16Dec 14, 2022Updated 3 years ago
- Code for reproducing our paper "Low Rank Adapting Models for Sparse Autoencoder Features"☆17Mar 31, 2025Updated last year
- Making of cuda kernel☆17May 27, 2025Updated last year
- C++17 implementation of einops for libtorch - clear and reliable tensor manipulations with einstein-like notation☆12Oct 16, 2023Updated 2 years ago
- 나무위키덤프에서 정제된 텍스트를 얻기 위한 NamuwikiExtractor☆20Feb 27, 2022Updated 4 years ago
- This is an official implementation for "A Unified Pruning Framework for Vision Transformers".☆20Aug 3, 2022Updated 4 years ago
- ☆17Oct 30, 2022Updated 3 years ago
- Data for evaluating GPT-4V☆11Oct 26, 2023Updated 2 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- How well can Text-to-Image Generative Models understand Ethical Natural Language Interventions?☆12Aug 16, 2023Updated 3 years ago
- [PACT'24] GraNNDis. A fast and unified distributed graph neural network (GNN) training framework for both full-batch (full-graph) and min…☆10Aug 13, 2024Updated 2 years ago
- The open-source repository for PAL: Sample-Efficient Personalized Reward Modeling for Pluralistic Alignment, which provides a general per…☆17Aug 28, 2025Updated last year
- ☆16Mar 12, 2024Updated 2 years ago
- Code to reproduce results of our experiments using LoRe☆18Jun 10, 2026Updated 3 months ago
- Open Source + Multilingual MLLM + Fine-tuning + Distillation + More efficient models and learning + ?☆19Jan 31, 2025Updated last year
- Web application enabling users and software to browse, upload, and share synthetic biology designs. This repository is a redesign of the …☆16Sep 18, 2026Updated last week
- ☆11Apr 29, 2023Updated 3 years ago
- Graph partitioning for distributed GNN training☆13Mar 26, 2023Updated 3 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Structured argument extraction for Korean☆23Feb 17, 2022Updated 4 years ago
- ☆14May 25, 2023Updated 3 years ago
- Calculating FLOPs of Pre-trained Models in NLP☆18Mar 29, 2021Updated 5 years ago
- Qwen2 VL Fine Tuning using Llama Factory☆19Sep 7, 2024Updated 2 years ago
- ☆23Jan 1, 2021Updated 5 years ago
- This is an open-source repository for constructing and researching fusion-style deep learning methods combined with pretrained vision mod…☆15Dec 31, 2024Updated last year
- Code for paper: Unraveling the Shift of Visual Information Flow in MLLMs: From Phased Interaction to Efficient Inference☆14Jun 7, 2025Updated last year
- Intel Gaudi's Megatron DeepSpeed Large Language Models for training☆17Dec 19, 2024Updated last year
- KeyTerms centralized terminology management tool☆13Feb 7, 2019Updated 7 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- simple, fast, and slick non-disturbing buffer list☆24Jan 13, 2023Updated 3 years ago
- ☆15Jan 19, 2018Updated 8 years ago
- [WACV2023] This is the official PyTorch impelementation of our paper "[Rethinking Rotation in Self-Supervised Contrastive Learning: Adapt…☆12Feb 24, 2023Updated 3 years ago
- [IPDPS 2024] Adaptive neighbor sampling for temporal GNN☆16Feb 17, 2025Updated last year
- ☆10Jul 19, 2023Updated 3 years ago
- ☆14Nov 14, 2023Updated 2 years ago
- 🎓Automatically Update Agents Papers Daily using Github Actions☆17Updated this week