Teacher - student distillation using DeepSpeed
β20Oct 7, 2022Updated 4 years ago
Alternatives and similar repositories for distill-bloom-deepspeed
Users that are interested in distill-bloom-deepspeed are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Implementation of the algorithm described in "Multi-sentence compression: Finding shortest paths in word graphs" by Katja Filippova.β13Apr 27, 2015Updated 11 years ago
- Testing DeepSpeed integration in π€ Accelerateβ12Jun 28, 2022Updated 4 years ago
- A starter kit for evaluating benchmarks on the π€ Hubβ18Apr 8, 2026Updated 6 months ago
- Techniques used to run BLOOM at inference in parallelβ36Oct 21, 2022Updated 4 years ago
- β13Apr 17, 2018Updated 8 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer β’ AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- β15Apr 10, 2023Updated 3 years ago
- β10Jul 20, 2022Updated 4 years ago
- Papers relevant with graph and GPUβ12Jan 1, 2026Updated 10 months ago
- β16Dec 14, 2022Updated 3 years ago
- β14Sep 7, 2022Updated 4 years ago
- Code for reproducing our paper "Low Rank Adapting Models for Sparse Autoencoder Features"β17Mar 31, 2025Updated last year
- Few-Shot Preference Optimization (FSPO) personalizes LLMs by reframing reward modeling as a meta-learning problem, enabling rapid adaptatβ¦β17Feb 27, 2025Updated last year
- An adaptive collective communication library for distributed trainingβ14Apr 29, 2024Updated 2 years ago
- How well can Text-to-Image Generative Models understand Ethical Natural Language Interventions?β12Aug 16, 2023Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer β’ AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Implementing Supervised Fine-Tuning (SFT) and Reinforcement Learning (RL) for Qwen3 and DeepSeek-Math models. Includes experimental code,β¦β10Aug 21, 2025Updated last year
- C++17 implementation of einops for libtorch - clear and reliable tensor manipulations with einstein-like notationβ12Oct 16, 2023Updated 3 years ago
- β14Aug 21, 2025Updated last year
- The open-source repository for PAL: Sample-Efficient Personalized Reward Modeling for Pluralistic Alignment, which provides a general perβ¦β17Aug 28, 2025Updated last year
- Princeton NLP's pre-training library based on fairseq with DeepSpeed kernel integration πβ117Oct 27, 2022Updated 4 years ago
- Scalable AI Inference Server for CPU and GPU with Node.js | Utilizes llama.cpp and parts of llamafile C/C++ core under the hood.β15May 30, 2024Updated 2 years ago
- [PACT'24] GraNNDis. A fast and unified distributed graph neural network (GNN) training framework for both full-batch (full-graph) and minβ¦β10Aug 13, 2024Updated 2 years ago
- Simple nodes, relations, queries.β10May 2, 2017Updated 9 years ago
- N/Aβ19Aug 15, 2022Updated 4 years ago
- Managed hosting for WordPress and PHP on Cloudways β’ AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A Swift package for grammar-guided text generation, powered by xgrammarβ11Feb 8, 2026Updated 8 months ago
- [ICLR 2025] No Preference Left Behind: Group Distributional Preference Optimizationβ16Apr 21, 2025Updated last year
- Data for evaluating GPT-4Vβ11Oct 26, 2023Updated 3 years ago
- Graph partitioning for distributed GNN trainingβ13Mar 26, 2023Updated 3 years ago
- λ무μν€λ€νμμ μ μ λ ν μ€νΈλ₯Ό μ»κΈ° μν NamuwikiExtractorβ20Feb 27, 2022Updated 4 years ago
- β11Apr 29, 2023Updated 3 years ago
- Open Source + Multilingual MLLM + Fine-tuning + Distillation + More efficient models and learning + ?β19Jan 31, 2025Updated last year
- SNTPv4 client designed for embedded devices.β27Jul 10, 2026Updated 3 months ago
- Official source code repository for QueryBlazer: Efficient Query Autocompletion Frameworkβ20Jun 16, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient β’ AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- [DATE 2023] Pipe-BD: Pipelined Parallel Blockwise Distillationβ12Jul 13, 2023Updated 3 years ago
- β16Jul 10, 2022Updated 4 years ago
- β23Jan 1, 2021Updated 5 years ago
- Spline interpolation with FITPACK for xtensor.β14Apr 10, 2018Updated 8 years ago
- takahe is a multi-sentence compression moduleβ52Jun 17, 2021Updated 5 years ago
- Code to reproduce results of our experiments using LoReβ19Jun 10, 2026Updated 4 months ago
- β13May 9, 2025Updated last year