Teacher - student distillation using DeepSpeed
β20Oct 7, 2022Updated 4 years ago
Alternatives and similar repositories for distill-bloom-deepspeed
Users that are interested in distill-bloom-deepspeed are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- All-in-one repository for Fine-tuning & Pretraining (Large) Language Modelsβ15Mar 8, 2023Updated 3 years ago
- A starter kit for evaluating benchmarks on the π€ Hubβ18Apr 8, 2026Updated 6 months ago
- Techniques used to run BLOOM at inference in parallelβ36Oct 21, 2022Updated 3 years ago
- β13Apr 17, 2018Updated 8 years ago
- On-the-fly Definition Augmentation of LLMs for Biomedical NERβ14Apr 14, 2025Updated last year
- Managed Database hosting by DigitalOcean β’ AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Train your own GPT2!β14Apr 11, 2023Updated 3 years ago
- β14Sep 7, 2022Updated 4 years ago
- Directed masked autoencodersβ14Mar 25, 2026Updated 6 months ago
- β15Apr 10, 2023Updated 3 years ago
- Making of cuda kernelβ17May 27, 2025Updated last year
- C++17 implementation of einops for libtorch - clear and reliable tensor manipulations with einstein-like notationβ12Oct 16, 2023Updated 3 years ago
- λ무μν€λ€νμμ μ μ λ ν μ€νΈλ₯Ό μ»κΈ° μν NamuwikiExtractorβ20Feb 27, 2022Updated 4 years ago
- Code for reproducing our paper "Low Rank Adapting Models for Sparse Autoencoder Features"β17Mar 31, 2025Updated last year
- Few-Shot Preference Optimization (FSPO) personalizes LLMs by reframing reward modeling as a meta-learning problem, enabling rapid adaptatβ¦β17Feb 27, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer β’ AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Princeton NLP's pre-training library based on fairseq with DeepSpeed kernel integration πβ117Oct 27, 2022Updated 3 years ago
- The open-source repository for PAL: Sample-Efficient Personalized Reward Modeling for Pluralistic Alignment, which provides a general perβ¦β17Aug 28, 2025Updated last year
- β16Jul 10, 2022Updated 4 years ago
- β16Mar 12, 2024Updated 2 years ago
- Code to reproduce results of our experiments using LoReβ18Jun 10, 2026Updated 4 months ago
- β13Feb 2, 2026Updated 8 months ago
- Web application enabling users and software to browse, upload, and share synthetic biology designs. This repository is a redesign of the β¦β16Updated this week
- β14Jun 20, 2022Updated 4 years ago
- Structured argument extraction for Koreanβ23Feb 17, 2022Updated 4 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer β’ AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Spline interpolation with FITPACK for xtensor.β14Apr 10, 2018Updated 8 years ago
- Calculating FLOPs of Pre-trained Models in NLPβ18Mar 29, 2021Updated 5 years ago
- β12Oct 1, 2025Updated last year
- β19Oct 8, 2024Updated 2 years ago
- FL-Tuningβ12Jul 11, 2022Updated 4 years ago
- [DATE 2023] Pipe-BD: Pipelined Parallel Blockwise Distillationβ12Jul 13, 2023Updated 3 years ago
- Qwen2 VL Fine Tuning using Llama Factoryβ19Sep 7, 2024Updated 2 years ago
- A new DRAM substrate that mitigates the excessive energy consumption from both (i) transmitting unused data on the memory channel and (iβ¦β14Aug 23, 2024Updated 2 years ago
- β23Jan 1, 2021Updated 5 years ago
- 1-Click AI Models by DigitalOcean Gradient β’ AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- This is an open-source repository for constructing and researching fusion-style deep learning methods combined with pretrained vision modβ¦β15Dec 31, 2024Updated last year
- Developing tools to automatically analyze datasetsβ75Sep 23, 2026Updated 3 weeks ago
- Intel Gaudi's Megatron DeepSpeed Large Language Models for trainingβ17Dec 19, 2024Updated last year
- Word2vec Model Reader for Node.js Clientβ13May 8, 2019Updated 7 years ago
- Synthetic Data Generation with Execution-Based Verification and Grounding for LLM Training.β24Feb 7, 2025Updated last year
- β11Nov 27, 2022Updated 3 years ago
- πAutomatically Update Agents Papers Daily using Github Actionsβ17Updated this week