Converting Mixtral-8x7B to Mixtral-[1~7]x7B
☆22Mar 4, 2024Updated 2 years ago
Alternatives and similar repositories for mixtral_spliter
Users that are interested in mixtral_spliter are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆12Jan 21, 2024Updated 2 years ago
- Official repository for ICML 2024 paper "MoRe Fine-Tuning with 10x Fewer Parameters"☆22Oct 14, 2025Updated 6 months ago
- Minimal implementation of TokenFormer for inference and learning☆13Nov 6, 2024Updated last year
- Code for experiments on transformers using Markovian data.☆22Nov 22, 2024Updated last year
- Official implementation of the paper "Pretraining Language Models to Ponder in Continuous Space"☆26Jul 21, 2025Updated 8 months ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- ☆20Apr 16, 2025Updated 11 months ago
- Exploring Evolution-aware & free protein language models as protein function predictors☆63Sep 28, 2024Updated last year
- ☆16Mar 12, 2024Updated 2 years ago
- ☆11Apr 3, 2023Updated 3 years ago
- [ICML 2025] Parameter-Efficient Fine-Tuning of State Space Models☆25Jun 9, 2025Updated 10 months ago
- ☆19Mar 25, 2025Updated last year
- Self Reproduction Code of Paper "Reducing Transformer Key-Value Cache Size with Cross-Layer Attention (MIT CSAIL)☆17May 24, 2024Updated last year
- Safe Unlearning: A Surprisingly Effective and Generalizable Solution to Defend Against Jailbreak Attacks☆32Jul 9, 2024Updated last year
- Official Pytorch implementation of "Omni-AVSR: Towards Unified Multimodal Speech Recognition with Large Language Models" [IEEE ICASSP 202…☆34Mar 10, 2026Updated last month
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆75Mar 7, 2024Updated 2 years ago
- [ICML 2024] Junk DNA Hypothesis: A Task-Centric Angle of LLM Pre-trained Weights through Sparsity; Lu Yin*, Ajay Jaiswal*, Shiwei Liu, So…☆16Apr 21, 2025Updated 11 months ago
- OPUS-Rota4: A Gradient-Based Protein Side-Chain Modeling Framework Assisted by Deep Learning-Based Predictors☆11Apr 14, 2022Updated 4 years ago
- Open Source + Multilingual MLLM + Fine-tuning + Distillation + More efficient models and learning + ?☆18Jan 31, 2025Updated last year
- Code release to accompany paper "Geometry-Aware Gradient Algorithms for Neural Architecture Search."☆25Oct 7, 2020Updated 5 years ago
- ☆14Jun 20, 2022Updated 3 years ago
- Codes for Evolving Plastic ANNs☆14Dec 18, 2022Updated 3 years ago
- ☆21Updated this week
- A Proof-of-Concept Private Server for an Anime Fleet Game☆20Mar 29, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Source code for IRL-INR (ICML 2023)☆20May 27, 2023Updated 2 years ago
- FL-Tuning☆12Jul 11, 2022Updated 3 years ago
- ☆21Dec 14, 2024Updated last year
- ☆12May 6, 2022Updated 3 years ago
- Towards a Mechanistic Interpretation of Multi-Step Reasoning Capabilities of Language Models☆15Nov 4, 2023Updated 2 years ago
- natural annotated text-category pairs for text classification☆10Sep 10, 2021Updated 4 years ago
- [NeurIPS 2023] Github repository for "Composing Parameter-Efficient Modules with Arithmetic Operations"☆61Nov 26, 2023Updated 2 years ago
- Code for paper: Unraveling the Shift of Visual Information Flow in MLLMs: From Phased Interaction to Efficient Inference☆13Jun 7, 2025Updated 10 months ago
- A simple program scheduler for your code on different devices.☆12Mar 8, 2026Updated last month
- Wordpress hosting with auto-scaling - Free Trial • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A multilayer perceptron (for simple image classification), accelerated with CUDA☆17Oct 21, 2019Updated 6 years ago
- Model to predict kinase-ligand pKi values.☆12Jul 6, 2023Updated 2 years ago
- ☆11Sep 25, 2020Updated 5 years ago
- 预训练模型知识量度量竞赛 Baseline F1 0.35 BERTForMaskedLM☆13Sep 2, 2021Updated 4 years ago
- Code for the paper "The Journey, Not the Destination: How Data Guides Diffusion Models"☆25Dec 12, 2023Updated 2 years ago
- ☆16Apr 11, 2022Updated 4 years ago
- [EMNLP 2022] Code for our paper “ZeroGen: Efficient Zero-shot Learning via Dataset Generation”.☆16Feb 18, 2022Updated 4 years ago