foundation-model-stack / fms-model-optimizerLinks
FMS Model Optimizer is a framework for developing reduced precision neural network models.
☆20Updated this week
Alternatives and similar repositories for fms-model-optimizer
Users that are interested in fms-model-optimizer are comparing it to the libraries listed below
Sorting:
- a pipeline for using api calls to agnostically convert unstructured data into structured training data☆30Updated 9 months ago
- Train a SmolLM-style llm on fineweb-edu in JAX/Flax with an assortment of optimizers.☆17Updated 4 months ago
- Using multiple LLMs for ensemble Forecasting☆16Updated last year
- ☆49Updated last week
- ☆36Updated last year
- ☆52Updated 8 months ago
- entropix style sampling + GUI☆26Updated 8 months ago
- A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.☆33Updated last year
- An open source replication of the stawberry method that leverages Monte Carlo Search with PPO and or DPO☆29Updated last week
- GoldFinch and other hybrid transformer components☆46Updated 11 months ago
- ☆39Updated 2 years ago
- Training hybrid models for dummies.☆25Updated 6 months ago
- Creating Generative AI Apps which work☆17Updated 3 months ago
- Official repository for "BLEUBERI: BLEU is a surprisingly effective reward for instruction following"☆25Updated last month
- ☆48Updated 5 months ago
- Implementation of SelfExtend from the paper "LLM Maybe LongLM: Self-Extend LLM Context Window Without Tuning" from Pytorch and Zeta☆13Updated 8 months ago
- A sample pattern for running CI tests on Modal☆18Updated 3 months ago
- Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit☆63Updated 2 years ago
- ☆23Updated 2 years ago
- Repository containing the SPIN experiments on the DIBT 10k ranked prompts☆24Updated last year
- code for training and using chess embeddings models☆12Updated last year
- 🤗 HuggingFace Inference Toolkit for Google Cloud Vertex AI (similar to SageMaker's Inference Toolkit, but for Vertex AI and unofficial)☆17Updated last year
- Very minimal (and stateless) agent framework☆44Updated 6 months ago
- A repository for research on medium sized language models.☆77Updated last year
- Minimum Description Length probing for neural network representations☆18Updated 5 months ago
- Simple GRPO scripts and configurations.☆59Updated 5 months ago
- Zeus LLM Trainer is a rewrite of Stanford Alpaca aiming to be the trainer for all Large Language Models☆69Updated last year
- ☆22Updated last year
- Entailment self-training☆25Updated 2 years ago
- ☆38Updated last year