joey00072 / TinyLoraLinks
Low-Rank Adaptation of Large Language Models clean implementation
β8Updated last year
Alternatives and similar repositories for TinyLora
Users that are interested in TinyLora are comparing it to the libraries listed below
Sorting:
- ππ€ A collection of templates for Hugging Face Spacesβ35Updated last year
- β22Updated last year
- β23Updated 2 years ago
- β17Updated last year
- LLM attention pattern visualizerβ10Updated last year
- Code for the examples presented in the talk "Training a Llama in your backyard: fine-tuning very large models on consumer hardware" givenβ¦β14Updated last year
- Training and Inference Notebooks for the RedPajama (OpenLlama) modelsβ18Updated 2 years ago
- Zeus LLM Trainer is a rewrite of Stanford Alpaca aiming to be the trainer for all Large Language Modelsβ69Updated last year
- Experimental scripts for researching data adaptive learning rate scheduling.β23Updated last year
- A library for squeakily cleaning and filtering language datasets.β47Updated 2 years ago
- ML/DL Math and Method notesβ61Updated last year
- β16Updated last year
- The Next Generation Multi-Modality Superintelligenceβ70Updated 10 months ago
- Finetune any model on HF in less than 30 secondsβ57Updated 3 months ago
- QLoRA for Masked Language Modelingβ22Updated last year
- A sample pattern for running CI tests on Modalβ18Updated 3 months ago
- a pipeline for using api calls to agnostically convert unstructured data into structured training dataβ30Updated 9 months ago
- Example for Logging LLM Evaluator Prompt Responsesβ17Updated last year
- β43Updated 2 years ago
- Tools for merging pretrained large language models.β19Updated last year
- β30Updated 8 months ago
- Train a SmolLM-style llm on fineweb-edu in JAX/Flax with an assortment of optimizers.β17Updated 4 months ago
- This is a new metric that can be used to evaluate faithfulness of text generated by LLMs. The work behind this repository can be found heβ¦β31Updated last year
- β38Updated last year
- Command-line script for inferencing from models such as LLaMA, in a chat scenario, with LoRA adaptationsβ33Updated 2 years ago
- β54Updated last year
- β37Updated 2 years ago
- [WIP] A π₯ interface for running code in the cloudβ85Updated 2 years ago
- Turn any collection of files into a datasetβ45Updated 2 years ago
- β56Updated 2 months ago