joey00072 / TinyLora
Low-Rank Adaptation of Large Language Models clean implementation
β8Updated last year
Alternatives and similar repositories for TinyLora:
Users that are interested in TinyLora are comparing it to the libraries listed below
- ππ€ A collection of templates for Hugging Face Spacesβ35Updated last year
- Code for the examples presented in the talk "Training a Llama in your backyard: fine-tuning very large models on consumer hardware" givenβ¦β14Updated last year
- Jax like function transformation engine but micro, microjaxβ31Updated 6 months ago
- A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.β33Updated last year
- β22Updated last year
- β24Updated last year
- β54Updated last year
- Experimental scripts for researching data adaptive learning rate scheduling.β23Updated last year
- alternative way to calculating self attentionβ18Updated 11 months ago
- β19Updated 9 months ago
- Implementation of SelfExtend from the paper "LLM Maybe LongLM: Self-Extend LLM Context Window Without Tuning" from Pytorch and Zetaβ13Updated 5 months ago
- Using multiple LLMs for ensemble Forecastingβ16Updated last year
- A library for squeakily cleaning and filtering language datasets.β47Updated last year
- Understanding the correlation between different LLM benchmarksβ29Updated last year
- Command-line script for inferencing from models such as LLaMA, in a chat scenario, with LoRA adaptationsβ33Updated last year
- QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning Pβ¦β34Updated last year
- β31Updated last year
- β49Updated last year
- NeurIPS 2023 - Cappy: Outperforming and Boosting Large Multi-Task LMs with a Small Scorerβ43Updated last year
- β27Updated last year
- A sample pattern for running CI tests on Modalβ17Updated 3 weeks ago
- LLM training in simple, raw C/CUDAβ14Updated 5 months ago
- β20Updated last year
- Turn any collection of files into a datasetβ45Updated 2 years ago
- β33Updated 10 months ago
- YouTube Assistantβ12Updated last year
- β26Updated last year
- Local emulator for Hugging Face Inference Endpoints customer handlersβ25Updated last year
- A clone of OpenAI's Tokenizer page for HuggingFace Modelsβ45Updated last year
- Cerule - A Tiny Mighty Vision Modelβ67Updated 8 months ago