Sentdex / Lambda-Cloud
Helpers and such for working with Lambda Cloud
☆51Updated last year
Related projects ⓘ
Alternatives and complementary repositories for Lambda-Cloud
- Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.☆81Updated last year
- ☆91Updated last year
- Minimal example scripts of the Hugging Face Trainer, focused on staying under 150 lines☆195Updated 6 months ago
- Highly commented implementations of Transformers in PyTorch☆128Updated last year
- MiniHF is an inference, human preference data collection, and fine-tuning tool for local language models. It is intended to help the user…☆151Updated this week
- ☆48Updated last year
- ☆142Updated last year
- A puzzle to learn about prompting☆121Updated last year
- ☆22Updated last year
- Large scale 4D parallelism pre-training for 🤗 transformers in Mixture of Experts *(still work in progress)*☆80Updated 11 months ago
- Just large language models. Hackable, with as little abstraction as possible. Done for my own purposes, feel free to rip.☆44Updated last year
- Simple Transformer in Jax☆119Updated 4 months ago
- Simple embedding -> text model trained on a small subset of Wikipedia sentences.☆152Updated last year
- Tools to make language models a bit easier to use☆30Updated this week
- Drop in replacement for OpenAI, but with Open models.☆154Updated last year
- git extension for {collaborative, communal, continual} model development☆205Updated this week
- Fast bare-bones BPE for modern tokenizer training☆142Updated last month
- Full finetuning of large language models without large memory requirements☆93Updated 10 months ago
- inference code for mixtral-8x7b-32kseqlen☆98Updated 11 months ago
- Just a bunch of benchmark logs for different LLMs☆114Updated 3 months ago
- The history files when recording human interaction while solving ARC tasks☆95Updated this week
- Fully fine-tune large models like Mistral, Llama-2-13B, or Qwen-14B completely for free☆221Updated 2 weeks ago
- Stream of my favorite papers and links☆36Updated 2 months ago
- An introduction to LLM Sampling☆64Updated last week
- ☆93Updated last year
- Command-line script for inferencing from models such as MPT-7B-Chat☆102Updated last year
- Minimalistic, extremely fast, and hackable researcher's toolbench for GPT models in 307 lines of code. Reaches <3.8 validation loss on wi…☆334Updated 3 months ago
- Exploring finetuning public checkpoints on filter 8K sequences on Pile☆115Updated last year
- A miniture AI training framework for PyTorch☆34Updated last year
- QLoRA with Enhanced Multi GPU Support☆36Updated last year