RobertRiachi / nanoPALM
☆142Updated last year
Related projects ⓘ
Alternatives and complementary repositories for nanoPALM
- Minimalistic, extremely fast, and hackable researcher's toolbench for GPT models in 307 lines of code. Reaches <3.8 validation loss on wi…☆334Updated 3 months ago
- ☆153Updated last year
- Helpers and such for working with Lambda Cloud☆51Updated last year
- Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.☆81Updated last year
- ☆91Updated last year
- An interactive exploration of Transformer programming.☆247Updated last year
- The GeoV model is a large langauge model designed by Georges Harik and uses Rotary Positional Embeddings with Relative distances (RoPER).…☆122Updated last year
- Simple Transformer in Jax☆119Updated 5 months ago
- Simple embedding -> text model trained on a small subset of Wikipedia sentences.☆152Updated last year
- Full finetuning of large language models without large memory requirements☆93Updated 10 months ago
- ☆165Updated last year
- The history files when recording human interaction while solving ARC tasks☆95Updated this week
- ☆22Updated last year
- Command-line script for inferencing from models such as MPT-7B-Chat☆102Updated last year
- Automatic gradient descent☆206Updated last year
- A puzzle to learn about prompting☆122Updated last year
- Drive a browser with Cohere☆72Updated last year
- git extension for {collaborative, communal, continual} model development☆205Updated last week
- Train very large language models in Jax.☆195Updated last year
- Large scale 4D parallelism pre-training for 🤗 transformers in Mixture of Experts *(still work in progress)*☆80Updated 11 months ago
- ☆197Updated 4 months ago
- Used for adaptive human in the loop evaluation of language and embedding models.☆304Updated last year
- MiniHF is an inference, human preference data collection, and fine-tuning tool for local language models. It is intended to help the user…☆152Updated this week
- Functional local implementations of main model parallelism approaches☆95Updated last year
- Reimplementation of the task generation part from the Alpaca paper☆119Updated last year
- Simplex Random Feature attention, in PyTorch☆71Updated last year
- Tiny inference-only implementation of LLaMA☆91Updated 7 months ago
- a small code base for training large models☆268Updated 3 weeks ago
- A really tiny autograd engine☆87Updated 7 months ago
- ☆57Updated 11 months ago