RobertRiachi / nanoPALMLinks
☆143Updated 2 years ago
Alternatives and similar repositories for nanoPALM
Users that are interested in nanoPALM are comparing it to the libraries listed below
Sorting:
- ☆93Updated last year
- The GeoV model is a large langauge model designed by Georges Harik and uses Rotary Positional Embeddings with Relative distances (RoPER).…☆121Updated 2 years ago
- Helpers and such for working with Lambda Cloud☆51Updated last year
- ☆155Updated 2 years ago
- Minimalistic, extremely fast, and hackable researcher's toolbench for GPT models in 307 lines of code. Reaches <3.8 validation loss on wi…☆349Updated last year
- Automatic gradient descent☆207Updated 2 years ago
- Simple embedding -> text model trained on a small subset of Wikipedia sentences.☆156Updated last year
- Drive a browser with Cohere☆72Updated 2 years ago
- Functional local implementations of main model parallelism approaches☆94Updated 2 years ago
- git extension for {collaborative, communal, continual} model development☆217Updated 8 months ago
- An interactive exploration of Transformer programming.☆268Updated last year
- Simplex Random Feature attention, in PyTorch☆74Updated last year
- Full finetuning of large language models without large memory requirements☆94Updated last year
- Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.☆82Updated last year
- ☆166Updated 2 years ago
- Command-line script for inferencing from models such as MPT-7B-Chat☆100Updated 2 years ago
- Visualizing the internal board state of a GPT trained on chess PGN strings, and performing interventions on its internal board state and …☆208Updated 8 months ago
- ☆22Updated last year
- a small code base for training large models☆307Updated 3 months ago
- A puzzle to learn about prompting☆132Updated 2 years ago
- Used for adaptive human in the loop evaluation of language and embedding models.☆310Updated 2 years ago
- Various handy scripts to quickly setup new Linux and Windows sandboxes, containers and WSL.☆40Updated 3 months ago
- Just large language models. Hackable, with as little abstraction as possible. Done for my own purposes, feel free to rip.☆44Updated last year
- Drop in replacement for OpenAI, but with Open models.☆152Updated 2 years ago
- A crude RLHF layer on top of nanoGPT with Gumbel-Softmax trick☆291Updated last year
- Understanding large language models☆117Updated 2 years ago
- Inference code for Persimmon-8B☆415Updated last year
- [Added T5 support to TRLX] A repo for distributed training of language models with Reinforcement Learning via Human Feedback (RLHF)☆47Updated 2 years ago
- A tool to analyze and debug neural networks in pytorch. Use a GUI to traverse the computation graph and view the data from many different…☆288Updated 7 months ago
- A really tiny autograd engine☆95Updated 2 months ago