RobertRiachi / nanoPALMLinks
☆144Updated 2 years ago
Alternatives and similar repositories for nanoPALM
Users that are interested in nanoPALM are comparing it to the libraries listed below
Sorting:
- The GeoV model is a large langauge model designed by Georges Harik and uses Rotary Positional Embeddings with Relative distances (RoPER).…☆121Updated 2 years ago
- Helpers and such for working with Lambda Cloud☆52Updated 2 years ago
- Minimalistic, extremely fast, and hackable researcher's toolbench for GPT models in 307 lines of code. Reaches <3.8 validation loss on wi…☆355Updated last year
- Automatic gradient descent☆217Updated 2 years ago
- ☆94Updated 2 years ago
- Simplex Random Feature attention, in PyTorch☆75Updated 2 years ago
- Simple embedding -> text model trained on a small subset of Wikipedia sentences.☆158Updated 2 years ago
- ☆157Updated 2 years ago
- An interactive exploration of Transformer programming.☆271Updated 2 years ago
- git extension for {collaborative, communal, continual} model development☆217Updated last year
- Functional local implementations of main model parallelism approaches☆95Updated 2 years ago
- Drop in replacement for OpenAI, but with Open models.☆154Updated 2 years ago
- Various handy scripts to quickly setup new Linux and Windows sandboxes, containers and WSL.☆40Updated last week
- Drive a browser with Cohere☆72Updated 2 years ago
- ☆22Updated 2 years ago
- Full finetuning of large language models without large memory requirements☆94Updated 4 months ago
- Command-line script for inferencing from models such as MPT-7B-Chat☆100Updated 2 years ago
- Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.☆83Updated 2 years ago
- ☆166Updated 3 years ago
- Used for adaptive human in the loop evaluation of language and embedding models.☆308Updated 2 years ago
- MiniHF is an inference, human preference data collection, and fine-tuning tool for local language models. It is intended to help the user…☆183Updated 2 months ago
- Smol but mighty language model☆65Updated 2 years ago
- Inference code for Persimmon-8B☆412Updated 2 years ago
- Language Modeling with the H3 State Space Model☆522Updated 2 years ago
- Highly commented implementations of Transformers in PyTorch☆138Updated 2 years ago
- a small code base for training large models☆320Updated 9 months ago
- A collection of LLM services you can self host via docker or modal labs to support your applications development☆198Updated last year
- A crude RLHF layer on top of nanoGPT with Gumbel-Softmax trick☆293Updated 2 years ago
- ☆45Updated 2 years ago
- A puzzle to learn about prompting☆135Updated 2 years ago