Alternatives and similar repositories for nanoPALM:

Users that are interested in nanoPALM are comparing it to the libraries listed below

• tysam-code / hlb-gpt
  Minimalistic, extremely fast, and hackable researcher's toolbench for GPT models in 307 lines of code. Reaches <3.8 validation loss on wi…
  ☆345Updated 9 months ago
• srush / raspy
  An interactive exploration of Transformer programming.
  ☆263Updated last year
• abacaj / train-with-fsdp
  ☆92Updated last year
• Narsil / fast_gpt2
  ☆155Updated 2 years ago
• Sentdex / Lambda-Cloud
  Helpers and such for working with Lambda Cloud
  ☆51Updated last year
• AblateIt / finetune-study
  Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.
  ☆82Updated last year
• r2d4 / parserllm
  Use context-free grammars with an LLM
  ☆168Updated last year
• r-three / git-theta
  git extension for {collaborative, communal, continual} model development
  ☆211Updated 5 months ago
• jxbz / agd
  Automatic gradient descent
  ☆207Updated last year
• MF-FOOM / wikivec2text
  Simple embedding -> text model trained on a small subset of Wikipedia sentences.
  ☆153Updated last year
• ayaka14732 / llama-2-jax
  JAX implementation of the Llama 2 model
  ☆218Updated last year
• warner-benjamin / commented-transformers
  Highly commented implementations of Transformers in PyTorch
  ☆136Updated last year
• euclaise / SlimTrainer
  Full finetuning of large language models without large memory requirements
  ☆94Updated last year
• danielgross / ggml-k8s
  Run GGML models with Kubernetes.
  ☆173Updated last year
• xjdr-alt / simple_transformer
  Simple Transformer in Jax
  ☆136Updated 10 months ago
• FlorianDietz / comgra
  A tool to analyze and debug neural networks in pytorch. Use a GUI to traverse the computation graph and view the data from many different…
  ☆287Updated 5 months ago
• CarperAI / cheese
  Used for adaptive human in the loop evaluation of language and embedding models.
  ☆309Updated 2 years ago
• srush / GPTWorld
  A puzzle to learn about prompting
  ☆127Updated last year
• Birch-san / mpt-play
  Command-line script for inferencing from models such as MPT-7B-Chat
  ☆101Updated last year
• Cerebras / gigaGPT
  a small code base for training large models
  ☆294Updated last week
• google-deepmind / nanodo
  ☆217Updated 9 months ago
• geov-ai / geov
  The GeoV model is a large langauge model designed by Georges Harik and uses Rotary Positional Embeddings with Relative distances (RoPER).…
  ☆122Updated 2 years ago
• HazyResearch / H3
  Language Modeling with the H3 State Space Model
  ☆520Updated last year
• notarussianteenager / srf-attention
  Simplex Random Feature attention, in PyTorch
  ☆74Updated last year
• joey00072 / Tinytorch
  A really tiny autograd engine
  ☆92Updated last year
• adamkarvonen / chess_llm_interpretability
  Visualizing the internal board state of a GPT trained on chess PGN strings, and performing interventions on its internal board state and …
  ☆204Updated 5 months ago
• JD-P / minihf
  MiniHF is an inference, human preference data collection, and fine-tuning tool for local language models. It is intended to help the user…
  ☆171Updated this week
• sumo43 / loopvlm
  run paligemma in real time
  ☆131Updated 11 months ago
• aidangomez / weblm
  Drive a browser with Cohere
  ☆72Updated 2 years ago
• muellerzr / minimal-trainer-zoo
  Minimal example scripts of the Hugging Face Trainer, focused on staying under 150 lines
  ☆198Updated last year