Alternatives and similar repositories for nanoPALM

Users that are interested in nanoPALM are comparing it to the libraries listed below

• geov-ai / geov
  The GeoV model is a large langauge model designed by Georges Harik and uses Rotary Positional Embeddings with Relative distances (RoPER).…
  ☆121Updated 2 years ago
• abacaj / train-with-fsdp
  ☆94Updated 2 years ago
• Narsil / fast_gpt2
  ☆157Updated 2 years ago
• srush / raspy
  An interactive exploration of Transformer programming.
  ☆271Updated 2 years ago
• Sentdex / Lambda-Cloud
  Helpers and such for working with Lambda Cloud
  ☆51Updated 2 years ago
• MF-FOOM / wikivec2text
  Simple embedding -> text model trained on a small subset of Wikipedia sentences.
  ☆158Updated 2 years ago
• tysam-code / hlb-gpt
  Minimalistic, extremely fast, and hackable researcher's toolbench for GPT models in 307 lines of code. Reaches <3.8 validation loss on wi…
  ☆355Updated last year
• notarussianteenager / srf-attention
  Simplex Random Feature attention, in PyTorch
  ☆75Updated 2 years ago
• jxbz / agd
  Automatic gradient descent
  ☆216Updated 2 years ago
• hundredblocks / large-model-parallelism
  Functional local implementations of main model parallelism approaches
  ☆95Updated 2 years ago
• r-three / git-theta
  git extension for {collaborative, communal, continual} model development
  ☆217Updated last year
• aidangomez / weblm
  Drive a browser with Cohere
  ☆72Updated 2 years ago
• keerthanpg / TalkToCode
  ☆166Updated 2 years ago
• CarperAI / treasure_trove
  ☆22Updated 2 years ago
• closedai-project / closedai
  Drop in replacement for OpenAI, but with Open models.
  ☆152Updated 2 years ago
• euclaise / SlimTrainer
  Full finetuning of large language models without large memory requirements
  ☆94Updated 3 months ago
• Birch-san / mpt-play
  Command-line script for inferencing from models such as MPT-7B-Chat
  ☆100Updated 2 years ago
• abacaj / transformers
  Understanding large language models
  ☆120Updated 2 years ago
• sytelus / pcprep
  Various handy scripts to quickly setup new Linux and Windows sandboxes, containers and WSL.
  ☆40Updated last week
• sumo43 / loopvlm
  run paligemma in real time
  ☆133Updated last year
• Cerebras / gigaGPT
  a small code base for training large models
  ☆318Updated 8 months ago
• adamkarvonen / chess_llm_interpretability
  Visualizing the internal board state of a GPT trained on chess PGN strings, and performing interventions on its internal board state and …
  ☆218Updated last year
• NolanoOrg / smol-gpt
  Smol but mighty language model
  ☆64Updated 2 years ago
• persimmon-ai-labs / adept-inference
  Inference code for Persimmon-8B
  ☆412Updated 2 years ago
• FlorianDietz / comgra
  A tool to analyze and debug neural networks in pytorch. Use a GUI to traverse the computation graph and view the data from many different…
  ☆298Updated last year
• HazyResearch / H3
  Language Modeling with the H3 State Space Model
  ☆521Updated 2 years ago
• KhoomeiK / complexity-scaling
  gzip Predicts Data-dependent Scaling Laws
  ☆34Updated last year
• CarperAI / cheese
  Used for adaptive human in the loop evaluation of language and embedding models.
  ☆308Updated 2 years ago
• SumanthRH / tokenization
  A comprehensive deep dive into the world of tokens
  ☆227Updated last year
• teknium1 / transformers-gptq-quant
  ☆45Updated 2 years ago