Alternatives and similar repositories for nanoPALM:

Users that are interested in nanoPALM are comparing it to the libraries listed below

• srush / raspy
  An interactive exploration of Transformer programming.
  ☆259Updated last year
• Sentdex / Lambda-Cloud
  Helpers and such for working with Lambda Cloud
  ☆52Updated last year
• MF-FOOM / wikivec2text
  Simple embedding -> text model trained on a small subset of Wikipedia sentences.
  ☆153Updated last year
• r-three / git-theta
  git extension for {collaborative, communal, continual} model development
  ☆208Updated 3 months ago
• euclaise / SlimTrainer
  Full finetuning of large language models without large memory requirements
  ☆93Updated last year
• geov-ai / geov
  The GeoV model is a large langauge model designed by Georges Harik and uses Rotary Positional Embeddings with Relative distances (RoPER).…
  ☆121Updated last year
• JD-P / minihf
  MiniHF is an inference, human preference data collection, and fine-tuning tool for local language models. It is intended to help the user…
  ☆165Updated last week
• hundredblocks / large-model-parallelism
  Functional local implementations of main model parallelism approaches
  ☆95Updated 2 years ago
• adamkarvonen / chess_llm_interpretability
  Visualizing the internal board state of a GPT trained on chess PGN strings, and performing interventions on its internal board state and …
  ☆201Updated 3 months ago
• xjdr-alt / simple_transformer
  Simple Transformer in Jax
  ☆136Updated 8 months ago
• AblateIt / finetune-study
  Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.
  ☆82Updated last year
• r2d4 / parserllm
  Use context-free grammars with an LLM
  ☆168Updated 11 months ago
• srush / GPTWorld
  A puzzle to learn about prompting
  ☆124Updated last year
• Narsil / fast_gpt2
  ☆153Updated 2 years ago
• tysam-code / hlb-gpt
  Minimalistic, extremely fast, and hackable researcher's toolbench for GPT models in 307 lines of code. Reaches <3.8 validation loss on wi…
  ☆343Updated 7 months ago
• abacaj / train-with-fsdp
  ☆92Updated last year
• keerthanpg / SwePT
  AI sends pull requests for features you request in natural language
  ☆113Updated last year
• irregular-rhomboid / EAI-Math-Reading-Group
  Resources from the EleutherAI Math Reading Group
  ☆53Updated last week
• google-deepmind / nanodo
  ☆212Updated 7 months ago
• CarperAI / cheese
  Used for adaptive human in the loop evaluation of language and embedding models.
  ☆306Updated 2 years ago
• cloneofsimo / min-fsdp
  ☆75Updated 8 months ago
• aidangomez / weblm
  Drive a browser with Cohere
  ☆72Updated last year
• jxbz / agd
  Automatic gradient descent
  ☆207Updated last year
• CarperAI / treasure_trove
  ☆22Updated last year
• keerthanpg / TalkToCode
  ☆165Updated 2 years ago
• HazyResearch / manifest
  Prompt programming with FMs.
  ☆440Updated 7 months ago
• 567-labs / fastllm
  A collection of LLM services you can self host via docker or modal labs to support your applications development
  ☆186Updated 10 months ago
• NousResearch / StripedHyenaTrainer
  ☆60Updated last year
• IBM / ModuleFormer
  ModuleFormer is a MoE-based architecture that includes two different types of experts: stick-breaking attention heads and feedforward exp…
  ☆215Updated 11 months ago
• Sea-Snell / JAXSeq
  Train very large language models in Jax.
  ☆203Updated last year