xjdr-alt / simple_transformer

Related projects: ⓘ

• aidanmclaughlin / Aidan-Bench
  Aidan Bench attempts to measure <big_model_smell> in LLMs.
  ☆64Updated this week
• KellerJordan / modded-nanogpt
  GPT-2 (124M) quality in 5B tokens
  ☆227Updated last week
• neoneye / ARC-Interactive-History-Dataset
  The history files when recording human interaction while solving ARC tasks
  ☆91Updated this week
• yacineMTB / just-large-models
  Just large language models. Hackable, with as little abstraction as possible. Done for my own purposes, feel free to rip.
  ☆42Updated last year
• JD-P / minihf
  MiniHF is an inference, human preference data collection, and fine-tuning tool for local language models. It is intended to help the user…
  ☆143Updated this week
• okarthikb / state-space-models
  ☆27Updated 2 months ago
• AblateIt / finetune-study
  Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.
  ☆81Updated last year
• joey00072 / Tinytorch
  A really tiny autograd engine
  ☆85Updated 5 months ago
• EleutherAI / sae
  Sparse autoencoders
  ☆297Updated last week
• NousResearch / Open-Reasoning-Tasks
  A comprehensive repository of reasoning tasks for LLMs (and beyond)
  ☆260Updated last month
• Sentdex / Lambda-Cloud
  Helpers and such for working with Lambda Cloud
  ☆51Updated 10 months ago
• srush / GPTWorld
  A puzzle to learn about prompting
  ☆106Updated last year
• magicproduct / hash-hop
  Long context evaluation for large language models
  ☆148Updated this week
• teknium1 / LLM-Benchmark-Logs
  Just a bunch of benchmark logs for different LLMs
  ☆112Updated last month
• rgreenblatt / arc_draw_more_samples_pub
  Draw more samples
  ☆159Updated 2 months ago
• abacaj / train-with-fsdp
  ☆89Updated 11 months ago
• justinchiu / openlogprobs
  Extract full next-token probabilities via language model APIs
  ☆226Updated 6 months ago
• euclaise / SlimTrainer
  Full finetuning of large language models without large memory requirements
  ☆94Updated 8 months ago
• MatX-inc / seqax
  seqax = sequence modeling + JAX
  ☆129Updated 2 months ago
• notarussianteenager / srf-attention
  Simplex Random Feature attention, in PyTorch
  ☆71Updated 11 months ago
• callummcdougall / sae_visualizer
  ☆24Updated 5 months ago
• teknium1 / transformers-gptq-quant
  ☆48Updated 11 months ago
• joshuacnf / Ctrl-G
  ☆68Updated 2 months ago
• omkaark / simple-federated-learning
  ☆97Updated 5 months ago
• mcleish7 / arithmetic
  Code to reproduce "Transformers Can Do Arithmetic with the Right Embeddings", McLeish et al (2024)
  ☆169Updated 3 months ago
• ai8hyf / OpenResearchAssistant
  An automated tool for discovering insights from research papaer corpora
  ☆131Updated 3 months ago
• vithursant / nanoGPT_mlx
  Port of Andrej Karpathy's nanoGPT to Apple MLX framework.
  ☆96Updated 7 months ago
• Laz4rz / GPT-2
  Following master Karpathy with GPT-2 implementation and training, writing lots of comments cause I have memory of a goldfish
  ☆165Updated last month
• SpellcraftAI / turing
  Turing machines, Rule 110, and A::B reversal using Claude 3 Opus.
  ☆60Updated 4 months ago
• gautierdag / bpeasy
  Fast bare-bones BPE for modern tokenizer training
  ☆138Updated 3 weeks ago