gmontamat / poor-mans-transformers

Related projects ⓘ

Alternatives and complementary repositories for poor-mans-transformers

• AkiRusProd / numpy-transformer
  A numpy implementation of the Transformer model in "Attention is All You Need"
  ☆50Updated 4 months ago
• hkproj / pytorch-llama
  LLaMA 2 implemented from scratch in PyTorch
  ☆258Updated last year
• TheSeriousProgrammer / SimpleBitNet
  Simple Adaptation of BitNet
  ☆29Updated 7 months ago
• Entropy-xcy / bitnet158
  ☆68Updated 8 months ago
• lucidrains / CoLT5-attention
  Implementation of the conditionally routed attention in the CoLT5 architecture, in Pytorch
  ☆226Updated 2 months ago
• rasbt / dora-from-scratch
  LoRA and DoRA from Scratch Implementations
  ☆188Updated 8 months ago
• huggingface / transformers_bloom_parallel
  Techniques used to run BLOOM at inference in parallel
  ☆37Updated 2 years ago
• huggingface / large_language_model_training_playbook
  An open collection of implementation tips, tricks and resources for training large language models
  ☆460Updated last year
• ayaka14732 / llama-2-jax
  JAX implementation of the Llama 2 model
  ☆210Updated 9 months ago
• ayaka14732 / tpu-starter
  Everything you want to know about Google Cloud TPU
  ☆496Updated 4 months ago
• uygarkurt / BERT-PyTorch
  ☆14Updated last year
• lucidrains / block-recurrent-transformer-pytorch
  Implementation of Block Recurrent Transformer - Pytorch
  ☆213Updated 3 months ago
• gautierdag / bpeasy
  Fast bare-bones BPE for modern tokenizer training
  ☆142Updated last month
• jaymody / picoBERT
  Like picoGPT but for BERT.
  ☆50Updated last year
• kyleliang919 / Long-context-transformers
  Exploring finetuning public checkpoints on filter 8K sequences on Pile
  ☆115Updated last year
• lucidrains / mlm-pytorch
  An implementation of masked language modeling for Pytorch, made as concise and simple as possible
  ☆177Updated last year
• tcapelle / llm_recipes
  A set of scripts and notebooks on LLM finetunning and dataset creation
  ☆93Updated last month
• Locutusque / TPU-Alignment
  Fully fine-tune large models like Mistral, Llama-2-13B, or Qwen-14B completely for free
  ☆222Updated 3 weeks ago
• johnma2006 / candle
  Deep learning library implemented from scratch in numpy. Mixtral, Mamba, LLaMA, GPT, ResNet, and other experiments.
  ☆48Updated 7 months ago
• Rallio67 / language-model-agents
  Experiments with generating opensource language model assistants
  ☆97Updated last year
• pbelcak / fastfeedforward
  A repository for log-time feedforward networks
  ☆216Updated 7 months ago
• sleekmike / Finetune_GPT-J_6B_8-bit
  Fine-tuning GPT-J-6B on colab or equivalent PC GPU with your custom datasets: 8-bit weights with low-rank adaptors (LoRA)
  ☆74Updated 2 years ago
• explosion / curated-transformers
  🤖 A PyTorch library of curated Transformer models and their composable components
  ☆867Updated 7 months ago
• lucasdelimanogueira / PyNorch
  Recreating PyTorch from scratch (C/C++, CUDA, NCCL and Python, with multi-GPU support and automatic differentiation!)
  ☆114Updated 5 months ago
• coaxsoft / pytorch_bert
  Tutorial for how to build BERT from scratch
  ☆83Updated 6 months ago
• ajhalthor / Transformer-Neural-Network
  Code Transformer neural network components piece by piece
  ☆300Updated last year
• patrickvonplaten / notebooks
  Some notebooks for NLP
  ☆188Updated last year
• neuralmagic / nm-vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆253Updated last month
• abetlen / ggml-python
  Python bindings for ggml
  ☆132Updated 2 months ago
• huggingface / bloom-jax-inference
  ☆64Updated 2 years ago