lucidrains / nim-tokenizer

Related projects ⓘ

Alternatives and complementary repositories for nim-tokenizer

• lucidrains / n-grammer-pytorch
  Implementation of N-Grammer, augmenting Transformers with latent n-grams, in Pytorch
  ☆72Updated last year
• lucidrains / memory-editable-transformer
  My explorations into editing the knowledge and memories of an attention network
  ☆34Updated last year
• antofuller / configaformers
  A python library for highly configurable transformers - easing model architecture search and experimentation.
  ☆49Updated 2 years ago
• lucidrains / token-shift-gpt
  Implementation of Token Shift GPT - An autoregressive model that solely relies on shifting the sequence space for mixing
  ☆47Updated 2 years ago
• sanchit-gandhi / seq2seq-speech
  Repository for fine-tuning Transformers 🤗 based seq2seq speech models in JAX/Flax.
  ☆34Updated last year
• lessw2020 / transformer_central
  Various transformers for FSDP research
  ☆33Updated 2 years ago
• crypdick / timm-lr-scheduler-explorer
  A dashboard for exploring timm learning rate schedulers
  ☆18Updated last year
• lucidrains / panoptic-transformer
  Another attempt at a long-context / efficient transformer by me
  ☆37Updated 2 years ago
• NathanGodey / headless-lm
  Training and evaluation code for the paper "Headless Language Models: Learning without Predicting with Contrastive Weight Tying" (https:/…
  ☆23Updated 6 months ago
• ahennequ / pytorch-custom-mma
  ☆29Updated 2 years ago
• lucidrains / local-attention-flax
  Local Attention - Flax module for Jax
  ☆20Updated 3 years ago
• EleutherAI / rnngineering
  Engineering the state of RNN language models (Mamba, RWKV, etc.)
  ☆32Updated 5 months ago
• lucidrains / kalman-filtering-attention
  Implementation of the Kalman Filtering Attention proposed in "Kalman Filtering Attention for User Behavior Modeling in CTR Prediction"
  ☆57Updated last year
• mariosasko / datasets_sql
  An extension package of 🤗 Datasets that provides support for executing arbitrary SQL queries on HF datasets
  ☆31Updated 9 months ago
• krylm / whisper-event-tuning
  Final training script from HuggingFace Whisper Fine tuning event - to get best results on finetuned model.
  ☆12Updated last year
• tmabraham / Trans-CycleGAN
  A convolution-free, transformer-only version of the CycleGAN framework
  ☆32Updated 2 years ago
• lucidrains / mlp-gpt-jax
  A GPT, made only of MLPs, in Jax
  ☆55Updated 3 years ago
• lucidrains / coco-lm-pytorch
  Implementation of COCO-LM, Correcting and Contrasting Text Sequences for Language Model Pretraining, in Pytorch
  ☆45Updated 3 years ago
• google-research / precondition
  ☆29Updated 2 weeks ago
• gsarti / t5-flax-gcp
  Tutorial to pretrain & fine-tune a 🤗 Flax T5 model on a TPUv3-8 with GCP
  ☆58Updated 2 years ago
• HomebrewNLP / Olmax
  HomebrewNLP in JAX flavour for maintable TPU-Training
  ☆46Updated 9 months ago
• htoyryla / DALLE-pytorch
  Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch
  ☆59Updated 3 years ago
• lucidrains / multistream-transformers
  Implementation of Multistream Transformers in Pytorch
  ☆53Updated 3 years ago
• huggingface / olm-training
  Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.
  ☆92Updated last year
• codekansas / rwkv
  RWKV model implementation
  ☆38Updated last year
• anton-l / wav2vec-toolkit
  A collection of scripts to preprocess ASR datasets and finetune language-specific Wav2Vec2 XLSR models
  ☆31Updated 3 years ago
• lucidrains / rela-transformer
  Implementation of a Transformer using ReLA (Rectified Linear Attention) from https://arxiv.org/abs/2104.07012
  ☆49Updated 2 years ago
• iKernels / transformers-lightning
  A collection of Models, Datasets, DataModules, Callbacks, Metrics, Losses and Loggers to better integrate pytorch-lightning with transfor…
  ☆47Updated last year