Alternatives and similar repositories for character-tokenizer:

Users that are interested in character-tokenizer are comparing it to the libraries listed below

• huggingface / bloom-jax-inference
  ☆67Updated 2 years ago
• EleutherAI / nanoGPT-mup
  The simplest, fastest repository for training/finetuning medium-sized GPTs.
  ☆103Updated 4 months ago
• lucidrains / PaLM-jax
  Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling with Pathways - in Jax (Equinox framework)
  ☆187Updated 2 years ago
• srush / do-we-need-attention
  ☆165Updated last year
• HazyResearch / zoology
  Understand and test language model architectures on synthetic tasks.
  ☆185Updated 3 weeks ago
• lucidrains / CoLT5-attention
  Implementation of the conditionally routed attention in the CoLT5 architecture, in Pytorch
  ☆226Updated 6 months ago
• r-three / git-theta
  git extension for {collaborative, communal, continual} model development
  ☆210Updated 4 months ago
• lucidrains / electra-pytorch
  A simple and working implementation of Electra, the fastest way to pretrain language models from scratch, in Pytorch
  ☆225Updated last year
• athms / mad-lab
  A MAD laboratory to improve AI architecture designs 🧪
  ☆108Updated 3 months ago
• warner-benjamin / optimi
  Fast, Modern, Memory Efficient, and Low Precision PyTorch Optimizers
  ☆88Updated 8 months ago
• microsoft / mutransformers
  some common Huggingface transformers in maximal update parametrization (µP)
  ☆80Updated 3 years ago
• Sea-Snell / JAX_llama
  Inference code for LLaMA models in JAX
  ☆116Updated 10 months ago
• imoneoi / multipack_sampler
  Multipack distributed sampler for fast padding-free training of LLMs
  ☆186Updated 7 months ago
• facebookresearch / mega
  Sequence modeling with Mega.
  ☆295Updated 2 years ago
• HomebrewML / HomebrewNLP-torch
  A case study of efficient training of large language models using commodity hardware.
  ☆69Updated 2 years ago
• google-deepmind / neural_networks_chomsky_hierarchy
  Neural Networks and the Chomsky Hierarchy
  ☆205Updated 11 months ago
• inseq-team / inseq
  Interpretability for sequence generation models 🐛 🔍
  ☆410Updated 4 months ago
• callummcdougall / sae_vis
  Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).
  ☆192Updated 3 months ago
• nostalgebraist / transformer-utils
  Utilities for the HuggingFace transformers library
  ☆67Updated 2 years ago
• huggingface / olm-training
  Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.
  ☆93Updated 2 years ago
• google-deepmind / transformer_grammars
  Transformer Grammars: Augmenting Transformer Language Models with Syntactic Inductive Biases at Scale, TACL (2022)
  ☆124Updated 5 months ago
• TomFrederik / unseal
  Mechanistic Interpretability for Transformer Models
  ☆50Updated 2 years ago
• huggingface / olm-datasets
  Pipeline for pulling and processing online language model pretraining data from the web
  ☆177Updated last year
• llm-efficiency-challenge / neurips_llm_efficiency_challenge
  NeurIPS Large Language Model Efficiency Challenge: 1 LLM + 1GPU + 1Day
  ☆255Updated last year
• Sea-Snell / grokking
  unofficial re-implementation of "Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets"
  ☆76Updated 2 years ago
• HomebrewML / Olmax
  HomebrewNLP in JAX flavour for maintable TPU-Training
  ☆49Updated last year
• epfml / DenseFormer
  ☆79Updated 11 months ago
• mlfoundations / task_vectors
  Editing Models with Task Arithmetic
  ☆460Updated last year
• mega002 / lm-debugger
  The official code of LM-Debugger, an interactive tool for inspection and intervention in transformer-based language models.
  ☆177Updated 2 years ago
• justinchiu / openlogprobs
  Extract full next-token probabilities via language model APIs
  ☆237Updated last year