Alternatives and similar repositories for mesh-transformer-jax

Users that are interested in mesh-transformer-jax are comparing it to the libraries listed below

• zphang / minimal-gpt-neox-20b
  ☆130Updated 3 years ago
• labmlai / neox
  Simple Annotated implementation of GPT-NeoX in PyTorch
  ☆110Updated 2 years ago
• finetunej / transformers
  🤗Transformers: State-of-the-art Natural Language Processing for Pytorch and TensorFlow 2.0.
  ☆56Updated 3 years ago
• AeroScripts / HiddenEngrams
  Hidden Engrams: Long Term Memory for Transformer Model Inference
  ☆35Updated 4 years ago
• VE-FORBRYDERNE / mtj-softtuner
  Create soft prompts for fairseq 13B dense, GPT-J-6B and GPT-Neo-2.7B for free in a Google Colab TPU instance
  ☆28Updated 2 years ago
• harrisonvanderbyl / rwkvstic
  Framework agnostic python runtime for RWKV models
  ☆147Updated last year
• pszemraj / ai-msgbot
  Training & Implementation of chatbots leveraging GPT-like architecture with the aitextgen package to enable dynamic conversations.
  ☆48Updated 2 years ago
• hitomi-team / sukima
  A ready-to-deploy container for implementing an easy to use REST API to access Language Models.
  ☆65Updated 2 years ago
• Rallio67 / language-model-agents
  Experiments with generating opensource language model assistants
  ☆97Updated 2 years ago
• EleutherAI / magiCARP
  One stop shop for all things carp
  ☆59Updated 2 years ago
• BlinkDL / RWKV-v2-RNN-Pile
  RWKV-v2-RNN trained on the Pile. See https://github.com/BlinkDL/RWKV-LM for details.
  ☆67Updated 2 years ago
• shawwn / tpunicorn
  Babysit your preemptible TPUs
  ☆86Updated 2 years ago
• CarperAI / squeakily
  A library for squeakily cleaning and filtering language datasets.
  ☆47Updated 2 years ago
• EleutherAI / openwebtext2
  ☆90Updated 3 years ago
• arrmansa / Basic-UI-for-GPT-Neo-with-low-vram
  A basic ui for running gpt neo 2.7B on low vram (3 gb Vram minimum)
  ☆36Updated 4 years ago
• finetunej / gpt-neo_finetune_2.7B
  ☆27Updated 2 years ago
• ArEnSc / Production-RWKV
  This project aims to make RWKV Accessible to everyone using a Hugging Face like interface, while keeping it close to the R and D RWKV bra…
  ☆64Updated 2 years ago
• leogao2 / commoncrawl_downloader
  ☆33Updated 2 years ago
• huu4ontocord / MDEL
  Multi-Domain Expert Learning
  ☆67Updated last year
• arrmansa / Basic-UI-for-GPT-J-6B-with-low-vram
  A repository to run gpt-j-6b on low vram machines (4.2 gb minimum vram for 2000 token context, 3.5 gb for 1000 token context). Model load…
  ☆114Updated 3 years ago
• TheoCoombes / crawlingathome
  A client library for LAION's effort to filter CommonCrawl with CLIP, building a large scale image-text dataset.
  ☆32Updated 2 years ago
• donaldafeith / Pytorch_Merge
  Merge LLM that are split in to parts
  ☆26Updated last year
• LAION-AI / interesting-text-datasets
  ☆43Updated 2 years ago
• leogao2 / lm_dataformat
  ☆79Updated last year
• EleutherAI / lm_perplexity
  ☆151Updated 4 years ago
• iwalton3 / mpt-lora-patch
  Patch for MPT-7B which allows using and training a LoRA
  ☆58Updated 2 years ago
• nickthorpie / gpt-j-simple
  ☆9Updated 4 years ago
• LAION-AI / Anh
  Anh - LAION's multilingual assistant datasets and models
  ☆27Updated 2 years ago
• radi-cho / RSTOD
  Auxiliary tasks for task-oriented dialogue systems. Published in ICNLSP'22 and indexed in the ACL Anthology.
  ☆17Updated 2 years ago
• huggingface / olm-datasets
  Pipeline for pulling and processing online language model pretraining data from the web
  ☆178Updated last year