kamalkraj / minGPT-TF
A minimal TF2 re-implementation of the OpenAI GPT training
☆57Updated 3 years ago
Alternatives and similar repositories for minGPT-TF:
Users that are interested in minGPT-TF are comparing it to the libraries listed below
- A library for squeakily cleaning and filtering language datasets.☆46Updated last year
- TorchServe+Streamlit for easily serving your HuggingFace NER models☆32Updated 2 years ago
- Exploring finetuning public checkpoints on filter 8K sequences on Pile☆115Updated last year
- HomebrewNLP in JAX flavour for maintable TPU-Training☆48Updated last year
- Experiments with generating opensource language model assistants☆97Updated last year
- Using short models to classify long texts☆21Updated last year
- ☆58Updated 2 years ago
- ☆13Updated 3 years ago
- Scripts to convert datasets from various sources to Hugging Face Datasets.☆58Updated 2 years ago
- A package for fine-tuning Transformers with TPUs, written in Tensorflow2.0+☆37Updated 3 years ago
- ☆19Updated 2 years ago
- Various transformers for FSDP research☆36Updated 2 years ago
- [WIP] A 🔥 interface for running code in the cloud☆86Updated last year
- Contains my experiments with the `big_vision` repo to train ViTs on ImageNet-1k.☆22Updated 2 years ago
- QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…☆34Updated last year
- NLP Examples using the 🤗 libraries☆41Updated 4 years ago
- [WIP] Behold, semantic-search, built over sentence-transformers to make it easy for search engineers to evaluate, optimise and deploy mod…☆15Updated last year
- Simple Annotated implementation of GPT-NeoX in PyTorch☆110Updated 2 years ago
- A minimal TPU compatible Jax implementation of NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis.☆13Updated 2 years ago
- This repository hosts the code to port NumPy model weights of BiT-ResNets to TensorFlow SavedModel format.☆14Updated 3 years ago
- Large Scale Distributed Model Training strategy with Colossal AI and Lightning AI☆57Updated last year
- Accelerated NLP pipelines for fast inference on CPU. Built with Transformers and ONNX runtime.☆126Updated 4 years ago
- Training and evaluation code for the paper "Headless Language Models: Learning without Predicting with Contrastive Weight Tying" (https:/…☆25Updated 10 months ago
- This repository contains code for cleaning your training data of benchmark data to help combat data snooping.☆25Updated last year
- Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit☆63Updated last year
- Implementation of Token Shift GPT - An autoregressive model that solely relies on shifting the sequence space for mixing☆48Updated 3 years ago
- A place to store reusable transformer components of my own creation or found on the interwebs☆46Updated last week
- ☆65Updated 2 years ago
- Serialize JAX, Flax, Haiku, or Objax model params with 🤗`safetensors`☆44Updated 8 months ago
- Few Shot Learning using EleutherAI's GPT-Neo an Open-source version of GPT-3☆18Updated 3 years ago