tanmoyio / sahajBERT
☆13Updated 2 years ago
Related projects ⓘ
Alternatives and complementary repositories for sahajBERT
- An attempt at the implementation of GLOM, Geoffrey Hinton's paper for emergent part-whole hierarchies from data☆37Updated 3 years ago
- Memory-efficient transformer. Work in progress.☆19Updated 2 years ago
- This repository hosts the code to port NumPy model weights of BiT-ResNets to TensorFlow SavedModel format.☆14Updated 2 years ago
- ☆38Updated last year
- A minimal TPU compatible Jax implementation of NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis.☆13Updated 2 years ago
- Shows how to do parameter ensembling using differential evolution.☆10Updated 2 years ago
- This project shows how to derive the total number of training tokens from a large text dataset from 🤗 datasets with Apache Beam and Data…☆24Updated 2 years ago
- Code for scaling Transformers☆26Updated 3 years ago
- ☆13Updated 4 years ago
- URL downloader supporting checkpointing and continuous checksumming.☆19Updated 11 months ago
- Re-implementation of 'Grokking: Generalization beyond overfitting on small algorithmic datasets'☆38Updated 2 years ago
- A collection of Models, Datasets, DataModules, Callbacks, Metrics, Losses and Loggers to better integrate pytorch-lightning with transfor…☆47Updated last year
- One stop shop for all things carp☆59Updated 2 years ago
- Code for the paper: Saying No is An Art: Contextualized Fallback Responses for Unanswerable Dialogue Queries☆19Updated 2 years ago
- This repository contains example code to build models on TPUs☆30Updated last year
- ☆38Updated 2 months ago
- A case study of efficient training of large language models using commodity hardware.☆68Updated 2 years ago
- Simple tooling for marking deprecated functions or classes and re-routing to the new successors' instance.☆50Updated last month
- PyTorch implementation of GLOM☆21Updated 2 years ago
- Implements EvoNorms B0 and S0 as proposed in Evolving Normalization-Activation Layers.☆11Updated 4 years ago
- ☆13Updated 5 years ago
- TPU support for the fastai library☆13Updated 3 years ago
- A modular Reinforcement Learning library for research☆11Updated 4 years ago
- An open source implementation of CLIP.☆32Updated 2 years ago
- A Simple but Powerful CNN Trainer For PyTorch☆26Updated 3 years ago
- A GPT, made only of MLPs, in Jax☆55Updated 3 years ago
- Highly specialized crate to parse and use `google/sentencepiece` 's precompiled_charsmap in `tokenizers`☆18Updated 2 years ago
- A python library for highly configurable transformers - easing model architecture search and experimentation.☆49Updated 2 years ago
- A client library for LAION's effort to filter CommonCrawl with CLIP, building a large scale image-text dataset.☆31Updated last year