jaymody / picoBERT
Like picoGPT but for BERT.
☆50Updated 2 years ago
Alternatives and similar repositories for picoBERT:
Users that are interested in picoBERT are comparing it to the libraries listed below
- This repository contains code for cleaning your training data of benchmark data to help combat data snooping.☆25Updated last year
- Repository containing awesome resources regarding Hugging Face tooling.☆46Updated last year
- a pipeline for using api calls to agnostically convert unstructured data into structured training data☆30Updated 6 months ago
- Supervised instruction finetuning for LLM with HF trainer and Deepspeed☆34Updated last year
- manage histories of LLM applied applications☆88Updated last year
- ☆37Updated last year
- A library for squeakily cleaning and filtering language datasets.☆46Updated last year
- Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.☆82Updated last year
- Finetune Falcon, LLaMA, MPT, and RedPajama on consumer hardware using PEFT LoRA☆102Updated 8 months ago
- an implementation of Self-Extend, to expand the context window via grouped attention☆118Updated last year
- Experiments with generating opensource language model assistants☆97Updated last year
- ☆48Updated last year
- Exploring finetuning public checkpoints on filter 8K sequences on Pile☆115Updated 2 years ago
- Gzip and nearest neighbors for text classification☆55Updated last year
- ☆60Updated last year
- QLoRA with Enhanced Multi GPU Support☆36Updated last year
- ☆22Updated last year