huggingface / transformers_bloom_parallel
Techniques used to run BLOOM at inference in parallel
☆37Updated 2 years ago
Related projects ⓘ
Alternatives and complementary repositories for transformers_bloom_parallel
- Experiments with generating opensource language model assistants☆97Updated last year
- ☆64Updated 2 years ago
- Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.☆92Updated last year
- ☆76Updated 11 months ago
- ☆73Updated last year
- [TMLR'23] Contrastive Search Is What You Need For Neural Text Generation☆118Updated last year
- Pipeline for pulling and processing online language model pretraining data from the web☆174Updated last year
- ☆38Updated 7 months ago
- ☆95Updated last year
- Exploring finetuning public checkpoints on filter 8K sequences on Pile☆115Updated last year
- Helper scripts and notes that were used while porting various nlp models☆44Updated 2 years ago
- BLOOM+1: Adapting BLOOM model to support a new unseen language☆70Updated 8 months ago
- An experimental implementation of the retrieval-enhanced language model☆75Updated last year
- ARCHIVED. Please use https://docs.adapterhub.ml/huggingface_hub.html || 🔌 A central repository collecting pre-trained adapter modules☆68Updated 5 months ago
- Tools for managing datasets for governance and training.☆78Updated 3 weeks ago
- Repository for analysis and experiments in the BigCode project.☆115Updated 8 months ago
- ☆20Updated 2 years ago
- A framework for few-shot evaluation of autoregressive language models.☆102Updated last year
- ☆65Updated last year
- Code repository for the c-BTM paper☆105Updated last year
- Tutorial to pretrain & fine-tune a 🤗 Flax T5 model on a TPUv3-8 with GCP☆58Updated 2 years ago
- Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.☆64Updated last month
- Python tools for processing the stackexchange data dumps into a text dataset for Language Models☆76Updated 11 months ago
- A diff tool for language models☆42Updated 10 months ago
- This project studies the performance and robustness of language models and task-adaptation methods.☆141Updated 6 months ago
- ☆97Updated 2 years ago
- minimal pytorch implementation of bm25 (with sparse tensors)☆90Updated 8 months ago
- Inference script for Meta's LLaMA models using Hugging Face wrapper☆111Updated last year