rinnakk / prefix-tuning-gpt
Example code for prefix-tuning GPT/GPT-NeoX models and for inference with trained prefixes
☆12Updated 2 years ago
Alternatives and similar repositories for prefix-tuning-gpt:
Users that are interested in prefix-tuning-gpt are comparing it to the libraries listed below
- Support Continual pre-training & Instruction Tuning forked from llama-recipes☆32Updated last year
- ☆46Updated 3 years ago
- Checkpointable dataset utilities for foundation model training☆32Updated last year
- ↔️ T5 Machine Translation from English to Korean☆18Updated 2 years ago
- A Benchmark for Robust, Multi-evidence, Multi-answer Question Answering☆16Updated 2 years ago
- Observe the slow deterioration of my mental sanity in the github commit history☆12Updated last year
- ☆11Updated 3 years ago
- QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…☆34Updated last year
- Hugging Face RoBERTa with Flash Attention 2☆22Updated last year
- ☆29Updated 2 years ago
- Codes to pre-train Japanese T5 models☆41Updated 3 years ago
- Implementation of autoregressive language model using improved Transformer and DeepSpeed pipeline parallelism.☆32Updated 3 years ago
- KETOD Knowledge-Enriched Task-Oriented Dialogue☆32Updated 2 years ago
- [COLM 2024] Early Weight Averaging meets High Learning Rates for LLM Pre-training☆16Updated 6 months ago
- ☆14Updated 2 years ago
- Calculating Expected Time for training LLM.☆38Updated 2 years ago
- Project of llm evaluation to Japanese tasks☆81Updated 2 months ago
- ☆44Updated 5 months ago
- COMET-ATOMIC ja☆29Updated last year
- Utility scripts for preprocessing Wikipedia texts for NLP☆77Updated last year
- Do Multilingual Language Models Think Better in English?☆41Updated last year
- DIRECT: Direct and Indirect REsponses in Conversational Text Corpus☆16Updated 3 years ago
- List of papers on Self-Correction of LLMs.☆72Updated 3 months ago
- ☆19Updated last year
- TorchServe+Streamlit for easily serving your HuggingFace NER models☆33Updated 2 years ago
- GPT-jax based on the official huggingface library☆13Updated 3 years ago
- Anh - LAION's multilingual assistant datasets and models☆27Updated 2 years ago
- Japanese LLaMa experiment☆53Updated 4 months ago
- ☆18Updated 2 months ago
- ☆48Updated 4 months ago