Exploring finetuning public checkpoints on filter 8K sequences on Pile
☆115Mar 22, 2023Updated 2 years ago
Alternatives and similar repositories for Long-context-transformers
Users that are interested in Long-context-transformers are comparing it to the libraries listed below
Sorting:
- Fine-Tuning Pre-trained Transformers into Decaying Fast Weights☆19Oct 9, 2022Updated 3 years ago
- A method for evaluating the high-level coherence of machine-generated texts. Identifies high-level coherence issues in transformer-based …☆11Mar 18, 2023Updated 2 years ago
- Recursive Bayesian Networks☆11May 11, 2025Updated 9 months ago
- Automatically take good care of your preemptible TPUs☆37May 15, 2023Updated 2 years ago
- ☆13Feb 7, 2023Updated 3 years ago
- Anh - LAION's multilingual assistant datasets and models☆27Apr 5, 2023Updated 2 years ago
- Generate visual podcasts about novels using open source models☆26Feb 15, 2023Updated 3 years ago
- ☆44Mar 29, 2023Updated 2 years ago
- ☆160Sep 15, 2023Updated 2 years ago
- ☆29Oct 3, 2022Updated 3 years ago
- ☆18Mar 10, 2023Updated 2 years ago
- Source-to-Source Debuggable Derivatives in Pure Python☆15Jan 23, 2024Updated 2 years ago
- BigKnow2022: Bringing Language Models Up to Speed☆16Mar 27, 2023Updated 2 years ago
- ☆14Nov 20, 2022Updated 3 years ago
- Chrome extension for OA sites like arxiv, openreivew: 1. PDF back to abstract page, 2. Rename PDF page with paper title.☆18Oct 12, 2023Updated 2 years ago
- Crawl & visualize ICLR papers and reviews.☆18Nov 5, 2022Updated 3 years ago
- Implementation of the paper 'Sentence Bottleneck Autoencoders from Transformer Language Models'☆17Mar 14, 2022Updated 3 years ago
- Official code and model checkpoints for our EMNLP 2022 paper "RankGen - Improving Text Generation with Large Ranking Models" (https://arx…☆137Aug 2, 2023Updated 2 years ago
- ☆18May 28, 2021Updated 4 years ago
- ☆72May 22, 2023Updated 2 years ago
- code for "Natural Language to Code Translation with Execution"☆41Nov 2, 2022Updated 3 years ago
- A CLIP conditioned Decision Transformer.☆22Jul 14, 2021Updated 4 years ago
- ☆44Dec 28, 2022Updated 3 years ago
- [ICLR 2024 Spotlight] Social Reward: Evaluating and Enhancing Generative AI through Million-User Feedback from an Online Creative Communi…☆11Mar 29, 2024Updated last year
- ☆10Aug 30, 2025Updated 6 months ago
- Used for adaptive human in the loop evaluation of language and embedding models.☆308Mar 1, 2023Updated 3 years ago
- Long-context pretrained encoder-decoder models☆96Oct 28, 2022Updated 3 years ago
- Embroid: Unsupervised Prediction Smoothing Can Improve Few-Shot Classification☆11Aug 12, 2023Updated 2 years ago
- Fine-tune copilot based on your codebase☆12Mar 26, 2024Updated last year
- Advanced Formal Language Theory (263-5352-00L; Frühjahr 2023)☆10Feb 21, 2023Updated 3 years ago
- source code for NAACL2022 main conference "Dynamic Programming in Rank Space: Scaling Structured Inference with Low-Rank HMMs and PCFGs"☆10Sep 26, 2022Updated 3 years ago
- ☆12Jan 3, 2022Updated 4 years ago
- ☆11Oct 11, 2023Updated 2 years ago
- Implementation of SelfExtend from the paper "LLM Maybe LongLM: Self-Extend LLM Context Window Without Tuning" from Pytorch and Zeta☆13Nov 11, 2024Updated last year
- ☆23Jul 23, 2021Updated 4 years ago
- Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit☆63Jun 21, 2023Updated 2 years ago
- Differentiable Perturb-and-Parse operator☆25Mar 7, 2019Updated 6 years ago
- Neural Algorithmic Reasoning Tutorial☆12Dec 21, 2022Updated 3 years ago
- Easily compute model embeddings and save the embeddings.☆10Dec 10, 2022Updated 3 years ago