β54May 20, 2024Updated 2 years ago
Alternatives and similar repositories for seq_icl
Users that are interested in seq_icl are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- β40Feb 26, 2024Updated 2 years ago
- A MAD laboratory to improve AI architecture designs π§ͺβ153Dec 17, 2024Updated last year
- β65Jul 9, 2024Updated 2 years ago
- Parallel Associative Scan for Language Modelsβ18Jan 8, 2024Updated 2 years ago
- PyTorch implementation for PaLM: A Hybrid Parser and Language Model.β10Jan 7, 2020Updated 6 years ago
- 1-Click AI Models by DigitalOcean Gradient β’ AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- β10Jul 27, 2026Updated 3 months ago
- Code for the paper: https://arxiv.org/pdf/2309.06979.pdfβ21Jul 29, 2024Updated 2 years ago
- Understand and test language model architectures on synthetic tasks.β294Mar 22, 2026Updated 7 months ago
- β19Dec 4, 2025Updated 11 months ago
- Official PyTorch Implementation of the Longhorn Deep State Space Modelβ58Dec 4, 2024Updated last year
- β36Apr 12, 2024Updated 2 years ago
- Here we will test various linear attention designs.β62Apr 25, 2024Updated 2 years ago
- Example of using Epochraft to train HuggingFace transformers models with PyTorch FSDPβ11Jan 29, 2024Updated 2 years ago
- Official repository of paper "RNNs Are Not Transformers (Yet): The Key Bottleneck on In-context Retrieval"β27Apr 17, 2024Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform β’ AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- β22Dec 15, 2023Updated 2 years ago
- Accelerated First Order Parallel Associative Scanβ197Jan 7, 2026Updated 10 months ago
- Code for exploring Based models from "Simple linear attention language models balance the recall-throughput tradeoff"β260Jun 6, 2025Updated last year
- Blog postβ17Feb 16, 2024Updated 2 years ago
- β16Dec 9, 2023Updated 2 years ago
- Efficient PScan implementation in PyTorchβ17Jan 2, 2024Updated 2 years ago
- Clustered Compositional Embeddingsβ13Oct 25, 2023Updated 3 years ago
- Code implementing "Efficient Parallelization of a Ubiquitious Sequential Computation" (Heinsen, 2023)β97Dec 5, 2024Updated last year
- Stick-breaking attentionβ64Jul 1, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer β’ AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Reference implementation of "Softmax Attention with Constant Cost per Token" (Heinsen, 2024)β25Jun 6, 2024Updated 2 years ago
- An annotated implementation of the Hyena Hierarchy paperβ34May 28, 2023Updated 3 years ago
- β13Sep 16, 2024Updated 2 years ago
- β63Oct 3, 2024Updated 2 years ago
- [ICML'24 Oral] The official code of "DiJiang: Efficient Large Language Models through Compact Kernelization", a novel DCT-based linear atβ¦β105Jun 14, 2024Updated 2 years ago
- Official implementation of the paper "Linear Transformers with Learnable Kernel Functions are Better In-Context Models"β168Jan 16, 2025Updated last year
- Implementations of various linear RNN layers using pytorch and tritonβ56Aug 4, 2023Updated 3 years ago
- β24Sep 25, 2024Updated 2 years ago
- HGRN2: Gated Linear RNNs with State Expansionβ59Aug 20, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer β’ AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Implementation of Cascaded Head-colliding Attention (ACL'2021)β11Sep 16, 2021Updated 5 years ago
- Xmixers: A collection of SOTA efficient token/channel mixersβ29Sep 4, 2025Updated last year
- LAGr: Label Aligned Graphs for Better Systematic Generalization in Semantic Parsingβ10Jun 1, 2022Updated 4 years ago
- Find context neurons in Pythia models.β13Jun 13, 2023Updated 3 years ago
- β11Apr 23, 2023Updated 3 years ago
- Code for the paper "Stack Attention: Improving the Ability of Transformers to Model Hierarchical Patterns"β19Mar 15, 2024Updated 2 years ago
- Engineering the state of RNN language models (Mamba, RWKV, etc.)β33May 25, 2024Updated 2 years ago
Are these results useful?