Implementation of the dilated self attention as described in "LongNet: Scaling Transformers to 1,000,000,000 Tokens"
☆13Jul 23, 2023Updated 3 years ago
Alternatives and similar repositories for dilated-self-attention
Users that are interested in dilated-self-attention are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆10Oct 2, 2024Updated 2 years ago
- Fast BM25 search engine with category theory abstractions☆12Feb 22, 2026Updated 8 months ago
- Knowledgeable Embedding: Injecting dynamically updatable entity knowledge into embeddings to enhance RAG☆15Aug 31, 2025Updated last year
- 🤝 Trade any tensors over the network☆31Sep 27, 2023Updated 3 years ago
- ☆17Jan 5, 2023Updated 3 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- YASEM - Yet Another Splade|Sparse Embedder - A simple and efficient library for SPLADE embeddings☆13May 22, 2025Updated last year
- A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.☆32Sep 19, 2025Updated last year
- Semantically Search Emojis From the Command Line!☆13Nov 26, 2023Updated 2 years ago
- [NAACL 2018] Robust Sequence Labeling with Adversarial Training☆10Sep 30, 2019Updated 7 years ago
- Training SLMs for reasoning-intensive re-ranking☆11Jul 18, 2025Updated last year
- recreation of the classic drug trading game "dope wars"☆11May 9, 2019Updated 7 years ago
- ☆14Oct 31, 2023Updated 3 years ago
- Alternate LLM Architecture Experiment with O(n) time complexity☆11Jul 18, 2026Updated 3 months ago
- Emacs Lisp color manipulation utilities.☆13Jul 16, 2024Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- A Python module for retrieving script types of writing systems including alphabets, abjads, abugidas, syllabaries, logographs, featurals …☆15Aug 21, 2026Updated 2 months ago
- Investigation into whether Transformers and self-supervised learning could be used to trade currency markets☆10Jun 21, 2023Updated 3 years ago
- Bleeding edge low level Rust binding for GGML☆18Jun 26, 2024Updated 2 years ago
- A collection of pretraining, finetuning and evaluation scripts for mLateOn and mDenseOn, as well as their English counterparts.☆15Aug 5, 2026Updated 3 months ago
- Life before `main()`☆19Feb 2, 2021Updated 5 years ago
- [CoLM 24] Official Repository of MambaByte: Token-free Selective State Space Model☆26Oct 12, 2024Updated 2 years ago
- A proposed standard `NOCK` for a Parquet format that supports efficient distributed serialization of multiple kinds of graph technologies☆21Apr 27, 2026Updated 6 months ago
- Lazily and automatically execute emacs config code☆10Jan 15, 2017Updated 9 years ago
- Hugging Face on Microsoft Azure (documentation, examples and more)☆17Oct 14, 2026Updated 3 weeks ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- ☆20Oct 2, 2024Updated 2 years ago
- ☆22Mar 23, 2026Updated 7 months ago
- A Basic Redis leaderboard demo app written in Python☆10Jun 27, 2023Updated 3 years ago
- [NeurIPS 2024] 🕸 GlotCC Dataset and Pipline☆21Apr 6, 2025Updated last year
- Official Repository for Efficient Linear-Time Attention Transformers.☆17Jun 2, 2024Updated 2 years ago
- Rhythm analysis toolkit in Python☆13Jul 5, 2026Updated 4 months ago
- Library for evaluating RAG using Nuclia's models☆19Jul 31, 2024Updated 2 years ago
- Babel plugin for Regex+☆15Dec 16, 2025Updated 10 months ago
- Make SharedWorker works like Remote Procedure Call easily☆10Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Free Cloud JSON Storage Written in Python☆14Feb 2, 2023Updated 3 years ago
- Smart commit messages☆18Oct 25, 2024Updated 2 years ago
- ☆24Jul 10, 2026Updated 4 months ago
- Model implementation for the contextual embeddings project☆54Jun 2, 2025Updated last year
- Starbucks: Improved Training for 2D Matryoshka Embeddings☆26Jun 30, 2025Updated last year
- Official codes for COLING 2024 paper "Robust and Scalable Model Editing for Large Language Models": https://arxiv.org/abs/2403.17431v1☆14Mar 27, 2024Updated 2 years ago
- The source code for the official documentation of PyScript.☆17Jul 29, 2026Updated 3 months ago
Are these results useful?