Implementation of the dilated self attention as described in "LongNet: Scaling Transformers to 1,000,000,000 Tokens"
☆13Jul 23, 2023Updated 3 years ago
Alternatives and similar repositories for dilated-self-attention
Users that are interested in dilated-self-attention are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- (Unofficial) Implementation of dilated attention from "LongNet: Scaling Transformers to 1,000,000,000 Tokens" (https://arxiv.org/abs/2307…☆52Aug 7, 2023Updated 3 years ago
- 🚂 Fine-tune OpenAI models for text classification, question answering, and more☆17May 1, 2023Updated 3 years ago
- A RAG that can scale 🧑🏻💻☆11May 28, 2024Updated 2 years ago
- ☆10Oct 2, 2024Updated last year
- YASEM - Yet Another Splade|Sparse Embedder - A simple and efficient library for SPLADE embeddings☆13May 22, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆11Feb 1, 2024Updated 2 years ago
- 🤝 Trade any tensors over the network☆31Sep 27, 2023Updated 2 years ago
- ☆17Jan 5, 2023Updated 3 years ago
- Knowledgeable Embedding: Injecting dynamically updatable entity knowledge into embeddings to enhance RAG☆15Aug 31, 2025Updated 11 months ago
- 🤗 HuggingFace Inference Toolkit for Google Cloud Vertex AI (similar to SageMaker's Inference Toolkit, but for Vertex AI and unofficial)☆17Mar 20, 2024Updated 2 years ago
- A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.☆32Sep 19, 2025Updated 10 months ago
- Semantically Search Emojis From the Command Line!☆13Nov 26, 2023Updated 2 years ago
- 🎓Automatically Update CV Papers Daily using Github Actions (Update Every 12th hours)☆12May 17, 2026Updated 3 months ago
- 🧬 Typescript Genetic Algorithm Framework built using deno☆13Jun 7, 2022Updated 4 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A proposed standard `NOCK` for a Parquet format that supports efficient distributed serialization of multiple kinds of graph technologies☆21Apr 27, 2026Updated 3 months ago
- Investigation into whether Transformers and self-supervised learning could be used to trade currency markets☆10Jun 21, 2023Updated 3 years ago
- Bleeding edge low level Rust binding for GGML☆18Jun 26, 2024Updated 2 years ago
- ☆14Oct 31, 2023Updated 2 years ago
- A subset of YFCC100M. Tools, checking scripts and links of web drive to download datasets(uncompressed).☆19Aug 5, 2026Updated 2 weeks ago
- ☆11Dec 26, 2018Updated 7 years ago
- [CoLM 24] Official Repository of MambaByte: Token-free Selective State Space Model☆27Oct 12, 2024Updated last year
- recreation of the classic drug trading game "dope wars"☆11May 9, 2019Updated 7 years ago
- Alternate LLM Architecture Experiment with O(n) time complexity☆11Jul 18, 2026Updated last month
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- ☆15Aug 10, 2024Updated 2 years ago
- ☆20Oct 2, 2024Updated last year
- A small spreadsheet demo in Rust, Yew, and WASM☆11Jun 16, 2023Updated 3 years ago
- Efficient kernel for RMS normalization with fused operations, includes both forward and backward passes, compatibility with PyTorch.☆13Jun 5, 2024Updated 2 years ago
- Keyphrase Extraction Prototypes☆15Nov 24, 2016Updated 9 years ago
- Parsing and serialization support for PSSH boxes used in DRM systems☆16Jul 24, 2026Updated 3 weeks ago
- Life before `main()`☆19Feb 2, 2021Updated 5 years ago
- RWKV model implementation☆37Jul 15, 2023Updated 3 years ago
- DrBERT: A Robust Pre-trained Model in French for Biomedical and Clinical domains☆22Feb 7, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Smart commit messages☆18Oct 25, 2024Updated last year
- [NeurIPS 2024] 🕸 GlotCC Dataset and Pipline☆21Apr 6, 2025Updated last year
- SMS gateway for sending text messages☆13Apr 9, 2023Updated 3 years ago
- Implementation for Revela: Dense Retriever Learning via Language Modeling - ICLR 2026 Oral☆20Mar 26, 2026Updated 4 months ago
- The code of Self-Training Multi-Sequence Learning with Transformer for Weakly Supervised Video Anomaly Detection☆24Nov 23, 2022Updated 3 years ago
- Log-structured merge-tree implementation in Rust☆19Nov 6, 2018Updated 7 years ago
- Hunt the Wumpus in Yew☆11Oct 26, 2023Updated 2 years ago