Research on DeepSeek Sparse Attention
☆40Oct 8, 2025Updated last year
Alternatives and similar repositories for deepseek-sparse-attention-research
Users that are interested in deepseek-sparse-attention-research are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- python-to-triton-llm☆10Aug 25, 2025Updated last year
- So, I trained a MoE based a 124M (8x12M) architecture I coded from ground up to build a small instruct model, going through the below-men…☆14Jul 18, 2025Updated last year
- Comparative study and experimentation on standard vs mHC vs attention residual (full and block)☆13Mar 17, 2026Updated 7 months ago
- Research on training an LLM with DeepSeek & Kimi architecture☆67Sep 30, 2025Updated last year
- ☆88Dec 13, 2025Updated 10 months ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- ☆16Mar 18, 2025Updated last year
- ☆53May 20, 2025Updated last year
- ☆19Oct 26, 2026Updated last week
- Implementation of the paper "ProxyAttn: Guided Sparse Attention via Representative Heads".☆14Mar 9, 2026Updated 7 months ago
- A distilled DeepSeek-R1 variant built on Qwen2.5-32B, fine-tuned with curated data for enhanced performance and efficiency. <metadata> gp…☆14Mar 11, 2025Updated last year
- Книга "Графовые нейронные сети на Python"☆10Aug 31, 2024Updated 2 years ago
- ☆27Aug 12, 2026Updated 2 months ago
- Rucio K8s tutorial☆12Jul 24, 2026Updated 3 months ago
- 使用trl、peft、transformers等库，实现对huggingface上模型的微调。☆10Mar 21, 2025Updated last year
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- ☆14Jul 16, 2020Updated 6 years ago
- Phony News Classifier is a repository which contains analysis of a natural language processing application i.e fake news classifier with …☆10May 27, 2020Updated 6 years ago
- ☆11Apr 21, 2022Updated 4 years ago
- Sparse-dense matrix-matrix multiplication on GPUs☆13Oct 15, 2018Updated 8 years ago
- Custom triton kernels for training Karpathy's nanoGPT.☆19Oct 21, 2024Updated 2 years ago
- Official Repo for paper "VLCache: Computing 2% Vision Tokens and Reusing 98% for Vision-Language Inference"☆16Mar 28, 2026Updated 7 months ago
- The official github repo for MixEval-X, the first any-to-any, real-world benchmark.☆17Feb 15, 2025Updated last year
- Official implementation of Diffusion-DFL: Decision-focused Diffusion Models for Stochastic Optimization (ICLR 2026).☆15Apr 22, 2026Updated 6 months ago
- RuCLIP-SB (Russian Contrastive Language–Image Pretraining SWIN-BERT) is a multimodal model for obtaining images and text similarities and…☆15Jan 25, 2022Updated 4 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- ☆16Dec 11, 2025Updated 10 months ago
- Elastic Attention: Test-time Adaptive Sparsity Ratios for Efficient Transformers☆24May 26, 2026Updated 5 months ago
- ☆20Nov 22, 2025Updated 11 months ago
- Nano vLLM☆15Jun 1, 2026Updated 5 months ago
- ☆21Sep 22, 2026Updated last month
- RL a search agent on SEC filings with Tinker (Dr. GRPO, gpt-oss-20b)☆24Sep 17, 2026Updated last month
- This is the official code for UGTs.☆13Feb 8, 2023Updated 3 years ago
- Investigating the generalization behavior of LM probes trained to predict truth labels: (1) from one annotator to another, and (2) from e…☆34May 23, 2024Updated 2 years ago
- Music算法仿真实验☆15Dec 21, 2018Updated 7 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Image captioning using CNN and RNN☆11Mar 24, 2025Updated last year
- ☆18Mar 10, 2026Updated 7 months ago
- Using DDPG agent to control UAV system with energy efficiency☆16Jan 7, 2023Updated 3 years ago
- ☆14Jan 18, 2020Updated 6 years ago
- Implementation of the paper "Enabling cell-free massive MIMO systems with wireless millimeter wave fronthaul"☆15Apr 4, 2023Updated 3 years ago
- context denoising training for long-context modeling☆17Oct 10, 2025Updated last year
- (COLING2025) SEED: Accelerating Reasoning Tree Construction via Scheduled Speculative Decoding☆10Dec 18, 2024Updated last year