Imperative deep learning framework with customized GPU and CPU backend
☆29Jul 25, 2023Updated 2 years ago
Alternatives and similar repositories for Needle
Users that are interested in Needle are comparing it to the libraries listed below
Sorting:
- ☆19Dec 24, 2024Updated last year
- ☆32Oct 4, 2025Updated 5 months ago
- deep learning framework from scratch☆33Apr 18, 2022Updated 3 years ago
- Source code for the paper "LongGenBench: Long-context Generation Benchmark"☆23Oct 8, 2024Updated last year
- implementation of nori the raytracer☆10Aug 12, 2019Updated 6 years ago
- volumetric path tracer for heterogeneous volume☆10Jun 15, 2024Updated last year
- Tutorial Exercises and Code for GPU Communications Tutorial at HOT Interconnects 2025☆31Oct 22, 2025Updated 5 months ago
- ☆11Sep 23, 2023Updated 2 years ago
- ☆13Sep 10, 2021Updated 4 years ago
- Learning material for CMU10-714: Deep Learning System☆305May 12, 2024Updated last year
- Code Repository for the NeurIPS 2024 Paper "Toward Efficient Inference for Mixture of Experts".☆19Oct 30, 2024Updated last year
- Expansion of the Nori renderer☆15Feb 1, 2016Updated 10 years ago
- HALO: Hadamard-Assisted Low-Precision Optimization and Training method for finetuning LLMs. 🚀 The official implementation of https://arx…☆29Feb 17, 2025Updated last year
- ☆20Dec 29, 2023Updated 2 years ago
- A selective knowledge distillation algorithm for efficient speculative decoders☆36Nov 27, 2025Updated 3 months ago
- Decoding Attention is specially optimized for MHA, MQA, GQA and MLA using CUDA core for the decoding stage of LLM inference.☆45Jun 11, 2025Updated 9 months ago
- Visualize expert firing frequencies across sentences in the Mixtral MoE model☆18Dec 22, 2023Updated 2 years ago
- Stanford CS149 -- Assignment 1☆18Jul 24, 2021Updated 4 years ago
- ☆10May 14, 2023Updated 2 years ago
- ☆11Jan 17, 2024Updated 2 years ago
- ☆14Nov 28, 2023Updated 2 years ago
- Adaptive Message Quantization and Parallelization for Distributed Full-graph GNN Training☆24Mar 1, 2024Updated 2 years ago
- Explore Inter-layer Expert Affinity in MoE Model Inference☆16May 6, 2024Updated last year
- SGLang is a fast serving framework for large language models and vision language models.☆30Updated this week
- Fast and memory-efficient exact attention☆20Mar 13, 2026Updated last week
- ☆24Apr 22, 2023Updated 2 years ago
- c++实现的clip推理，模型有一点点改动，但是不大，改动和导出模型的代码可以在readme里找到，模型文件都在Releases里，包括AX650的模型。新增支持ChineseCLIP☆31Jun 19, 2025Updated 9 months ago
- Sample Codes using NVSHMEM on Multi-GPU☆30Jan 22, 2023Updated 3 years ago
- ☆12Apr 9, 2025Updated 11 months ago
- ☆14Jan 20, 2025Updated last year
- A tool convert TensorRT engine/plan to a fake onnx☆40Nov 22, 2022Updated 3 years ago
- MobileSAM のエンコーダー/デコーダーをONNXに変換し、推論するサンプル☆11Apr 11, 2024Updated last year
- AccelOpt: Self-improving Agents for AI Accelerator Kernel Optimization☆30Feb 18, 2026Updated last month
- 监控六个主流数字货币交易所的上币公告：Gate Bybit Bitget KuCoin Binance OKX☆37Aug 6, 2025Updated 7 months ago
- ☆25Mar 9, 2026Updated 2 weeks ago
- ☆15Jan 27, 2026Updated last month
- python-2.5-annotated☆13Jan 7, 2015Updated 11 years ago
- Converts CLIP models to ONNX☆10Jan 17, 2023Updated 3 years ago
- Less Is More: Training-Free Sparse Attention with Global Locality for Efficient Reasoning☆29Sep 12, 2025Updated 6 months ago