Imperative deep learning framework with customized GPU and CPU backend
☆29Jul 25, 2023Updated 3 years ago
Alternatives and similar repositories for Needle
Users that are interested in Needle are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆20Dec 24, 2024Updated last year
- Evaluation code for the EMNLP 2024 Findings paper introducing LongGenBench, a benchmark for long-context generation by large language mod…☆25Oct 8, 2024Updated 2 years ago
- implementation of nori the raytracer☆10Aug 12, 2019Updated 7 years ago
- volumetric path tracer for heterogeneous volume☆10Jun 15, 2024Updated 2 years ago
- deep learning framework from scratch☆35Apr 18, 2022Updated 4 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Tutorial Exercises and Code for GPU Communications Tutorial at HOT Interconnects 2026☆48Sep 28, 2026Updated 2 weeks ago
- High-performance GEMM implementation optimized for NVIDIA H100 GPUs, leveraging Hopper architecture's TMA, WGMMA, and Thread Block Cluste…☆11Aug 25, 2026Updated last month
- ☆13Sep 10, 2021Updated 5 years ago
- Learning material for CMU10-714: Deep Learning System☆326May 12, 2024Updated 2 years ago
- ☆17Apr 16, 2026Updated 5 months ago
- MESMERIC: A Software-based NVM Emulator Supporting Read/Write Asymmetric Latencies☆10Oct 1, 2020Updated 6 years ago
- Code Repository for the NeurIPS 2024 Paper "Toward Efficient Inference for Mixture of Experts".☆19Oct 30, 2024Updated last year
- ☆20Dec 29, 2023Updated 2 years ago
- A Streamlit app that uses Respell AI's API to allow you to make calls using AI.☆13Oct 29, 2023Updated 2 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Visualize expert firing frequencies across sentences in the Mixtral MoE model☆18Dec 22, 2023Updated 2 years ago
- Final project for the class "Deep Learning Systems Algorithms and Implementation" from CMU, where we try to make needle work with Apple M…☆10Jan 8, 2023Updated 3 years ago
- Linux programming environment course in Chinese☆12Nov 19, 2017Updated 8 years ago
- Decoding Attention is specially optimized for MHA, MQA, GQA and MLA using CUDA core for the decoding stage of LLM inference.☆48Jun 11, 2025Updated last year
- Code Examples for the OpenAI series☆14Jul 23, 2023Updated 3 years ago
- Explore Inter-layer Expert Affinity in MoE Model Inference☆17May 6, 2024Updated 2 years ago
- Adaptive Message Quantization and Parallelization for Distributed Full-graph GNN Training☆24Mar 1, 2024Updated 2 years ago
- ☆23Aug 14, 2024Updated 2 years ago
- ☆38Oct 4, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- An example of using Torch rust bindings to serve trained machine learning models via Actix Web☆17Aug 15, 2021Updated 5 years ago
- ☆13Jan 17, 2024Updated 2 years ago
- c++实现的clip推理，模型有一点点改动，但是不大，改动和导出模型的代码可以在readme里找到，模型文件都在Releases里，包括AX650的模型。新增支持ChineseCLIP☆31Jun 19, 2025Updated last year
- ☆437Sep 17, 2026Updated 3 weeks ago
- 用java实现DNS服务器☆13Apr 9, 2015Updated 11 years ago
- Awesome MoE Diffusion Models☆21Mar 25, 2026Updated 6 months ago
- ☆16Jul 12, 2024Updated 2 years ago
- Real-time multimodal AI pipelines on Apple Silicon☆203Updated this week
- A tool convert TensorRT engine/plan to a fake onnx☆41Nov 22, 2022Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- This project is intended to build and deploy an SNPE model on Qualcomm Devices, which are having unsupported layers which are not part of…☆10Oct 4, 2021Updated 5 years ago
- python-2.5-annotated☆14Jan 7, 2015Updated 11 years ago
- Chat with Towards Data Science☆14Nov 4, 2023Updated 2 years ago
- YOLOv12 TensorRT 端到端模型加速推理和INT8量化实现☆14Mar 5, 2025Updated last year
- NCU-driven iterative optimization workflow for CUDA/CUTLASS/Triton/CuTe DSL kernels.☆25Apr 10, 2026Updated 6 months ago
- Converts CLIP models to ONNX☆11Jan 17, 2023Updated 3 years ago
- ☆13Apr 9, 2025Updated last year