A high-throughput and memory-efficient inference and serving engine for LLMs
☆16Jul 19, 2026Updated 3 weeks ago
Alternatives and similar repositories for vllm_ascend_orangepi
Users that are interested in vllm_ascend_orangepi are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- JittorInfer is a high-performance C++ inference framework designed for large language models on Huawei's Ascend AI processor.☆83Jun 10, 2026Updated 2 months ago
- Everything about AI4Geometry (AI for geometry problem solving / geometry theorem proving).☆19Dec 19, 2025Updated 7 months ago
- Code for paper 'Zero-Shot Scene Graph Generation via Triplet Calibration and Reduction' （TOMM 2023）☆10Sep 6, 2025Updated 11 months ago
- ☆24May 11, 2024Updated 2 years ago
- This tool set can generate required capabilities for binaries. A system call to capability mapping is used to assign capability to the bi…☆14Oct 26, 2022Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆12Jul 9, 2025Updated last year
- 《互联网络原理与实践（中文翻译）》Principles and Practices of Interconnection Networks☆32Nov 20, 2020Updated 5 years ago
- Source code for "An Empirical Study of Code Smells in Transformer-based Code Generation Techniques".☆11Oct 4, 2022Updated 3 years ago
- Frontend project for the OSS Compass☆21Aug 3, 2026Updated last week
- [ESEC/FSE'23] Hue: A User-Adaptive Parser for Hybrid Logs☆10Aug 24, 2023Updated 2 years ago
- MyBlog☆11Jul 27, 2026Updated 2 weeks ago
- Language Model Accessor Object - Neural autocomplete for Overleaf☆13May 2, 2023Updated 3 years ago
- Code for ICLR'2021 paper: On Dyadic Fairness: Exploring and Mitigating Bias in Graph Connections☆12Jul 17, 2021Updated 5 years ago
- Ladder Loss for Coherent Visual-Semantic Embedding, AAAI, 2020☆13Aug 14, 2021Updated 4 years ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- Minimal multi-gpu implementation of EDM2: "Analyzing and Improving the Training Dynamics of Diffusion Models"☆41Mar 5, 2024Updated 2 years ago
- Ascend TileLang adapter☆349Updated this week
- ☆13Jun 27, 2022Updated 4 years ago
- A framework for graph-based dependency parsing.☆19Feb 9, 2022Updated 4 years ago
- 复旦大学计算机学院 2021~2022学年秋季学期《计算机网络》复习资料总结, 包含《王道考研》笔记以及各方整理试题.☆26Jan 11, 2022Updated 4 years ago
- Facebook AI Research Sequence-to-Sequence Toolkit written in Python.☆12Oct 10, 2020Updated 5 years ago
- Anomaly detection using RAG☆19Apr 22, 2024Updated 2 years ago
- Compiler and code generator for a dialect of Abstract Syntax Description Language☆13Oct 13, 2018Updated 7 years ago
- Rebuilding ...☆11Apr 20, 2021Updated 5 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- ☆12Sep 11, 2020Updated 5 years ago
- MetaAttention: A Unified and Performant Attention Framework Across Hardware Backends(PPoPP'26)☆17Updated this week
- CS231N project☆12Dec 17, 2018Updated 7 years ago
- code for "Implant Global and Local Hierarchy Information to Sequence based Code Representation Models"☆12Dec 13, 2024Updated last year
- PyTorch library for synthesizing programs from natural language☆18Jul 25, 2024Updated 2 years ago
- 北大树洞爬虫☆11Jul 30, 2020Updated 6 years ago
- LLM training in simple, C++/CUDA(with Eigen3)☆17Sep 1, 2024Updated last year
- ☆14Aug 28, 2022Updated 3 years ago
- This is a repo holding codes for the paper: Code Completion with Neural Attention and Pointer Networks☆13Mar 21, 2018Updated 8 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- An official implementation of CW-RGP (NeurIPS 2022, spotlight).☆21Dec 9, 2022Updated 3 years ago
- 谷歌开源项目Python风格指南与编写简洁可读代码的建议☆13Sep 10, 2021Updated 4 years ago
- SGLang Kernel Wheel Index☆24Updated this week
- 告诉你每门课的意义所在。☆22May 16, 2014Updated 12 years ago
- GPT学习☆21Sep 3, 2020Updated 5 years ago
- Supplementary materials for paper "On the Effectiveness of Log Representation for Log-based Anomaly Detection"☆14Dec 1, 2023Updated 2 years ago
- 《统计学习方法-李航》Python代码实现☆17Feb 14, 2019Updated 7 years ago