这是一个基于C++实现的从零开始的大模型推理框架
☆10Nov 18, 2024Updated last year
Alternatives and similar repositories for LLM_infra_from_scratch
Users that are interested in LLM_infra_from_scratch are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 这是一个从零学习CUDA课程☆13Nov 3, 2024Updated last year
- 2025.3.18再次更新！新增查询余额功能！ChatGPT-website的改进版本（后端请求），几乎支持所有OpenAI模型，新增前端设置参数（temperature和tokens），gpt4访问密码，记忆和读取参数（cookies），apikey支持批量填写（前端以及…☆14Jan 4, 2026Updated 9 months ago
- A unified framework for feed-forward neural networks☆15Nov 28, 2025Updated 10 months ago
- Ollama Function Calling with Search API☆11Apr 28, 2025Updated last year
- Love 2d based Tetris game☆13May 21, 2013Updated 13 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- 3D Gaussian Splat Easily Attacked to Cause Harm☆13Aug 5, 2025Updated last year
- Demonstration of a factory pattern where the types automatically register themselves☆13Mar 13, 2019Updated 7 years ago
- simplest online-softmax notebook for explain Flash Attention☆18Jan 27, 2026Updated 8 months ago
- rule matcher (context free grammar)☆10Dec 27, 2019Updated 6 years ago
- a within-document event coreference resolution system, trained and evaluated on the KBP corpus.☆10May 15, 2023Updated 3 years ago
- Let's build a completely self-hosting Lua compiler from scratch (that means regex, lexer, parser, bytecode, the whole nine yards!)☆12Dec 2, 2015Updated 10 years ago
- ☆10Apr 20, 2025Updated last year
- PyTorch implementation of the Reinforced Mnemonic Reader + Answer Verifier model (https://arxiv.org/abs/1808.05759)☆10Nov 23, 2018Updated 7 years ago
- This repo aims to offer a packet flow tracer based on bpf☆13Oct 6, 2019Updated 7 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- zero-overhead SSH protection at XDP speed. Guard your SSH like tyr guard the gates of asgard!☆11May 2, 2025Updated last year
- python interface for mate tools☆17Jan 23, 2018Updated 8 years ago
- using taichi to create sph simulation☆49Jul 22, 2022Updated 4 years ago
- VLSI placement and routing tool☆16Dec 20, 2025Updated 10 months ago
- ☆12Jun 7, 2019Updated 7 years ago
- ☆14Mar 5, 2023Updated 3 years ago
- nthu-route 2.11☆14Aug 5, 2019Updated 7 years ago
- Repository for NeuroSnippets Code.☆12Apr 19, 2022Updated 4 years ago
- My solutions to the assignments of dlsys course (CSE599G1: Deep Learning System Spring 2017)☆10Jul 1, 2017Updated 9 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Speed up development of AF_XDP-based Network Functions☆14Jul 16, 2023Updated 3 years ago
- One-click deployment and management toolkit for Mieru, Snell v4/v5, Hysteria2 and VLESS + FinalMask + Sudoku.☆98Updated this week
- Co-training for Policy Learning☆13Aug 8, 2019Updated 7 years ago
- ☆12Jul 4, 2023Updated 3 years ago
- Benchmark Generator for Global Routing☆13Jul 18, 2019Updated 7 years ago
- Deterministic Regular Expressions with Backreferences☆21Oct 12, 2020Updated 6 years ago
- Chaining of SR-aware and SR-unaware Service Functions☆10Apr 17, 2018Updated 8 years ago
- ☆10May 21, 2024Updated 2 years ago
- A Deterministic Finite Automata GPU-based Engine☆17Sep 6, 2017Updated 9 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- [ICRA 2024] WLST: Weak Labels Guided Self-training for Weakly-supervised Domain Adaptation on 3D Object Detection☆12Feb 6, 2024Updated 2 years ago
- Datanlord's RDMA nic driver☆12Sep 12, 2024Updated 2 years ago
- IC设计中的一些经典书籍☆13Jul 28, 2020Updated 6 years ago
- Live2D creation workflow for Codex and AI agents, with PSD/PNG rigging, anime upscaling, Core/WebGL validation, and an example model for …☆35Updated this week
- This is a distributed kv project to demonstrate how to use matrixcube☆17Sep 8, 2022Updated 4 years ago
- AutodiffEngine☆13Apr 1, 2019Updated 7 years ago
- ☆29Jan 5, 2025Updated last year