build llama inference compute from scrath, only using torch/numpy base ops
☆15May 5, 2026Updated 3 weeks ago
Alternatives and similar repositories for naked_llama
Users that are interested in naked_llama are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- OSDI 2023 Welder, deeplearning compiler☆34Nov 24, 2023Updated 2 years ago
- Portable LLM - A rust library for LLM inference☆12Apr 13, 2024Updated 2 years ago
- 破解我的世界禁止多人游戏的限制☆10Jun 9, 2023Updated 2 years ago
- ☆23May 10, 2023Updated 3 years ago
- SHUOSC RISC-V implementation☆11May 12, 2024Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Implement yolov5 with Tensorrt C++ api, and integrate batchedNMSPlugin. A Python wrapper is also provided.☆49Sep 30, 2021Updated 4 years ago
- Inference Llama 2 in one file of pure go☆15Jul 25, 2023Updated 2 years ago
- github pages main entry point: https://dgschwend.github.io☆20Jul 22, 2016Updated 9 years ago
- ☆39Jun 14, 2023Updated 2 years ago
- A CNN accelerator design inspired by MIT Eyeriss project☆20Aug 14, 2021Updated 4 years ago
- ☆13Sep 6, 2021Updated 4 years ago
- a lightweight C++ LLaMA inference engine for mobile devices☆15Oct 28, 2023Updated 2 years ago
- TUI-klient för SVTs text-tv skriven i Go.☆23May 28, 2021Updated 5 years ago
- ☆17Jan 1, 2024Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- convert pytorch trained yolo model to ncnn for Flexible deployment☆10Aug 30, 2018Updated 7 years ago
- YOLOv12 TensorRT 端到端模型加速推理和INT8量化实现☆13Mar 5, 2025Updated last year
- Official Project Page for HLA: Higher-order Linear Attention (https://arxiv.org/abs/2510.27258)☆101May 13, 2026Updated 2 weeks ago
- ☆22Jun 17, 2025Updated 11 months ago
- Performance of the C++ interface of flash attention and flash attention v2 in large language model (LLM) inference scenarios.☆16Aug 31, 2023Updated 2 years ago
- [mirror] An OS tuning engine based on AI.☆23May 19, 2026Updated last week
- A Rust built code judger utils with Web & CLI executables☆17Apr 7, 2025Updated last year
- MVP (Minimal Viable Preparation) for modern dApp developers☆20Sep 19, 2023Updated 2 years ago
- Resources for Large Language Model Inference☆17Dec 29, 2023Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆35Nov 26, 2024Updated last year
- Reactive State Machine with RxJs☆29Feb 23, 2015Updated 11 years ago
- Unscented Kalman Filter (in C++) for Self-Driving Car (AV) Project. Using Sensor Fusion, combines noisy data from Radar and LIDAR sensors…☆15Apr 14, 2017Updated 9 years ago
- 海康威视视频实时预览Demo☆11Dec 12, 2019Updated 6 years ago
- a simple end to end example of taking a ML graph (TF2 / PyTorch) and running it on a device [cpu, gpu]☆36Jan 20, 2021Updated 5 years ago
- A pytorch implement of scalable neural netowrks.☆23Jun 9, 2020Updated 5 years ago
- OpenCV Text Detection (EAST text detector)☆12Jul 15, 2019Updated 6 years ago
- QT5+海康威视SDk二次开发+Opencv3.4+Marker识别☆14Jan 17, 2019Updated 7 years ago
- Using DOPE and YOLO-2 based hand tracking to detect object pose.☆12Nov 22, 2022Updated 3 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- A compiler to automatically transform applications into disaggregated memory apps.☆17Nov 16, 2023Updated 2 years ago
- In this project I implemented the Unscented Kalman Filter to estimate the state of multiple cars on a highway using noisy lidar and radar…☆12Feb 21, 2020Updated 6 years ago
- a ros node using face_net do face_recognition☆12Jul 27, 2016Updated 9 years ago
- MLIR backend for optimising graph algorithms☆17Mar 30, 2024Updated 2 years ago
- ☆12Dec 30, 2020Updated 5 years ago
- 🔴 Accelerated GStreamer utilities for NVIDIA Jetson Nano.☆10May 8, 2021Updated 5 years ago
- A 2-4h workshop on the Tamarin protocol verifier.☆22Mar 9, 2026Updated 2 months ago