build llama inference compute from scrath, only using torch/numpy base ops
☆12Aug 1, 2025Updated 8 months ago
Alternatives and similar repositories for naked_llama
Users that are interested in naked_llama are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- OSDI 2023 Welder, deeplearning compiler☆33Nov 24, 2023Updated 2 years ago
- Portable LLM - A rust library for LLM inference☆11Apr 13, 2024Updated 2 years ago
- Convert a dynamically linked binary to a statically linked binary going thorugh LLVM IR, using mcsema☆12May 27, 2019Updated 6 years ago
- lightsocks client implements by golang☆13Sep 11, 2015Updated 10 years ago
- Implement yolov5 with Tensorrt C++ api, and integrate batchedNMSPlugin. A Python wrapper is also provided.☆49Sep 30, 2021Updated 4 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆23Aug 5, 2020Updated 5 years ago
- Inference Llama 2 in one file of pure go☆16Jul 25, 2023Updated 2 years ago
- 你也可以做个Shadowsocks(Android篇)☆14Jan 30, 2022Updated 4 years ago
- ☆17Jan 1, 2024Updated 2 years ago
- YOLOv12 TensorRT 端到端模型加速推理和INT8量化实现☆13Mar 5, 2025Updated last year
- Performance of the C++ interface of flash attention and flash attention v2 in large language model (LLM) inference scenarios.☆16Aug 31, 2023Updated 2 years ago
- An OpenFaaS Provider example using memory for state.☆24Aug 16, 2022Updated 3 years ago
- [mirror] An OS tuning engine based on AI.☆24Dec 5, 2025Updated 4 months ago
- An android app using Tensorflow for Object Detection☆24Sep 6, 2017Updated 8 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Resources for Large Language Model Inference☆17Dec 29, 2023Updated 2 years ago
- Unscented Kalman Filter (in C++) for Self-Driving Car (AV) Project. Using Sensor Fusion, combines noisy data from Radar and LIDAR sensors…☆15Apr 14, 2017Updated 9 years ago
- a simple end to end example of taking a ML graph (TF2 / PyTorch) and running it on a device [cpu, gpu]☆36Jan 20, 2021Updated 5 years ago
- A pytorch implement of scalable neural netowrks.☆23Jun 9, 2020Updated 5 years ago
- OpenCV Text Detection (EAST text detector)☆12Jul 15, 2019Updated 6 years ago
- QT5+海康威视SDk二次开发+Opencv3.4+Marker识别☆13Jan 17, 2019Updated 7 years ago
- Using DOPE and YOLO-2 based hand tracking to detect object pose.☆12Nov 22, 2022Updated 3 years ago
- In this project I implemented the Unscented Kalman Filter to estimate the state of multiple cars on a highway using noisy lidar and radar…☆12Feb 21, 2020Updated 6 years ago
- a ros node using face_net do face_recognition☆12Jul 27, 2016Updated 9 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Codes for paper "Few Shot Network Compression via Cross Distillation", AAAI 2020.☆30Jan 31, 2020Updated 6 years ago
- MLIR backend for optimising graph algorithms☆17Mar 30, 2024Updated 2 years ago
- ☆12Dec 30, 2020Updated 5 years ago
- 🔴 Accelerated GStreamer utilities for NVIDIA Jetson Nano.☆10May 8, 2021Updated 4 years ago
- Serverless with Rancher 1.x and (OpenFaaS)☆23Jan 25, 2019Updated 7 years ago
- Depth_conv for MobileNet☆30Jun 22, 2020Updated 5 years ago
- a single-header math library☆17Nov 7, 2025Updated 5 months ago
- YoloV5 Tensorrt Conversion, Calibration, Inference☆12Jul 23, 2021Updated 4 years ago
- 程序员必看的91部影片包括电影、电视剧和纪录片-附在线地址-持续更新☆12May 18, 2020Updated 5 years ago
- Wordpress hosting with auto-scaling - Free Trial • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Python Flask based industrial SCADA application.☆14Mar 2, 2026Updated last month
- maskcnn_benchmark based on mobilenetv2☆12Nov 11, 2019Updated 6 years ago
- Client and Server stubs for Remote Procedure Call over UDP connection☆18Jun 13, 2014Updated 11 years ago
- 基于mobilev2和YOLOv3的目标检测的android端的ncnn的实现☆10Mar 20, 2020Updated 6 years ago
- 个人的Easylogging的学习总结☆12Aug 13, 2017Updated 8 years ago
- Talk "Go on GPU" in GopherChina 2023☆27Jun 29, 2023Updated 2 years ago
- ☆16Apr 1, 2022Updated 4 years ago