Seeed-Projects / RAG_based_on_JetsonLinks
This project has implemented the RAG function on Jetson and supports TXT and PDF document formats. It uses MLC for 4-bit quantization of the Llama2-7b model, utilizes ChromaDB as the vector database, and connects these features with Llama_Index. I hope you like this project.
☆13Updated last year
Alternatives and similar repositories for RAG_based_on_Jetson
Users that are interested in RAG_based_on_Jetson are comparing it to the libraries listed below
Sorting:
- ☆119Updated last week
- A collection of reference AI microservices and workflows for Jetson Platform Services☆51Updated 10 months ago
- This repo has the code of the 3 demos I presented at Google Gemma2 DevDay Tokyo, using Gemma2 on a Jetson Orin Nano device.☆60Updated 4 months ago
- ☆20Updated 8 months ago
- Using FastChat-T5 Large Language Model, Vosk API for automatic speech recognition, and Piper for text-to-speech☆125Updated 2 years ago
- Jetbot tools is a set of ROS2 nodes that utilize the Jetson inference DNN vision library for NVIDIA Jetson☆23Updated last year
- Real-time Vision Language Model interaction via webcam - WebRTC-based web interface☆144Updated 3 weeks ago
- Optimized local inference for LLMs with HuggingFace-like APIs for quantization, vision/language models, multimodal agents, speech, vector…☆336Updated last year
- High-performance, optimized pre-trained template AI application pipelines for systems using Hailo devices☆171Updated 2 months ago
- ASR/NLP/TTS deep learning inference library for NVIDIA Jetson using PyTorch and TensorRT☆219Updated last year
- Jetbot Voice to Action Tools is a set of ROS2 nodes that utilize the Jetson Automatic Speech Recognition (ASR) deep learning interface li…☆12Updated last year
- Training framework for easy creation, training and exporting of deep learning models.☆20Updated last week
- Examine the camera capabilities for V4l2 cameras☆50Updated last year
- ☆107Updated last year
- Workflow for generating synthetic data and training CV models.☆88Updated 5 months ago
- MCP server for ROS to control robots via topics, services, and actions.☆28Updated 3 months ago
- The NVIDIA RTX™ AI Toolkit is a suite of tools and SDKs for Windows developers to customize, optimize, and deploy AI models across RTX PC…☆180Updated 3 weeks ago
- ROS2 package for trt_pos_hand, "Real-time hand pose estimation and gesture classification using TensorRT"☆18Updated 4 years ago
- This repository provides a detailed guide on integrating NVIDIA Isaac Sim with Isaac ROS on the Jetson Orin Nano, utilizing JetPack 6 for…☆23Updated last year
- Synthetic Data Generation Examples☆143Updated 6 months ago
- Perception workflows☆69Updated this week
- A curated list of OpenVINO based AI projects☆172Updated 5 months ago
- Beginner's Guide to reComputer Jetson☆119Updated 2 months ago
- PX4 Autopilot Software for OmniQuad platform☆19Updated 8 months ago
- Get started with AI vision at the edge with no coding experience at all!☆72Updated 11 months ago
- Take your LLM to the optometrist.☆42Updated 2 weeks ago
- Use Florence 2 to auto-label data for use in training fine-tuned object detection models.☆68Updated last year
- Demonstrate how to use zero-copy Shared Memory data transfer in a single independent example. The middleware used is Eclipse CycloneDDS w…☆36Updated 4 years ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆34Updated last year
- Support for Logitech F710 game controller on Jetson Xavier☆24Updated 8 months ago