High-Performance Implementation of OpenAI's TikToken.
☆473Jul 3, 2025Updated 8 months ago
Alternatives and similar repositories for TokenDagger
Users that are interested in TokenDagger are comparing it to the libraries listed below
Sorting:
- Collection of high-performance, CUDA-accelerated fluid dynamics and physics simulators, including SPH, hypersonic flow, and reaction-diff…☆60Feb 23, 2026Updated 3 weeks ago
- A browser-based, WebGL2 implementation of GPT-2 with transform block and attention matrix visualization☆342Oct 24, 2025Updated 4 months ago
- A complete end-to-end pipeline for LLM interpretability with sparse autoencoders (SAEs) using Llama 3.2, written in pure PyTorch and full…☆630Mar 23, 2025Updated 11 months ago
- High performance Rust stream processing engine seamlessly integrates AI capabilities, providing powerful real-time data processing and in…☆1,256Mar 11, 2026Updated last week
- Run larger LLMs with longer contexts on Apple Silicon by using differentiated precision for KV cache quantization. KVSplit enables 8-bit …☆362May 21, 2025Updated 9 months ago
- A comprehensive suite of tools, built to liberate science by making the creation, evaluation, and dissemination of research more transpar…☆240Aug 8, 2025Updated 7 months ago
- Min.js Style Compression of Tech Docs for LLM Context☆673Oct 5, 2025Updated 5 months ago
- Code Mode MCP — aggregate all your MCP servers behind search() + execute()☆29Feb 26, 2026Updated 3 weeks ago
- pubsub in <100 bytes☆165Nov 23, 2025Updated 3 months ago
- Rust implementation of the Zstandard Seekable Format☆260Mar 12, 2026Updated last week
- The Noisy Sockets CLI☆264Sep 20, 2024Updated last year
- Tensor library & inference framework for machine learning☆116Oct 3, 2025Updated 5 months ago
- ☆678Jul 31, 2025Updated 7 months ago
- browser plugin to send youtube, insta (all social videos) to local backend and process audio and video in all sorts of ways.☆249Aug 31, 2025Updated 6 months ago
- A SQL query engine in Go☆155Oct 8, 2024Updated last year
- Rust toolkit for layered stream multiplexing and schemaless RPC communication.☆32Feb 3, 2026Updated last month
- Multi-model transactional embedded database☆68Dec 10, 2024Updated last year
- Persistent memory for LLMs and apps. Content-addressed storage with dedupe, compression, full-text and vector search.☆366Mar 10, 2026Updated last week
- ☆200May 5, 2025Updated 10 months ago
- AI-powered Postgres Client☆494Jul 11, 2025Updated 8 months ago
- A privacy-preserving home security camera that uses end-to-end encryption. (Secluso was previously named Privastead.)☆1,093Updated this week
- Fully neural approach for text chunking☆407Oct 23, 2025Updated 4 months ago
- Browser-LLM Auto-Scaling Technology☆775Jan 29, 2026Updated last month
- ☆177Oct 26, 2024Updated last year
- A Nix web bundler because why not☆56Mar 10, 2024Updated 2 years ago
- A simple app for downloading YouTube Shorts transcripts. Built to self-host with Python and Streamlit. Free and open source.☆32Dec 4, 2024Updated last year
- MCP Server to fetch costs and usage data from your Vantage account.☆80Updated this week
- Open Source Web-based 3D Presentation Tool☆477Dec 25, 2025Updated 2 months ago
- A tile server for WSI stored in S3-compatible object storage. It serves tiles on-demand using HTTP range requests, so you never have to d…☆179Jan 17, 2026Updated 2 months ago
- Visual chatbot flow editor. GUI tool for designing chatbot flows. Create, test, and export as JSON.☆78Jul 19, 2025Updated 8 months ago
- Felafax is building AI infra for non-NVIDIA GPUs☆570Jan 24, 2025Updated last year
- Ultra-lightweight AI Agent☆432Mar 5, 2026Updated 2 weeks ago
- Hacker News Search and RAG built using Rust actix-web, minijinja, SolidJS, Vite, and Redis queue's☆30Dec 11, 2024Updated last year
- Lightweight Nearest Neighbors with Flexible Backends☆335Dec 30, 2025Updated 2 months ago
- ☆269Mar 6, 2025Updated last year
- AI Dataset Generator – Create realistic datasets for demos, learning, and dashboards☆754Oct 3, 2025Updated 5 months ago
- The fastest 128-bit and 256-bit hash, passes all tests, and under 140 source lines of code. API library and CLI tool in C++ and NodeJS/Wa…☆130Dec 20, 2025Updated 3 months ago
- Uses an llm to generate ffmpeg commands☆485Jan 19, 2025Updated last year
- Transcribe PDFs with local LLMs☆816Jan 27, 2026Updated last month