M4THYOU / TokenDaggerLinks
High-Performance Implementation of OpenAI's TikToken.
☆461Updated 4 months ago
Alternatives and similar repositories for TokenDagger
Users that are interested in TokenDagger are comparing it to the libraries listed below
Sorting:
- Fully neural approach for text chunking☆401Updated last month
- Browser-LLM Auto-Scaling Technology☆761Updated this week
- Run larger LLMs with longer contexts on Apple Silicon by using differentiated precision for KV cache quantization. KVSplit enables 8-bit …☆360Updated 6 months ago
- Content addressable storage with excellent search☆356Updated last week
- Multimodal RAG to search and interact locally with technical documents of any kind☆279Updated 3 weeks ago
- See Through Your Models☆402Updated 4 months ago
- Git Based Memory Storage for Conversational AI Agent☆737Updated last week
- ☆280Updated 5 months ago
- Parallel thinking for LLMs. Confidence‑gated, strategy‑driven, offline‑friendly☆258Updated 2 months ago
- ☆163Updated 8 months ago
- ☆198Updated 6 months ago
- Examples and guides for using the VLM Run API☆297Updated last week
- Animating R1's thoughts.☆386Updated 9 months ago
- ai for jq☆246Updated last year
- CleverBee - The Open Source Deep Researcher Tool☆305Updated 5 months ago
- This project collects GPU benchmarks from various cloud providers and compares them to fixed per token costs. Use our tool for efficient …☆222Updated 11 months ago
- Transform JSON objects using vector embeddings☆428Updated last year
- Docker-based inference engine for AMD GPUs☆230Updated last year
- Radient turns many data types (not just text) into vectors for similarity search, RAG, regression analysis, and more.☆281Updated last month
- Applying the ideas of Deepseek R1 to computer use☆217Updated 9 months ago
- A hub for various industry-specific schemas to be used with VLMs.☆537Updated 6 months ago
- Implement recursion using English as the programming language and an LLM as the runtime.☆238Updated 2 years ago
- RAG Logger is an open-source logging tool designed specifically for Retrieval-Augmented Generation (RAG) applications. It serves as a lig…☆225Updated 11 months ago
- Lightweight Pandas monkey-patch that adds async support to map, apply, applymap, aggregate, and transform, enabling seamless handling of …☆131Updated 5 months ago
- Build data processing and data analysis pipelines that leverage the power of LLMs 🧠☆230Updated 2 weeks ago
- Dead Simple LLM Abliteration☆241Updated 9 months ago
- Spegel - Reflect the web through AI☆317Updated 4 months ago
- AI Dataset Generator – Create realistic datasets for demos, learning, and dashboards☆734Updated last month
- Local first semantic and hybrid BM25 grep / search tool for use by AI and humans!☆1,026Updated 2 weeks ago
- Proof of thought : LLM-based reasoning using Z3 theorem proving with multiple backend support (SMT2 and JSON DSL)☆356Updated last month