M4THYOU / TokenDaggerLinks
High-Performance Implementation of OpenAI's TikToken.
☆467Updated 6 months ago
Alternatives and similar repositories for TokenDagger
Users that are interested in TokenDagger are comparing it to the libraries listed below
Sorting:
- Browser-LLM Auto-Scaling Technology☆770Updated last week
- Run larger LLMs with longer contexts on Apple Silicon by using differentiated precision for KV cache quantization. KVSplit enables 8-bit …☆363Updated 8 months ago
- Multimodal RAG to search and interact locally with technical documents of any kind☆284Updated last week
- Fully neural approach for text chunking☆406Updated 3 months ago
- ☆200Updated 8 months ago
- Persistent memory for LLMs and apps. Content-addressed storage with dedupe, compression, full-text and vector search.☆363Updated this week
- Animating R1's thoughts.☆384Updated 11 months ago
- ai for jq☆249Updated last year
- ☆164Updated 10 months ago
- This is a framework that implements various parallel reasoning strategies from the literature☆275Updated last month
- ☆279Updated 7 months ago
- This project collects GPU benchmarks from various cloud providers and compares them to fixed per token costs. Use our tool for efficient …☆222Updated last year
- Proof of thought : LLM-based reasoning using Z3 theorem proving with multiple backend support (SMT2 and JSON DSL)☆363Updated 3 months ago
- Examples and guides for using the VLM Run API☆305Updated 3 weeks ago
- Docker-based inference engine for AMD GPUs☆231Updated last year
- Heirarchical Navigable Small Worlds☆101Updated 5 months ago
- RAG Logger is an open-source logging tool designed specifically for Retrieval-Augmented Generation (RAG) applications. It serves as a lig…☆227Updated last year
- Implement recursion using English as the programming language and an LLM as the runtime.☆240Updated 2 years ago
- Dead Simple LLM Abliteration☆247Updated 11 months ago
- Run and explore Llama models locally with minimal dependencies on CPU☆190Updated last year
- See Through Your Models☆400Updated 6 months ago
- GUI for selecting text files for concatenation and submission to LLMs☆180Updated 2 months ago
- Transform JSON objects using vector embeddings☆429Updated last year
- CleverBee - The Open Source Deep Researcher Tool☆310Updated 7 months ago
- Browsers-as-a-service for automations and web agents☆627Updated this week
- Lightweight Pandas monkey-patch that adds async support to map, apply, applymap, aggregate, and transform, enabling seamless handling of …☆135Updated 7 months ago
- A hub for various industry-specific schemas to be used with VLMs.☆539Updated last month
- Spegel - Reflect the web through AI☆333Updated last week
- Git Based Memory Storage for Conversational AI Agent☆770Updated 2 months ago
- A comprehensive suite of tools, built to liberate science by making the creation, evaluation, and dissemination of research more transpar…☆231Updated 5 months ago