functorism / gpt4-tokenizer-visualizer
GPT4 Tokenizer Visualizer
☆22Updated last year
Alternatives and similar repositories for gpt4-tokenizer-visualizer:
Users that are interested in gpt4-tokenizer-visualizer are comparing it to the libraries listed below
- LIGHT is a platform for text-situated dialogue research. We originally hosted LIGHT as a live game with dialogue models in a grounded set…☆69Updated last year
- assign color hues to a collection of text fragments based on embeddings☆20Updated 8 months ago
- Browser-based Voice Assistant☆44Updated last year
- ☆22Updated last year
- GPU accelerated client-side embeddings for vector search, RAG etc.☆66Updated last year
- Generate visual podcasts about novels using open source models☆25Updated 2 years ago
- Image Generation API Server - Similar to https://text-generator.io but for images☆50Updated 3 months ago
- A new way to generate large quantities of high quality synthetic data (on par with GPT-4), with better controllability, at a fraction of …☆22Updated 5 months ago
- Aider's refactoring benchmark exercises based on popular python repos☆61Updated 5 months ago
- A clone of OpenAI's Tokenizer page for HuggingFace Models☆45Updated last year
- ☆30Updated last year
- ☆32Updated last year
- A re-implementation of Meta-Prompt in LangChain for building self-improving agents.☆63Updated last year
- ☆14Updated last month
- Based on the tree of thoughts paper☆46Updated last year
- Security measure for agentic LLMs using a council of AIs moderted by a veto system. The council judges an agent's actions outputs based o…☆37Updated last year
- Small, simple agent task environments for training and evaluation☆18Updated 4 months ago
- Lightweight tools for quick and easy LLM demo's☆26Updated 5 months ago
- ☆36Updated last year
- Using modal.com to process FineWeb-edu data☆20Updated last week
- a version of baby agi using dspy and typed predictors☆17Updated last year
- LLMs as Collaboratively Edited Knowledge Bases☆44Updated last year
- ☆38Updated 5 months ago
- A langchain app to visualise a debate using Tree-of-Thought reasoning☆59Updated last year
- ☆34Updated last year
- ☆11Updated 2 years ago
- [ICML 2023] "Outline, Then Details: Syntactically Guided Coarse-To-Fine Code Generation", Wenqing Zheng, S P Sharan, Ajay Kumar Jaiswal, …☆40Updated last year
- ☆33Updated last year
- ☆63Updated 5 months ago
- ☆26Updated last year