1rgs / tokenwiz
A clone of OpenAI's Tokenizer page for HuggingFace Models
☆45Updated last year
Alternatives and similar repositories for tokenwiz:
Users that are interested in tokenwiz are comparing it to the libraries listed below
- Using modal.com to process FineWeb-edu data☆20Updated last week
- utilities for loading and running text embeddings with onnx☆44Updated 7 months ago
- LLM plugin for models hosted by Anyscale Endpoints☆33Updated 10 months ago
- Cog wrapper for collabora/WhisperSpeech☆25Updated last year
- DSPy program/pipeline inspector widget for Jupyter/VSCode Notebooks.☆32Updated last year
- Gradio UI for a Cog API☆66Updated 11 months ago
- GPU accelerated client-side embeddings for vector search, RAG etc.☆66Updated last year
- a version of baby agi using dspy and typed predictors☆17Updated last year
- implementation of https://arxiv.org/pdf/2312.09299☆20Updated 8 months ago
- ☆48Updated last year
- Command-line script for inferencing from models such as LLaMA, in a chat scenario, with LoRA adaptations☆33Updated last year
- ☆22Updated last year
- ☆30Updated last year
- Chrome Extension for exploring Hugging Face datasets 🔎☆49Updated 5 months ago
- [WIP] AI Try-On plugin for Chrome☆27Updated 11 months ago
- Run LLMs on Replicate with vLLM☆16Updated 5 months ago
- Latent Large Language Models☆17Updated 6 months ago
- Radiantloom Email Assist 7B is an email-assistant large language model fine-tuned from Zephyr-7B-Beta, over a custom-curated dataset of 1…☆14Updated last year
- assign color hues to a collection of text fragments based on embeddings☆20Updated 8 months ago
- ☆31Updated last year
- Apps that run on modal.com☆12Updated 9 months ago
- The official repository for the Anything But Wrappers: Llama Edition Hackameetup☆22Updated last year
- Chat Markup Language conversation library☆55Updated last year
- [WIP] Transformer to embed Danbooru labelsets☆13Updated 11 months ago
- Training hybrid models for dummies.☆20Updated last month
- Writing Blog Posts with Generative Feedback Loops!☆47Updated 11 months ago
- Not financial advice.☆28Updated last year
- A feed of trending repos/models from GitHub, Replicate, HuggingFace, and Reddit.☆121Updated 6 months ago