Alternatives and similar repositories for tokenwiz:

Users that are interested in tokenwiz are comparing it to the libraries listed below

• enjalot / latent-data-modal
  Using modal.com to process FineWeb-edu data
  ☆20Updated 2 weeks ago
• taylorai / onnx_embedding_models
  utilities for loading and running text embeddings with onnx
  ☆44Updated 7 months ago
• Birch-san / llama-play
  Command-line script for inferencing from models such as LLaMA, in a chat scenario, with LoRA adaptations
  ☆33Updated last year
• bhavnicksm / AyaMCooking
  🍳 AyaMCooking is a Voice-to-Voice Mutli-lingual RAG Agent that makes a perfect sous chef for your kitchen, in upto 10 Languages 🤌🧑‍🍳
  ☆21Updated 4 months ago
• multimodalart / grog
  Gradio UI for a Cog API
  ☆66Updated 11 months ago
• fsndzomga / baby_agi_dspy
  a version of baby agi using dspy and typed predictors
  ☆17Updated last year
• lucataco / cog-whisperspeech
  Cog wrapper for collabora/WhisperSpeech
  ☆25Updated last year
• simonw / llm-anyscale-endpoints
  LLM plugin for models hosted by Anyscale Endpoints
  ☆33Updated 10 months ago
• CarperAI / treasure_trove
  ☆22Updated last year
• neoxelox / dspy-inspector
  DSPy program/pipeline inspector widget for Jupyter/VSCode Notebooks.
  ☆32Updated last year
• cfahlgren1 / hf-data-explorer
  Chrome Extension for exploring Hugging Face datasets 🔎
  ☆49Updated 6 months ago
• FL33TW00D / embd
  GPU accelerated client-side embeddings for vector search, RAG etc.
  ☆66Updated last year
• simonw / llm-embed-jina
  Embedding models from Jina AI
  ☆58Updated last year
• jbilcke-hf / atryon
  [WIP] AI Try-On plugin for Chrome
  ☆27Updated last year
• fxnai / fxn
  Run Python functions on desktop, mobile, web, and in the cloud. https://fxn.ai/explore
  ☆40Updated last week
• SonicCodes / subcloning
  implementation of https://arxiv.org/pdf/2312.09299
  ☆20Updated 8 months ago
• mattneary / colorspace
  assign color hues to a collection of text fragments based on embeddings
  ☆20Updated 9 months ago
• ChrisHayduk / QLoRA-for-MLM
  QLoRA for Masked Language Modeling
  ☆21Updated last year
• catid / lllm
  Latent Large Language Models
  ☆17Updated 6 months ago
• raphaelsty / LeNLP
  NLP with Rust for Python 🦀🐍
  ☆61Updated 9 months ago
• cg123 / rathe
  Tools for formatting large language model prompts.
  ☆12Updated last year
• Muhtasham / summarization-eval
  📝 Reference-Free automatic summarization evaluation with potential hallucination detection
  ☆100Updated last year
• nateraw / modal-examples
  Apps that run on modal.com
  ☆12Updated 9 months ago
• simonw / llm-embed-onnx
  Run embedding models using ONNX
  ☆31Updated last year
• JD-P / RetroInstruct
  Synthetic data derived by templating, few shot prompting, transformations on public domain corpora, and monte carlo tree search.
  ☆31Updated 2 weeks ago
• Birch-san / booru-embed
  [WIP] Transformer to embed Danbooru labelsets
  ☆13Updated 11 months ago
• jacoblee93 / oss-model-extraction-evals
  ☆31Updated last year