Alternatives and similar repositories for tokenwiz:

Users that are interested in tokenwiz are comparing it to the libraries listed below

• enjalot / latent-data-modal
  Using modal.com to process FineWeb-edu data
  ☆20Updated last month
• taylorai / onnx_embedding_models
  utilities for loading and running text embeddings with onnx
  ☆44Updated 8 months ago
• s-smits / grpo-optuna
  Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna
  ☆39Updated 3 months ago
• neoxelox / dspy-inspector
  DSPy program/pipeline inspector widget for Jupyter/VSCode Notebooks.
  ☆34Updated last year
• jacoblee93 / oss-model-extraction-evals
  ☆32Updated last year
• fsndzomga / baby_agi_dspy
  a version of baby agi using dspy and typed predictors
  ☆17Updated last year
• multimodalart / grog
  Gradio UI for a Cog API
  ☆67Updated last year
• lucataco / cog-whisperspeech
  Cog wrapper for collabora/WhisperSpeech
  ☆25Updated last year
• aigeek0x0 / radiantloom-email-assist-7b
  Radiantloom Email Assist 7B is an email-assistant large language model fine-tuned from Zephyr-7B-Beta, over a custom-curated dataset of 1…
  ☆14Updated last year
• jbilcke-hf / atryon
  [WIP] AI Try-On plugin for Chrome
  ☆27Updated last year
• allenai / adapt-demos
  Lightweight tools for quick and easy LLM demo's
  ☆26Updated 7 months ago
• SonicCodes / subcloning
  implementation of https://arxiv.org/pdf/2312.09299
  ☆20Updated 10 months ago
• CarperAI / treasure_trove
  ☆22Updated last year
• ahmed-moubtahij / TokenHealer
  ☆22Updated 11 months ago
• FL33TW00D / embd
  GPU accelerated client-side embeddings for vector search, RAG etc.
  ☆66Updated last year
• mattneary / colorspace
  assign color hues to a collection of text fragments based on embeddings
  ☆20Updated 10 months ago
• Birch-san / llama-play
  Command-line script for inferencing from models such as LLaMA, in a chat scenario, with LoRA adaptations
  ☆33Updated last year
• hwchase17 / chain-of-verification
  ☆32Updated last year
• simonw / llm-anyscale-endpoints
  LLM plugin for models hosted by Anyscale Endpoints
  ☆33Updated last year
• nateraw / modal-examples
  Apps that run on modal.com
  ☆12Updated 11 months ago
• smol-ai / llama-fine-tuning-hackameetup
  The official repository for the Anything But Wrappers: Llama Edition Hackameetup
  ☆22Updated last year
• n4ze3m / vexasearch
  A function to do all
  ☆36Updated last year
• teknium1 / transformers-gptq-quant
  ☆48Updated last year
• swyxio / openlangmem
  ☆47Updated last year
• abetlen / program-constrained-language-model-sampling
  ☆35Updated 2 years ago
• hamelsmu / replicate-examples
  ☆22Updated last year
• interstellarninja / function-calling-eval
  A framework for evaluating function calls made by LLMs
  ☆37Updated 9 months ago
• louisbrulenaudet / ragoon
  High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡
  ☆66Updated 6 months ago
• Narsil / hf-chat
  ☆26Updated 4 months ago
• huggingface / discord-bots
  ☆50Updated last year