Alternatives and similar repositories for gpt4-tokenizer-visualizer

Users that are interested in gpt4-tokenizer-visualizer are comparing it to the libraries listed below

• FL33TW00D / embd
  GPU accelerated client-side embeddings for vector search, RAG etc.
  ☆65Updated 2 years ago
• mbusigin / yaml-runner
  ☆57Updated 2 years ago
• CarperAI / treasure_trove
  ☆22Updated 2 years ago
• TheDuckAI / DuckTrack
  Multimodal computer agent data collection program
  ☆161Updated 2 months ago
• granawkins / latent-dictionary
  A dictionary, but it shows you position in embedding space relative to some synonyms/antonyms instead of a definition.
  ☆74Updated 2 months ago
• mattneary / colorspace
  assign color hues to a collection of text fragments based on embeddings
  ☆20Updated last year
• marlaman / DebateTree
  A langchain app to visualise a debate using Tree-of-Thought reasoning
  ☆62Updated last year
• benlipkin / probsem
  Probabilistic LLM evaluations. [CogSci2023; ACL2023]
  ☆73Updated last year
• Gentopia-AI / GentPool
  Gentopia Agent Zoo and Agent Benchmark
  ☆31Updated 2 years ago
• emrgnt-cmplxty / zero-shot-replication
  ☆74Updated 2 years ago
• GammaTauAI / opentau
  Using Large Language Models for Repo-wide Type Prediction
  ☆114Updated 2 years ago
• Agora-Lab-AI / The-Distiller
  Generate High Quality textual or multi-modal datasets with Agents
  ☆18Updated 2 years ago
• yoheinakajima / asymmetrix
  ☆132Updated 2 years ago
• alexrs / herd
  Mixture of Expert (MoE) techniques for enhancing LLM performance through expert-driven prompt mapping and adapter combinations.
  ☆12Updated last year
• 1rgs / tokenwiz
  A clone of OpenAI's Tokenizer page for HuggingFace Models
  ☆46Updated 2 years ago
• JoshuaPurtell / SmallBench
  Small, simple agent task environments for training and evaluation
  ☆19Updated last year
• aidangomez / weblm
  Drive a browser with Cohere
  ☆72Updated 2 years ago
• Watchfulio / dataset-generator
  A new way to generate large quantities of high quality synthetic data (on par with GPT-4), with better controllability, at a fraction of …
  ☆23Updated last year
• stunningpixels / lou-eval
  Track the progress of LLM context utilisation
  ☆55Updated 9 months ago
• facebookresearch / LIGHT
  LIGHT is a platform for text-situated dialogue research. We originally hosted LIGHT as a live game with dialogue models in a grounded set…
  ☆70Updated 2 years ago
• scottlogic-alex / prm800k-denorm
  Script for processing OpenAI's PRM800K process supervision dataset into an Alpaca-style instruction-response format
  ☆27Updated 2 years ago
• toufunao / SCM4LLMs
  ☆33Updated 2 years ago
• normal-computing / branches
  Prototype advanced LLM algorithms for reasoning and planning.
  ☆99Updated last year
• rawsh / mirrorllm
  various experiments for scaling inference time compute with small reasoning models
  ☆17Updated last year
• hongyishi / gpt-index-extension
  GPT Index Extension for Google Chrome
  ☆42Updated 3 years ago
• minalee-research / coauthor-interface
  ☆100Updated last year
• swarnaHub / ExplanationIntervention
  [NeurIPS 2023] PyTorch code for Can Language Models Teach? Teacher Explanations Improve Student Performance via Theory of Mind
  ☆66Updated 2 years ago
• huu4ontocord / MDEL
  Multi-Domain Expert Learning
  ☆67Updated 2 years ago
• abetlen / ai-voice-chat
  Browser-based Voice Assistant
  ☆43Updated 2 years ago
• fsndzomga / baby_agi_dspy
  a version of baby agi using dspy and typed predictors
  ☆16Updated last year