lenML / tokenizersLinks
a lightweight no-dependency fork from transformers.js (only tokenizers)
☆20Updated 2 months ago
Alternatives and similar repositories for tokenizers
Users that are interested in tokenizers are comparing it to the libraries listed below
Sorting:
- Browse, search, and visualize ONNX models.☆32Updated 2 months ago
- Simple structured data from any LLM☆44Updated 2 months ago
- Annotated AST for the purposes of LLM code repository context. Use this novel approach to pre-process your Github repository. This projec…☆32Updated 7 months ago
- Parallel wasm Barnes-Hut t-SNE implementation written in Rust.☆21Updated last year
- Using embeddings compressed by Product Quantization, in Javascript☆31Updated 2 years ago
- GPU accelerated client-side embeddings for vector search, RAG etc.☆66Updated last year
- The official Node.js / Typescript library for the Steel API☆14Updated last week
- llama.cpp gguf file parser for javascript☆43Updated 7 months ago
- A SQLite extension for generating text embeddings from remote APIs (OpenAI, Nomic, Ollama, llamafile...)☆130Updated 8 months ago
- LLM tools used in production at Dexa☆100Updated 6 months ago
- ☆31Updated last year
- GLiNER inference in JavaScript☆19Updated 4 months ago
- JavaScript implementation of LiteLLM.☆129Updated 4 months ago
- Chrome Extension for exploring Hugging Face datasets 🔎☆50Updated 10 months ago
- ☆46Updated 3 months ago
- iterate quickly with llama.cpp hot reloading. use the llama.cpp bindings with bun.sh☆50Updated last year
- Library to generate vector embeddings in NodeJS☆136Updated 3 months ago
- Vercel and web-llm template to run wasm models directly in the browser.☆160Updated last year
- Structured inference with Llama 2 in your browser☆52Updated 8 months ago
- ☆26Updated 8 months ago
- Keep searching, reading webpages, reasoning until it finds the answer (or exceeding the token budget)☆59Updated 4 months ago
- A demo that shows how to build a semantic search experience with Typesense's vector search feature and Instantsearch.js☆27Updated last year
- TypeScript generator for llama.cpp Grammar directly from TypeScript interfaces☆137Updated last year
- CodeMirror extension to hook up a Model Context Provider (MCP)☆74Updated 6 months ago
- A JavaScript implementation of Llama 3 using node-mlx.☆73Updated last year
- Platformatic Stackable to interact with AI services☆19Updated this week
- Powerfully simple AI agent framework.☆31Updated 6 months ago
- AskIt (for JavaScript/TypeScript): Unified programming interface for large language models (GPT-4, GPT-3.5)☆34Updated last year
- ☆16Updated 4 months ago
- ☆32Updated 11 months ago