lenML / tokenizersLinks
a lightweight no-dependency fork from transformers.js (only tokenizers)
☆20Updated 3 weeks ago
Alternatives and similar repositories for tokenizers
Users that are interested in tokenizers are comparing it to the libraries listed below
Sorting:
- Simple structured data from any LLM☆41Updated 2 weeks ago
- GPU accelerated client-side embeddings for vector search, RAG etc.☆66Updated last year
- A JavaScript implementation of Llama 3 using node-mlx.☆72Updated 10 months ago
- GLiNER inference in JavaScript☆12Updated 3 months ago
- ☆30Updated last year
- A demo that shows how to build a semantic search experience with Typesense's vector search feature and Instantsearch.js☆27Updated last year
- ☆21Updated 4 months ago
- Parallel wasm Barnes-Hut t-SNE implementation written in Rust.☆20Updated 11 months ago
- ☆24Updated 6 months ago
- Vector functions and indexing for SQLite☆11Updated 2 years ago
- Proof of concept for a generative AI application framework powered by WebAssembly and Extism☆14Updated last year
- Keep searching, reading webpages, reasoning until it finds the answer (or exceeding the token budget)☆57Updated 3 months ago
- You need a few lines of JS, not a vector database.☆19Updated 8 months ago
- JavaScript implementation of LiteLLM.☆126Updated 2 months ago
- An embedded Weaviate database with TypeScript client interface☆11Updated 11 months ago
- Add local LLMs to your Web or Electron apps! Powered by Rust + WebGPU☆102Updated last year
- Structured inference with Llama 2 in your browser☆52Updated 7 months ago
- Annotated AST for the purposes of LLM code repository context. Use this novel approach to pre-process your Github repository. This projec…☆28Updated 5 months ago
- LLM tools used in production at Dexa☆99Updated 4 months ago
- Create embeddings with infinity as serverless endpoint☆29Updated 2 weeks ago
- iterate quickly with llama.cpp hot reloading. use the llama.cpp bindings with bun.sh☆47Updated last year
- ☆30Updated 9 months ago
- Powered by SideGuide and GPT-3☆12Updated 2 years ago
- Create shockingly realistic automated software videos! The backend / CLI tool from CodeVideo to create videos.☆8Updated 2 months ago
- SDK for the Tavily search API which is tailored for LLM agents.☆13Updated last year
- Automagically generates summaries from html or text.☆66Updated 2 years ago
- Hierarchical Navigable Small Worlds in the browser☆60Updated 5 months ago
- Repair incomplete JSON (e.g. from streaming APIs or AI models) so it can be parsed as it's received.☆33Updated last year
- Using embeddings compressed by Product Quantization, in Javascript☆31Updated last year
- webassembly binding for Hora Approximate Nearest Neighbor Search Library☆58Updated 3 years ago