belladoreai / llama3-tokenizer-js
JS tokenizer for LLaMA 3 and LLaMA 3.1
☆91Updated 3 months ago
Related projects ⓘ
Alternatives and complementary repositories for llama3-tokenizer-js
- JS tokenizer for LLaMA 1 and 2☆343Updated 4 months ago
- WebAssembly (Wasm) Build and Bindings for llama.cpp☆214Updated 3 months ago
- Low-Rank adapter extraction for fine-tuned transformers model☆162Updated 6 months ago
- GPT-2 small trained on phi-like data☆65Updated 9 months ago
- BlinkDL's RWKV-v4 running in the browser☆46Updated last year
- An unsupervised model merging algorithm for Transformers-based language models.☆100Updated 6 months ago
- TypeScript generator for llama.cpp Grammar directly from TypeScript interfaces☆131Updated 4 months ago
- Let's create synthetic textbooks together :)☆70Updated 9 months ago
- an implementation of Self-Extend, to expand the context window via grouped attention☆118Updated 10 months ago
- Full finetuning of large language models without large memory requirements☆93Updated 10 months ago
- ☆149Updated 4 months ago
- Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAI☆221Updated 6 months ago
- Self-hosted LLM chatbot arena, with yourself as the only judge☆36Updated 9 months ago
- A client side vector search library that can embed, store, search, and cache vectors. Works on the browser and node. It outperforms OpenA…☆170Updated 5 months ago
- Inference Llama 2 in one file of pure JavaScript(HTML)☆30Updated 4 months ago
- Run Large-Language Models (LLMs) 🚀 directly in your browser!☆167Updated 2 months ago
- GPU accelerated client-side embeddings for vector search, RAG etc.☆63Updated 11 months ago
- ☆31Updated 10 months ago
- A multimodal, function calling powered LLM webui.☆208Updated last month
- ☆55Updated last year
- ☆102Updated last week
- A benchmark for emotional intelligence in large language models☆197Updated 3 months ago
- Pressure testing the context window of open LLMs☆22Updated 2 months ago
- ☆118Updated 3 months ago
- SemanticFinder - frontend-only live semantic search with transformers.js☆233Updated 2 months ago
- Unofficial python bindings for the rust llm library. 🐍❤️🦀☆73Updated last year
- ☆136Updated 11 months ago
- ☆50Updated 3 weeks ago