belladoreai / llama-tokenizer-js

Related projects ⓘ

Alternatives and complementary repositories for llama-tokenizer-js

• replicate / cog-llama-template
  LLaMA Cog template
  ☆306Updated 9 months ago
• lastmile-ai / llama-retrieval-plugin
  LLaMa retrieval plugin script using OpenAI's retrieval plugin
  ☆324Updated last year
• okuvshynov / slowllama
  Finetune llama2-70b and codellama on MacBook Air without quantization
  ☆447Updated 7 months ago
• r2d4 / openlm
  OpenAI-compatible Python client that can call any LLM
  ☆366Updated last year
• simonmesmith / agentflow
  Complex LLM Workflows from Simple JSON.
  ☆280Updated last year
• automorphic-ai / trex
  Enforce structured output from LLMs 100% of the time
  ☆241Updated 4 months ago
• eugenepentland / landmark-attention-qlora
  Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA
  ☆124Updated last year
• IntrinsicLabsAI / gbnfgen
  TypeScript generator for llama.cpp Grammar directly from TypeScript interfaces
  ☆131Updated 4 months ago
• cognitivecomputations / OpenChatML
  ☆149Updated 4 months ago
• lxe / wasm-gpt
  Tensor library for machine learning
  ☆279Updated last year
• ColinEberhardt / langchain-mini
  🦜️🔗 This is a very simple re-implementation of LangChain, in ~100 lines of code
  ☆250Updated last year
• migtissera / Sensei
  Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAI
  ☆221Updated 6 months ago
• newhouseb / clownfish
  Constrained Decoding for LLMs against JSON Schema
  ☆322Updated last year
• npi-ai / npi
  Action library for AI Agent
  ☆191Updated 2 weeks ago
• togethercomputer / redpajama.cpp
  Extend the original llama.cpp repo to support redpajama model.
  ☆117Updated 2 months ago
• definitive-io / code-indexer-loop
  Code Indexer Loop is a Python library for indexing and retrieving source code files through an integrated vector database that's continuo…
  ☆169Updated 7 months ago
• nestordemeure / question_extractor
  Generate question/answer training pairs out of raw text.
  ☆204Updated 11 months ago
• taprosoft / llm_finetuning
  Convenient wrapper for fine-tuning and inference of Large Language Models (LLMs) with several quantization techniques (GTPQ, bitsandbytes…
  ☆145Updated last year
• FL33TW00D / laserbeak
  Add local LLMs to your Web or Electron apps! Powered by Rust + WebGPU
  ☆102Updated last year
• valine / NeuralFlow
  Visualize the intermediate output of Mistral 7B
  ☆313Updated 9 months ago
• kayvr / token-hawk
  WebGPU LLM inference tuned by hand
  ☆147Updated last year
• traceloop / openllmetry-js
  Sister project to OpenLLMetry, but in Typescript. Open-source observability for your LLM application, based on OpenTelemetry
  ☆266Updated last week
• distantmagic / paddler
  Stateful load balancer custom-tailored for llama.cpp
  ☆563Updated this week
• belladoreai / llama3-tokenizer-js
  JS tokenizer for LLaMA 3 and LLaMA 3.1
  ☆91Updated 3 months ago
• SkunkworksAI / hydra-moe
  ☆411Updated last year
• llmonpy / needle-in-a-needlestack
  ☆113Updated 3 weeks ago
• tangledgroup / llama-cpp-wasm
  WebAssembly (Wasm) Build and Bindings for llama.cpp
  ☆213Updated 3 months ago
• cohere-ai / cohere-terrarium
  A simple Python sandbox for helpful LLM data agents
  ☆170Updated 5 months ago