javirandor / anthropic-tokenizerLinks
Approximation of the Claude 3 tokenizer by inspecting generation stream
☆140Updated last year
Alternatives and similar repositories for anthropic-tokenizer
Users that are interested in anthropic-tokenizer are comparing it to the libraries listed below
Sorting:
- Just a bunch of benchmark logs for different LLMs☆119Updated last year
- Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAI☆221Updated last year
- Steer LLM outputs towards a certain topic/subject and enhance response capabilities using activation engineering by adding steering vecto…☆246Updated 7 months ago
- Fully fine-tune large models like Mistral, Llama-2-13B, or Qwen-14B completely for free☆231Updated 11 months ago
- Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.☆83Updated 2 years ago
- ☆162Updated 2 months ago
- ☆116Updated 9 months ago
- Use the OpenAI Batch tool to make async batch requests to the OpenAI API.☆100Updated last year
- Sphynx Hallucination Induction☆53Updated 8 months ago
- ☆166Updated 9 months ago
- A subset of jailbreaks automatically discovered by the Haize Labs haizing suite.☆96Updated 5 months ago
- an implementation of Self-Extend, to expand the context window via grouped attention☆118Updated last year
- Track the progress of LLM context utilisation☆55Updated 5 months ago
- Function Calling Benchmark & Testing☆90Updated last year
- clean up your LLM datasets☆114Updated 2 years ago
- Low-Rank adapter extraction for fine-tuned transformers models☆178Updated last year
- MiniHF is an inference, human preference data collection, and fine-tuning tool for local language models. It is intended to help the user…☆181Updated 2 months ago
- Mixing Language Models with Self-Verification and Meta-Verification☆110Updated 9 months ago
- Doing simple retrieval from LLM models at various context lengths to measure accuracy☆104Updated 2 weeks ago
- Red-Teaming Language Models with DSPy☆216Updated 7 months ago
- An easy-to-understand framework for LLM samplers that rewind and revise generated tokens☆146Updated 7 months ago
- ☆74Updated 2 years ago
- Synthetic Data for LLM Fine-Tuning☆120Updated last year
- ☆135Updated last year
- ⚖️ Awesome LLM Judges ⚖️☆130Updated 5 months ago
- inference code for mixtral-8x7b-32kseqlen☆101Updated last year
- ☆123Updated last year
- ☆121Updated last year
- A comprehensive repository of reasoning tasks for LLMs (and beyond)☆450Updated last year
- Run GGML models with Kubernetes.☆174Updated last year