antirez / LLM-FTC-samplingLinks
First token cutoff sampling inference example
☆31Updated last year
Alternatives and similar repositories for LLM-FTC-sampling
Users that are interested in LLM-FTC-sampling are comparing it to the libraries listed below
Sorting:
- Trace LLM calls (and others) and visualize them in WandB, as interactive SVG or using a streaming local webapp☆14Updated 6 months ago
- Pivotal Token Search☆121Updated last month
- Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and min…☆26Updated 9 months ago
- A minimalistic C++ Jinja templating engine for LLM chat templates☆170Updated 3 weeks ago
- an implementation of Self-Extend, to expand the context window via grouped attention☆118Updated last year
- GGML implementation of BERT model with Python bindings and quantization.☆57Updated last year
- Chat Markup Language conversation library☆55Updated last year
- Your buddy in the (L)LM space.☆64Updated 11 months ago
- Aana SDK is a powerful framework for building AI enabled multimodal applications.☆52Updated this week
- Using modal.com to process FineWeb-edu data☆20Updated 4 months ago
- Transformer GPU VRAM estimator☆66Updated last year
- Because it's there.☆16Updated 11 months ago
- This repository is designed for deploying and managing server processes that handle embeddings using the Infinity Embedding model or Larg…☆24Updated 5 months ago
- Turing machines, Rule 110, and A::B reversal using Claude 3 Opus.☆58Updated last year
- The official evaluation suite and dynamic data release for MixEval.☆11Updated 11 months ago
- Lightweight tools for quick and easy LLM demo's☆28Updated 11 months ago
- ☆20Updated 10 months ago
- ☆12Updated last year
- A clone of OpenAI's Tokenizer page for HuggingFace Models☆45Updated last year
- Training code for Sparse Autoencoders on Embedding models☆38Updated 6 months ago
- inference code for mixtral-8x7b-32kseqlen☆101Updated last year
- Vector Database with support for late interaction and token level embeddings.☆55Updated 2 months ago
- Zeus LLM Trainer is a rewrite of Stanford Alpaca aiming to be the trainer for all Large Language Models☆70Updated 2 years ago
- ☆46Updated last year
- Alice in Wonderland code base for experiments and raw experiments data☆131Updated 3 weeks ago
- look how they massacred my boy☆64Updated 10 months ago
- A super simple web interface to perform blind tests on LLM outputs.☆28Updated last year
- LLM plugin for models hosted by Anyscale Endpoints☆35Updated last year
- Thin wrapper around GGML to make life easier☆40Updated 2 months ago
- Senna is an advanced AI-powered search engine designed to provide users with immediate answers to their queries by leveraging natural lan…☆19Updated 11 months ago