antirez / LLM-FTC-samplingLinks
First token cutoff sampling inference example
☆30Updated last year
Alternatives and similar repositories for LLM-FTC-sampling
Users that are interested in LLM-FTC-sampling are comparing it to the libraries listed below
Sorting:
- Tooling for exact and MinHash deduplication of large-scale text datasets☆51Updated last week
- The official evaluation suite and dynamic data release for MixEval.☆11Updated last year
- Benchmarks comparing PyTorch and MLX on Apple Silicon GPUs☆92Updated last year
- Transformer GPU VRAM estimator☆67Updated last year
- Training hybrid models for dummies.☆29Updated 2 months ago
- Trace LLM calls (and others) and visualize them in WandB, as interactive SVG or using a streaming local webapp☆14Updated 10 months ago
- an implementation of Self-Extend, to expand the context window via grouped attention☆119Updated 2 years ago
- Because it's there.☆16Updated last year
- Pivotal Token Search☆142Updated 3 weeks ago
- ☆12Updated last year
- ☆43Updated last week
- Like picoGPT but for BERT.☆51Updated 2 years ago
- NanoGPT (124M) quality in 2.67B tokens☆28Updated 3 months ago
- IBM development fork of https://github.com/huggingface/text-generation-inference☆62Updated 3 months ago
- 🛠 Self-hosted, fast, and consistent remote configuration for apps.☆16Updated 3 years ago
- Simple high-throughput inference library☆155Updated 7 months ago
- Aana SDK is a powerful framework for building AI enabled multimodal applications.☆55Updated 4 months ago
- Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and min…☆26Updated last year
- ☆21Updated last year
- Turing machines, Rule 110, and A::B reversal using Claude 3 Opus.☆58Updated last year
- Benchmarking suite for popular AI APIs☆88Updated 11 months ago
- Prepare for DeekSeek R1 inference: Benchmark CPU, DRAM, SSD, iGPU, GPU, ... with efficient code.☆73Updated 11 months ago
- Notus is a collection of fine-tuned LLMs using SFT, DPO, SFT+DPO, and/or any other RLHF techniques, while always keeping a data-first app…☆169Updated last year
- A minimalistic C++ Jinja templating engine for LLM chat templates☆202Updated 3 months ago
- A super simple web interface to perform blind tests on LLM outputs.☆29Updated last year
- inference code for mixtral-8x7b-32kseqlen☆105Updated 2 years ago
- Implementation of nougat that focuses on processing pdf locally.☆83Updated 11 months ago
- Public repository containing METR's DVC pipeline for eval data analysis☆178Updated 9 months ago
- Your buddy in the (L)LM space.☆64Updated last year
- Lightweight tools for quick and easy LLM demo's☆28Updated last year