antirez / LLM-FTC-samplingLinks
First token cutoff sampling inference example
☆30Updated 2 years ago
Alternatives and similar repositories for LLM-FTC-sampling
Users that are interested in LLM-FTC-sampling are comparing it to the libraries listed below
Sorting:
- an implementation of Self-Extend, to expand the context window via grouped attention☆119Updated 2 years ago
- Tooling for exact and MinHash deduplication of large-scale text datasets☆65Updated 3 weeks ago
- Training hybrid models for dummies.☆29Updated 3 months ago
- Pivotal Token Search☆144Updated last month
- NanoGPT (124M) quality in 2.67B tokens☆28Updated 4 months ago
- Transformer GPU VRAM estimator☆68Updated last year
- Simple high-throughput inference library☆155Updated 8 months ago
- The Engineer's Guide to Deep-Learning☆36Updated last year
- Vector Database with support for late interaction and token level embeddings.☆54Updated 7 months ago
- ☆92Updated last week
- Turing machines, Rule 110, and A::B reversal using Claude 3 Opus.☆58Updated last year
- Aana SDK is a powerful framework for building AI enabled multimodal applications.☆55Updated 5 months ago
- look how they massacred my boy☆63Updated last year
- Because it's there.☆16Updated last year
- A minimalistic C++ Jinja templating engine for LLM chat templates☆203Updated 4 months ago
- A super simple web interface to perform blind tests on LLM outputs.☆29Updated last year
- 🛠 Self-hosted, fast, and consistent remote configuration for apps.☆17Updated 3 years ago
- Benchmarks comparing PyTorch and MLX on Apple Silicon GPUs☆93Updated 2 weeks ago
- C API for MLX☆172Updated this week
- Implementation of nougat that focuses on processing pdf locally.☆84Updated last year
- Prepare for DeekSeek R1 inference: Benchmark CPU, DRAM, SSD, iGPU, GPU, ... with efficient code.☆74Updated last year
- XTR/WARP (SIGIR'25) is an extremely fast and accurate retrieval engine based on Stanford's ColBERTv2/PLAID and Google DeepMind's XTR.☆181Updated 9 months ago
- ☆44Updated this week
- Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna☆59Updated 3 months ago
- Trace LLM calls (and others) and visualize them in WandB, as interactive SVG or using a streaming local webapp☆14Updated 11 months ago
- SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?☆259Updated last month
- Just a bunch of benchmark logs for different LLMs☆119Updated last year
- Public reports detailing responses to sets of prompts by Large Language Models.☆32Updated last year
- GGUF implementation in C as a library and a tools CLI program☆301Updated 5 months ago
- ☆15Updated 7 months ago