antirez / LLM-FTC-samplingLinks
First token cutoff sampling inference example
☆30Updated last year
Alternatives and similar repositories for LLM-FTC-sampling
Users that are interested in LLM-FTC-sampling are comparing it to the libraries listed below
Sorting:
- Benchmarks comparing PyTorch and MLX on Apple Silicon GPUs☆88Updated last year
- Pivotal Token Search☆126Updated 2 months ago
- Because it's there.☆16Updated last year
- The official evaluation suite and dynamic data release for MixEval.☆11Updated last year
- ☆20Updated 11 months ago
- Vector Database with support for late interaction and token level embeddings.☆55Updated 3 months ago
- Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and min…☆25Updated 11 months ago
- High-performance MinHash implementation in Rust with Python bindings for efficient similarity estimation and deduplication of large datas…☆204Updated this week
- Simple high-throughput inference library☆142Updated 4 months ago
- A minimalistic C++ Jinja templating engine for LLM chat templates☆187Updated 2 weeks ago
- Aana SDK is a powerful framework for building AI enabled multimodal applications.☆52Updated last month
- SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?☆181Updated last week
- Transformer GPU VRAM estimator☆66Updated last year
- Implementation of nougat that focuses on processing pdf locally.☆83Updated 8 months ago
- Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna☆55Updated 8 months ago
- 🛠 Self-hosted, fast, and consistent remote configuration for apps.☆16Updated 2 years ago
- an implementation of Self-Extend, to expand the context window via grouped attention☆118Updated last year
- Prepare for DeekSeek R1 inference: Benchmark CPU, DRAM, SSD, iGPU, GPU, ... with efficient code.☆73Updated 8 months ago
- XTR: Rethinking the Role of Token Retrieval in Multi-Vector Retrieval☆58Updated last year
- ☆25Updated last month
- Using modal.com to process FineWeb-edu data☆20Updated 6 months ago
- Chat Markup Language conversation library☆55Updated last year
- C API for MLX☆137Updated 2 weeks ago
- NanoGPT (124M) quality in 2.67B tokens☆28Updated 3 weeks ago
- Turing machines, Rule 110, and A::B reversal using Claude 3 Opus.☆58Updated last year
- Benchmarking suite for popular AI APIs☆87Updated 8 months ago
- ☆15Updated last year
- A Learning Journey: Micrograd in Mojo 🔥☆62Updated 11 months ago
- Embedding models from Jina AI☆65Updated last year
- ☆12Updated last year