antirez / LLM-FTC-samplingLinks
First token cutoff sampling inference example
☆30Updated last year
Alternatives and similar repositories for LLM-FTC-sampling
Users that are interested in LLM-FTC-sampling are comparing it to the libraries listed below
Sorting:
- Using modal.com to process FineWeb-edu data☆20Updated 4 months ago
- an implementation of Self-Extend, to expand the context window via grouped attention☆119Updated last year
- Transformer GPU VRAM estimator☆66Updated last year
- A minimalistic C++ Jinja templating engine for LLM chat templates☆163Updated 3 weeks ago
- Pivotal Token Search☆118Updated 3 weeks ago
- Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna☆55Updated 6 months ago
- Because it's there.☆16Updated 10 months ago
- A super simple web interface to perform blind tests on LLM outputs.☆28Updated last year
- Trace LLM calls (and others) and visualize them in WandB, as interactive SVG or using a streaming local webapp☆14Updated 5 months ago
- Latent Large Language Models☆18Updated 11 months ago
- ☆20Updated 9 months ago
- Turing machines, Rule 110, and A::B reversal using Claude 3 Opus.☆58Updated last year
- Lightweight tools for quick and easy LLM demo's☆28Updated 10 months ago
- ☆38Updated last year
- Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and min…☆26Updated 8 months ago
- Aana SDK is a powerful framework for building AI enabled multimodal applications.☆51Updated this week
- ☆13Updated last year
- Implementation of nougat that focuses on processing pdf locally.☆81Updated 6 months ago
- Chat Markup Language conversation library☆55Updated last year
- utilities for loading and running text embeddings with onnx☆44Updated last year
- Just a bunch of benchmark logs for different LLMs☆119Updated last year
- Benchmarks comparing PyTorch and MLX on Apple Silicon GPUs☆88Updated last year
- Rust Implementation of micrograd☆52Updated last year
- A collection of optimizers for MLX☆37Updated this week
- look how they massacred my boy☆63Updated 9 months ago
- Your buddy in the (L)LM space.☆64Updated 10 months ago
- Simple high-throughput inference library☆125Updated 2 months ago
- Alice in Wonderland code base for experiments and raw experiments data☆131Updated last month
- GGUF implementation in C as a library and a tools CLI program☆277Updated 6 months ago
- ☆15Updated last year