antirez / LLM-FTC-samplingLinks
First token cutoff sampling inference example
☆31Updated last year
Alternatives and similar repositories for LLM-FTC-sampling
Users that are interested in LLM-FTC-sampling are comparing it to the libraries listed below
Sorting:
- Benchmarks comparing PyTorch and MLX on Apple Silicon GPUs☆92Updated last year
- Trace LLM calls (and others) and visualize them in WandB, as interactive SVG or using a streaming local webapp☆14Updated 10 months ago
- Because it's there.☆16Updated last year
- Tooling for exact and MinHash deduplication of large-scale text datasets☆44Updated last week
- Using modal.com to process FineWeb-edu data☆20Updated 8 months ago
- ☆42Updated last week
- A super simple web interface to perform blind tests on LLM outputs.☆29Updated last year
- A minimalistic C++ Jinja templating engine for LLM chat templates☆202Updated 3 months ago
- run embeddings in MLX☆96Updated last year
- Pivotal Token Search☆135Updated this week
- Your buddy in the (L)LM space.☆64Updated last year
- Chat Markup Language conversation library☆55Updated last year
- The official evaluation suite and dynamic data release for MixEval.☆11Updated last year
- ☆45Updated 2 months ago
- Turing machines, Rule 110, and A::B reversal using Claude 3 Opus.☆58Updated last year
- Like picoGPT but for BERT.☆51Updated 2 years ago
- Simple high-throughput inference library☆152Updated 7 months ago
- Implementation of nougat that focuses on processing pdf locally.☆83Updated 11 months ago
- Latent Large Language Models☆19Updated last year
- an implementation of Self-Extend, to expand the context window via grouped attention☆119Updated last year
- Transformer GPU VRAM estimator☆67Updated last year
- Aana SDK is a powerful framework for building AI enabled multimodal applications.☆54Updated 4 months ago
- NanoGPT (124M) quality in 2.67B tokens☆28Updated 3 months ago
- ☆21Updated last year
- C API for MLX☆155Updated this week
- GGUF implementation in C as a library and a tools CLI program☆296Updated 3 months ago
- look how they massacred my boy☆63Updated last year
- Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna☆59Updated 2 months ago
- Training hybrid models for dummies.☆29Updated last month
- Training code for Sparse Autoencoders on Embedding models☆39Updated 9 months ago