antirez / LLM-FTC-samplingLinks
First token cutoff sampling inference example
☆29Updated last year
Alternatives and similar repositories for LLM-FTC-sampling
Users that are interested in LLM-FTC-sampling are comparing it to the libraries listed below
Sorting:
- The official evaluation suite and dynamic data release for MixEval.☆11Updated 8 months ago
- LLama implementations benchmarking framework☆12Updated last year
- A super simple web interface to perform blind tests on LLM outputs.☆28Updated last year
- Trace LLM calls (and others) and visualize them in WandB, as interactive SVG or using a streaming local webapp☆14Updated 3 months ago
- A text-to-SQL prototype on the northwind sqlite dataset☆12Updated 8 months ago
- Training hybrid models for dummies.☆21Updated 4 months ago
- Because it's there.☆16Updated 8 months ago
- Prepare for DeekSeek R1 inference: Benchmark CPU, DRAM, SSD, iGPU, GPU, ... with efficient code.☆72Updated 3 months ago
- Nexusflow function call, tool use, and agent benchmarks.☆19Updated 5 months ago
- Latent Large Language Models☆18Updated 9 months ago
- Benchmarks comparing PyTorch and MLX on Apple Silicon GPUs☆81Updated 10 months ago
- ☆15Updated 2 months ago
- Inference Llama/Llama2/Llama3 Modes in NumPy☆21Updated last year
- TRITONCACHE implementation of a Redis cache☆13Updated 2 weeks ago
- Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks☆31Updated last year
- Visualize expert firing frequencies across sentences in the Mixtral MoE model☆18Updated last year
- ☆19Updated 4 months ago
- The code repository for the CURLoRA research paper. Stable LLM continual fine-tuning and catastrophic forgetting mitigation.☆44Updated 9 months ago
- An example implementation of RLHF (or, more accurately, RLAIF) built on MLX and HuggingFace.☆29Updated 11 months ago
- Using modal.com to process FineWeb-edu data☆20Updated last month
- ☆38Updated last year
- A collection of optimizers for MLX☆35Updated last week
- NanoGPT (124M) quality in 2.67B tokens☆28Updated 3 weeks ago
- DocGenius AI - Generative AI Chatbot for your Documents☆11Updated 2 months ago
- Lightweight tools for quick and easy LLM demo's☆27Updated 8 months ago
- j1-micro (1.7B) & j1-nano (600M) are absurdly tiny but mighty reward models.☆62Updated this week
- a pipeline for using api calls to agnostically convert unstructured data into structured training data☆29Updated 8 months ago
- Testing LLM reasoning abilities with lineage relationship quizzes.☆27Updated 2 months ago
- an implementation of Self-Extend, to expand the context window via grouped attention☆119Updated last year
- ☆35Updated last month