antirez / LLM-FTC-samplingLinks
First token cutoff sampling inference example
☆31Updated last year
Alternatives and similar repositories for LLM-FTC-sampling
Users that are interested in LLM-FTC-sampling are comparing it to the libraries listed below
Sorting:
- an implementation of Self-Extend, to expand the context window via grouped attention☆118Updated last year
- Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and min…☆26Updated 10 months ago
- Trace LLM calls (and others) and visualize them in WandB, as interactive SVG or using a streaming local webapp☆14Updated 7 months ago
- Because it's there.☆16Updated 11 months ago
- Pivotal Token Search☆124Updated 2 months ago
- 🛠 Self-hosted, fast, and consistent remote configuration for apps.☆16Updated 2 years ago
- Benchmarks comparing PyTorch and MLX on Apple Silicon GPUs☆88Updated last year
- Zeus LLM Trainer is a rewrite of Stanford Alpaca aiming to be the trainer for all Large Language Models☆70Updated 2 years ago
- ☆28Updated 5 months ago
- ☆22Updated last month
- Benchmarking suite for popular AI APIs☆88Updated 7 months ago
- Just a bunch of benchmark logs for different LLMs☆119Updated last year
- ☆12Updated last year
- Aana SDK is a powerful framework for building AI enabled multimodal applications.☆52Updated 3 weeks ago
- Vector Database with support for late interaction and token level embeddings.☆55Updated 3 months ago
- Binding to transformers in ggml☆63Updated 2 weeks ago
- Using modal.com to process FineWeb-edu data☆20Updated 5 months ago
- The official evaluation suite and dynamic data release for MixEval.☆11Updated 11 months ago
- Turing machines, Rule 110, and A::B reversal using Claude 3 Opus.☆58Updated last year
- ☆15Updated last year
- This repository is designed for deploying and managing server processes that handle embeddings using the Infinity Embedding model or Larg…☆24Updated 6 months ago
- A minimalistic C++ Jinja templating engine for LLM chat templates☆180Updated last week
- Chat Markup Language conversation library☆55Updated last year
- Transformer GPU VRAM estimator☆66Updated last year
- NanoGPT (124M) quality in 2.67B tokens☆28Updated last week
- Implementation of nougat that focuses on processing pdf locally.☆82Updated 8 months ago
- ☆67Updated last year
- look how they massacred my boy☆64Updated 11 months ago
- inference code for mixtral-8x7b-32kseqlen☆101Updated last year
- Lightweight tools for quick and easy LLM demo's☆28Updated 11 months ago