antirez / LLM-FTC-samplingLinks
First token cutoff sampling inference example
☆30Updated last year
Alternatives and similar repositories for LLM-FTC-sampling
Users that are interested in LLM-FTC-sampling are comparing it to the libraries listed below
Sorting:
- C API for MLX☆158Updated this week
- SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?☆240Updated this week
- The official evaluation suite and dynamic data release for MixEval.☆11Updated last year
- Pivotal Token Search☆142Updated 3 weeks ago
- an implementation of Self-Extend, to expand the context window via grouped attention☆119Updated 2 years ago
- Benchmarks comparing PyTorch and MLX on Apple Silicon GPUs☆92Updated last year
- Tooling for exact and MinHash deduplication of large-scale text datasets☆51Updated this week
- A minimalistic C++ Jinja templating engine for LLM chat templates☆202Updated 3 months ago
- Because it's there.☆16Updated last year
- GGUF implementation in C as a library and a tools CLI program☆297Updated 4 months ago
- Your buddy in the (L)LM space.☆64Updated last year
- 🛠 Self-hosted, fast, and consistent remote configuration for apps.☆16Updated 3 years ago
- Turing machines, Rule 110, and A::B reversal using Claude 3 Opus.☆58Updated last year
- Transformer GPU VRAM estimator☆67Updated last year
- Aana SDK is a powerful framework for building AI enabled multimodal applications.☆55Updated 4 months ago
- Simple high-throughput inference library☆155Updated 7 months ago
- Using modal.com to process FineWeb-edu data☆20Updated 9 months ago
- ☆15Updated 2 years ago
- Implementation of nougat that focuses on processing pdf locally.☆83Updated 11 months ago
- GGML implementation of BERT model with Python bindings and quantization.☆58Updated last year
- Vector Database with support for late interaction and token level embeddings.☆54Updated 6 months ago
- ☆115Updated 11 months ago
- Lightweight tools for quick and easy LLM demo's☆28Updated last year
- look how they massacred my boy☆63Updated last year
- A Learning Journey: Micrograd in Mojo 🔥☆65Updated last year
- Chat Markup Language conversation library☆55Updated 2 years ago
- Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and min…☆26Updated last year
- Efficient non-uniform quantization with GPTQ for GGUF☆58Updated 3 months ago
- Public reports detailing responses to sets of prompts by Large Language Models.☆32Updated last year
- Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna☆59Updated 2 months ago