antirez / LLM-FTC-sampling
First token cutoff sampling inference example
☆29Updated last year
Alternatives and similar repositories for LLM-FTC-sampling:
Users that are interested in LLM-FTC-sampling are comparing it to the libraries listed below
- ☆12Updated last month
- Using modal.com to process FineWeb-edu data☆20Updated 2 months ago
- A minimalistic C++ Jinja templating engine for LLM chat templates☆120Updated this week
- Trace LLM calls (and others) and visualize them in WandB, as interactive SVG or using a streaming local webapp☆15Updated this week
- Training hybrid models for dummies.☆20Updated last month
- a pipeline for using api calls to agnostically convert unstructured data into structured training data☆29Updated 4 months ago
- Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and min…☆25Updated 3 months ago
- An example implementation of RLHF (or, more accurately, RLAIF) built on MLX and HuggingFace.☆24Updated 7 months ago
- LLama implementations benchmarking framework☆12Updated last year
- Latent Large Language Models☆17Updated 5 months ago
- A fork of llama3.c used to do some R&D on inferencing☆18Updated 2 months ago
- Nexusflow function call, tool use, and agent benchmarks.☆19Updated 2 months ago
- GGML implementation of BERT model with Python bindings and quantization.☆53Updated last year
- Benchmarks comparing PyTorch and MLX on Apple Silicon GPUs☆72Updated 7 months ago
- The official evaluation suite and dynamic data release for MixEval.☆10Updated 4 months ago
- Experimental wasm32-unknown-wasi runtime for Python code execution☆36Updated 2 months ago
- ☆38Updated 11 months ago
- Inference Llama 2 in one file of zero-dependency, zero-unsafe Rust☆37Updated last year
- run embeddings in MLX☆82Updated 4 months ago
- A super simple web interface to perform blind tests on LLM outputs.☆27Updated 11 months ago
- Because it's there.☆14Updated 4 months ago
- convert natural language into technical diagrams☆12Updated 2 months ago
- Lightweight tools for quick and easy LLM demo's☆26Updated 4 months ago
- Tensor library for Zig☆11Updated 3 months ago
- ☆15Updated last year
- A library for simplifying fine tuning with multi gpu setups in the Huggingface ecosystem.☆16Updated 3 months ago
- A clone of OpenAI's Tokenizer page for HuggingFace Models☆44Updated last year
- Transformer GPU VRAM estimator☆50Updated 10 months ago