Alternatives and similar repositories for llm-profiling-toolkit

Users that are interested in llm-profiling-toolkit are comparing it to the libraries listed below

• Pleias / Quest-Best-Tokens
  An introduction to LLM Sampling
  ☆79Updated last year
• raphaelsty / LeNLP
  NLP with Rust for Python 🦀🐍
  ☆70Updated 8 months ago
• jxmorris12 / embzip
  lossily compress representation vectors using product quantization
  ☆59Updated 3 months ago
• davanstrien / haiku-dpo
  Using open source LLMs to build synthetic datasets for direct preference optimization
  ☆72Updated last year
• EleutherAI / features-across-time
  Understanding how features learned by neural networks evolve throughout training
  ☆41Updated last year
• jackbandy / bookcorpus-datasheet
  Documentation effort for the BookCorpus dataset
  ☆34Updated 4 years ago
• Muhtasham / summarization-eval
  📝 Reference-Free automatic summarization evaluation with potential hallucination detection
  ☆103Updated 2 years ago
• cohere-ai / magikarp
  Code for the paper "Fishing for Magikarp"
  ☆179Updated 8 months ago
• taylorai / onnx_embedding_models
  utilities for loading and running text embeddings with onnx
  ☆45Updated 5 months ago
• teknium1 / transformers-gptq-quant
  ☆45Updated 2 years ago
• castorini / hf-spacerini
  Plug-and-play Search Interfaces with Pyserini and Hugging Face
  ☆32Updated 2 years ago
• haizelabs / sphynx
  Sphynx Hallucination Induction
  ☆52Updated last year
• JD-P / RetroInstruct
  Synthetic data derived by templating, few shot prompting, transformations on public domain corpora, and monte carlo tree search.
  ☆32Updated 3 months ago
• MinishLab / tokenlearn
  Pre-train Static Word Embeddings
  ☆94Updated 4 months ago
• CarperAI / squeakily
  A library for squeakily cleaning and filtering language datasets.
  ☆49Updated 2 years ago
• teknium1 / LLM-Benchmark-Logs
  Just a bunch of benchmark logs for different LLMs
  ☆119Updated last year
• EleutherAI / tokengrams
  Efficiently computing & storing token n-grams from large corpora
  ☆26Updated last year
• EleutherAI / improved-t5
  Experiments for efforts to train a new and improved t5
  ☆76Updated last year
• AnswerDotAI / ModernBERT-Instruct-mini-cookbook
  ☆53Updated 11 months ago
• Mihaiii / backtrack_sampler
  An easy-to-understand framework for LLM samplers that rewind and revise generated tokens
  ☆150Updated 3 weeks ago
• minosvasilias / simple_grpo
  Simple GRPO scripts and configurations.
  ☆59Updated 11 months ago
• enjalot / latent-sae
  Training code for Sparse Autoencoders on Embedding models
  ☆39Updated 11 months ago
• Pleias / Pleias-RAG-Library
  Python library to use Pleias-RAG models
  ☆68Updated 9 months ago
• Alignment-Lab-AI / datagen
  a pipeline for using api calls to agnostically convert unstructured data into structured training data
  ☆32Updated last year
• pacman100 / peft-codegen-25
  ☆23Updated 2 years ago
• mozilla-ai / lm-buddy
  Your buddy in the (L)LM space.
  ☆64Updated last year
• haizelabs / thorn-in-haizestack
  Thorn in a HaizeStack test for evaluating long-context adversarial robustness.
  ☆26Updated last year
• geronimi73 / phi2-finetune
  ☆86Updated 2 years ago
• cohere-ai / sandbox-toy-semantic-search
  A demonstration of how a toy (but usable!) semantic search engine can be quickly built using Cohere's platform.
  ☆117Updated 2 years ago
• argilla-io / distilabel-spin-dibt
  Repository containing the SPIN experiments on the DIBT 10k ranked prompts
  ☆23Updated last year