Alternatives and similar repositories for llm-profiling-toolkit

Users that are interested in llm-profiling-toolkit are comparing it to the libraries listed below

• taylorai / onnx_embedding_models
  utilities for loading and running text embeddings with onnx
  ☆45Updated 5 months ago
• Pleias / Quest-Best-Tokens
  An introduction to LLM Sampling
  ☆79Updated last year
• haizelabs / sphynx
  Sphynx Hallucination Induction
  ☆53Updated last year
• Muhtasham / summarization-eval
  📝 Reference-Free automatic summarization evaluation with potential hallucination detection
  ☆103Updated 2 years ago
• teknium1 / transformers-gptq-quant
  ☆45Updated 2 years ago
• davanstrien / haiku-dpo
  Using open source LLMs to build synthetic datasets for direct preference optimization
  ☆72Updated last year
• minosvasilias / simple_grpo
  Simple GRPO scripts and configurations.
  ☆59Updated last year
• JD-P / minihf
  MiniHF is an inference, human preference data collection, and fine-tuning tool for local language models. It is intended to help the user…
  ☆183Updated 3 months ago
• JD-P / RetroInstruct
  Synthetic data derived by templating, few shot prompting, transformations on public domain corpora, and monte carlo tree search.
  ☆32Updated 4 months ago
• joshuacnf / Ctrl-G
  ☆105Updated last year
• thesephist / spectre
  Sparse autoencoders for Contra text embedding models
  ☆25Updated last year
• mozilla-ai / lm-buddy
  Your buddy in the (L)LM space.
  ☆64Updated last year
• jxmorris12 / embzip
  lossily compress representation vectors using product quantization
  ☆59Updated 3 months ago
• FL33TW00D / embd
  GPU accelerated client-side embeddings for vector search, RAG etc.
  ☆65Updated 2 years ago
• CarperAI / squeakily
  A library for squeakily cleaning and filtering language datasets.
  ☆49Updated 2 years ago
• raphaelsty / LeNLP
  NLP with Rust for Python 🦀🐍
  ☆71Updated 8 months ago
• AblateIt / finetune-study
  Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.
  ☆83Updated 2 years ago
• Mihaiii / backtrack_sampler
  An easy-to-understand framework for LLM samplers that rewind and revise generated tokens
  ☆150Updated last month
• teknium1 / LLM-Benchmark-Logs
  Just a bunch of benchmark logs for different LLMs
  ☆119Updated last year
• EleutherAI / improved-t5
  Experiments for efforts to train a new and improved t5
  ☆76Updated last year
• cohere-ai / magikarp
  Code for the paper "Fishing for Magikarp"
  ☆180Updated 8 months ago
• AnswerDotAI / ModernBERT-Instruct-mini-cookbook
  ☆53Updated last year
• geronimi73 / phi2-finetune
  ☆86Updated 2 years ago
• vikhyat / mixtral-inference
  inference code for mixtral-8x7b-32kseqlen
  ☆105Updated 2 years ago
• Alignment-Lab-AI / datagen
  a pipeline for using api calls to agnostically convert unstructured data into structured training data
  ☆32Updated last year
• euclaise / SlimTrainer
  Full finetuning of large language models without large memory requirements
  ☆94Updated 4 months ago
• notarussianteenager / srf-attention
  Simplex Random Feature attention, in PyTorch
  ☆75Updated 2 years ago
• cohere-ai / sandbox-toy-semantic-search
  A demonstration of how a toy (but usable!) semantic search engine can be quickly built using Cohere's platform.
  ☆117Updated 2 years ago
• JoeLi12345 / nGPT
  an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)
  ☆110Updated 11 months ago
• xjdr-alt / muzero_sketch
  ☆40Updated last year