Alternatives and similar repositories for llm-benchmarker-suite

Users that are interested in llm-benchmarker-suite are comparing it to the libraries listed below

• daniel-furman / sft-demos
  Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.
  ☆77Updated 7 months ago
• LLM360 / amber-data-prep
  Data preparation code for Amber 7B LLM
  ☆91Updated last year
• ParticleMedia / RAGTruth
  Github repository for "RAGTruth: A Hallucination Corpus for Developing Trustworthy Retrieval-Augmented Language Models"
  ☆180Updated 6 months ago
• Liyan06 / MiniCheck
  MiniCheck: Efficient Fact-Checking of LLMs on Grounding Documents [EMNLP 2024]
  ☆162Updated 5 months ago
• khaimt / qa_expert
  This repo is for handling Question Answering, especially for Multi-hop Question Answering
  ☆67Updated last year
• arcee-ai / EvolKit
  EvolKit is an innovative framework designed to automatically enhance the complexity of instructions used for fine-tuning Large Language M…
  ☆221Updated 7 months ago
• swj0419 / detect-pretrain-code-contamination
  ☆76Updated last year
• writer / writing-in-the-margins
  ☆118Updated 9 months ago
• allenai / olmes
  Reproducible, flexible LLM evaluations
  ☆204Updated 3 weeks ago
• kamalkraj / e5-mistral-7b-instruct
  Finetune mistral-7b-instruct for sentence embeddings
  ☆82Updated last year
• Digitous / LLM-SLERP-Merge
  Spherical Merge Pytorch/HF format Language Models with minimal feature loss.
  ☆124Updated last year
• terryyz / llm-benchmark
  A list of LLM benchmark frameworks.
  ☆66Updated last year
• TIGER-AI-Lab / MAmmoTH2
  Official code for "MAmmoTH2: Scaling Instructions from the Web" [NeurIPS 2024]
  ☆142Updated 7 months ago
• javyduck / KnowHalu
  ☆47Updated last year
• huggingface / llm-swarm
  Manage scalable open LLM inference endpoints in Slurm clusters
  ☆258Updated 10 months ago
• allenai / infinigram-api
  ☆58Updated 3 weeks ago
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆78Updated 8 months ago
• SalesforceAIResearch / SFR-RAG
  ☆75Updated 4 months ago
• golololologol / LLM-Distillery
  A pipeline for LLM knowledge distillation
  ☆104Updated 2 months ago
• SalesforceAIResearch / FaithEval
  ☆41Updated 3 months ago
• GAIR-NLP / Entropy-ABF
  Official implementation for 'Extending LLMs’ Context Window with 100 Samples'
  ☆78Updated last year
• davanstrien / awesome-synthetic-datasets
  awesome synthetic (text) datasets
  ☆281Updated 7 months ago
• hyintell / RetrievalQA
  Source code of the paper: RetrievalQA: Assessing Adaptive Retrieval-Augmented Generation for Short-form Open-Domain Question Answering [F…
  ☆64Updated last year
• zjunlp / OneGen
  [EMNLP 2024 Findings] OneGen: Efficient One-Pass Unified Generation and Retrieval for LLMs.
  ☆147Updated 6 months ago
• wang-research-lab / agentinstruct
  Code repo for "Agent Instructs Large Language Models to be General Zero-Shot Reasoners"
  ☆110Updated 8 months ago
• tigerchen52 / awesome_role_of_small_models
  a curated list of the role of small models in the LLM era
  ☆100Updated 8 months ago
• LLM360 / amber-train
  Pre-training code for Amber 7B LLM
  ☆166Updated last year
• Re-Align / URIAL
  ☆309Updated 11 months ago
• princeton-nlp / LitSearch
  [EMNLP 2024] A Retrieval Benchmark for Scientific Literature Search
  ☆89Updated 6 months ago
• dwzhu-pku / LongEmbed
  LongEmbed: Extending Embedding Models for Long Context Retrieval (EMNLP 2024)
  ☆135Updated 6 months ago