Alternatives and similar repositories for generative-benchmarking

Users that are interested in generative-benchmarking are comparing it to the libraries listed below

• davanstrien / haiku-dpo
  Using open source LLMs to build synthetic datasets for direct preference optimization
  ☆61Updated last year
• zetaalphavector / RAGElo
  RAGElo is a set of tools that helps you selecting the best RAG-based LLM agents by using an Elo ranker
  ☆108Updated last month
• MadryLab / context-cite
  Attribute (or cite) statements generated by LLMs back to in-context information.
  ☆229Updated 7 months ago
• orionw / promptriever
  The first dense retrieval model that can be prompted like an LM
  ☆71Updated this week
• allenai / infinigram-api
  ☆56Updated last week
• OpenPipe / deductive-reasoning
  Train your own SOTA deductive reasoning model
  ☆92Updated 2 months ago
• writer / writing-in-the-margins
  ☆117Updated 8 months ago
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆78Updated 7 months ago
• michaelfeil / embed
  A stable, fast and easy-to-use inference library with a focus on a sync-to-async API
  ☆45Updated 7 months ago
• argilla-io / argilla-cookbook
  Simple examples using Argilla tools to build AI
  ☆52Updated 5 months ago
• huggingface / ai-blueprint
  A blueprint for AI development, focusing on applied examples of RAG, information extraction, analysis and fine-tuning in the age of LLMs …
  ☆52Updated 3 months ago
• redotvideo / pluto
  Synthetic Data for LLM Fine-Tuning
  ☆115Updated last year
• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆49Updated 10 months ago
• mrmps / ai-chunker
  Chunk your text using gpt4o-mini more accurately
  ☆44Updated 9 months ago
• louisbrulenaudet / ragoon
  High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡
  ☆66Updated 6 months ago
• RulinShao / retrieval-scaling
  Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".
  ☆199Updated last week
• adobe-research / NoLiMa
  Official repository for "NoLiMa: Long-Context Evaluation Beyond Literal Matching"
  ☆68Updated last week
• teknium1 / transformers-gptq-quant
  ☆48Updated last year
• ComposioHQ / Composio-Function-Calling-Benchmark
  Function Calling Benchmark & Testing
  ☆87Updated 10 months ago
• automix-llm / automix
  Mixing Language Models with Self-Verification and Meta-Verification
  ☆104Updated 5 months ago
• Muhtasham / summarization-eval
  📝 Reference-Free automatic summarization evaluation with potential hallucination detection
  ☆100Updated last year
• facebookresearch / ExploreToM
  Code for ExploreTom
  ☆83Updated 5 months ago
• malteos / llm-datasets
  A collection of datasets for language model pretraining including scripts for downloading, preprocesssing, and sampling.
  ☆59Updated 9 months ago
• quotient-ai / judges
  A small library of LLM judges
  ☆191Updated 2 weeks ago
• Knowledgator / GLiClass
  Generalist and Lightweight Model for Text Classification
  ☆128Updated 2 weeks ago
• predlico / ARAGOG
  ARAGOG- Advanced RAG Output Grading. Exploring and comparing various Retrieval-Augmented Generation (RAG) techniques on AI research paper…
  ☆103Updated last year
• marcusschiesser / open-swarm
  Framework for building, orchestrating and deploying multi-agent systems. Managed by OpenAI Solutions team. Experimental framework.
  ☆91Updated 7 months ago
• suzgunmirac / dynamic-cheatsheet
  Dynamic Cheatsheet: Test-Time Learning with Adaptive Memory
  ☆56Updated last month
• MoritzLaurer / synthetic-data-blog
  This is the reproduction repository for my 🤗 Hugging Face blog post on synthetic data
  ☆68Updated last year
• cognitivecomputations / spectrum
  ☆120Updated last month