Alternatives and similar repositories for function-calling-eval

Users that are interested in function-calling-eval are comparing it to the libraries listed below

• teknium1 / LLM-Benchmark-Logs
  Just a bunch of benchmark logs for different LLMs
  ☆119Updated last year
• weaviate-tutorials / Hurricane
  Writing Blog Posts with Generative Feedback Loops!
  ☆50Updated last year
• Arize-ai / LLMTest_NeedleInAHaystack
  Doing simple retrieval from LLM models at various context lengths to measure accuracy
  ☆104Updated 2 weeks ago
• louisbrulenaudet / ragoon
  High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡
  ☆67Updated 10 months ago
• Xalp / ECHO
  Official homepage for "Self-Harmonized Chain of Thought" (NAACL 2025)
  ☆91Updated 8 months ago
• teknium1 / transformers-gptq-quant
  ☆46Updated last year
• zbambergerNLP / strategic-debate-tot
  A DSPy-based implementation of the tree of thoughts method (Yao et al., 2023) for generating persuasive arguments
  ☆89Updated last year
• Muhtasham / summarization-eval
  📝 Reference-Free automatic summarization evaluation with potential hallucination detection
  ☆103Updated last year
• teknium1 / ShareGPT-Builder
  ☆116Updated 9 months ago
• QuixiAI / kraken
  ☆67Updated last year
• davanstrien / haiku-dpo
  Using open source LLMs to build synthetic datasets for direct preference optimization
  ☆66Updated last year
• Mihaiii / backtrack_sampler
  An easy-to-understand framework for LLM samplers that rewind and revise generated tokens
  ☆146Updated 7 months ago
• migtissera / Sensei
  Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAI
  ☆222Updated last year
• redotvideo / pluto
  Synthetic Data for LLM Fine-Tuning
  ☆120Updated last year
• davidberenstein1957 / dataset-viber
  Dataset Viber is your chill repo for data collection, annotation and vibe checks.
  ☆46Updated last year
• thooton / muse
  Let's create synthetic textbooks together :)
  ☆75Updated last year
• flowaicom / flow-judge
  Code for evaluating with Flow-Judge-v0.1 - an open-source, lightweight (3.8B) language model optimized for LLM system evaluations. Crafte…
  ☆78Updated 11 months ago
• argilla-io / notus
  Notus is a collection of fine-tuned LLMs using SFT, DPO, SFT+DPO, and/or any other RLHF techniques, while always keeping a data-first app…
  ☆170Updated last year
• awslabs / extending-the-context-length-of-open-source-llms
  ☆56Updated 3 months ago
• brendanhogan / picoDeepResearch
  ☆68Updated 4 months ago
• davanstrien / data-for-fine-tuning-llms
  ☆80Updated last year
• QuixiAI / SystemChat
  ☆31Updated last year
• argilla-io / argilla-cookbook
  Simple examples using Argilla tools to build AI
  ☆55Updated 10 months ago
• minosvasilias / simple_grpo
  Simple GRPO scripts and configurations.
  ☆59Updated 7 months ago
• QuixiAI / OpenChatML
  ☆162Updated last month
• VikParuchuri / classified
  Score LLM pretraining data with classifiers
  ☆55Updated last year
• AnswerDotAI / ModernBERT-Instruct-mini-cookbook
  ☆49Updated 7 months ago
• ComposioHQ / Composio-Function-Calling-Benchmark
  Function Calling Benchmark & Testing
  ☆90Updated last year
• s-smits / grpo-optuna
  Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna
  ☆55Updated 7 months ago
• Technoculture / personal-graph
  Simple Graph Memory for AI applications
  ☆90Updated 4 months ago