firstbatchxyz / function-calling-evalLinks
The DPAB-α Benchmark
☆30Updated 10 months ago
Alternatives and similar repositories for function-calling-eval
Users that are interested in function-calling-eval are comparing it to the libraries listed below
Sorting:
- ☆107Updated 2 weeks ago
- Simple examples using Argilla tools to build AI☆56Updated last year
- Multi-Agent Step Race Benchmark: Assessing LLM Collaboration and Deception Under Pressure. A multi-player “step-race” that challenges LLM…☆76Updated 2 months ago
- Lightweight toolkit package to train and fine-tune 1.58bit Language models☆98Updated 6 months ago
- A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.☆98Updated 4 months ago
- klmbr - a prompt pre-processing technique to break through the barrier of entropy while generating text with LLMs☆84Updated last year
- powerful and fast tool calling agents☆66Updated 8 months ago
- ☆68Updated 5 months ago
- Thematic Generalization Benchmark: measures how effectively various LLMs can infer a narrow or specific "theme" (category/rule) from a sm…☆63Updated last month
- Distributed Inference for mlx LLm☆99Updated last year
- ☆23Updated 9 months ago
- Nexusflow function call, tool use, and agent benchmarks.☆29Updated 11 months ago
- Easy to use, High Performant Knowledge Distillation for LLMs☆95Updated 6 months ago
- Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna☆58Updated last month
- ☆67Updated last year
- ☆163Updated 3 months ago
- Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…☆83Updated 3 weeks ago
- MLX port for xjdr's entropix sampler (mimics jax implementation)☆62Updated last year
- ☆62Updated 4 months ago
- LLM Divergent Thinking Creativity Benchmark. LLMs generate 25 unique words that start with a given letter with no connections to each oth…☆33Updated 7 months ago
- A simple, easy-to-customize pipeline for local RAG evaluation. Starter prompts and metric definitions included.☆25Updated last month
- Train Large Language Models on MLX.☆216Updated this week
- craft post-training data recipes☆60Updated this week
- Pivotal Token Search☆131Updated 4 months ago
- Conduct in-depth research with AI-driven insights : DeepDive is a command-line tool that leverages web searches and AI models to generate…☆42Updated last year
- A Python library to orchestrate LLMs in a neural network-inspired structure☆51Updated last year
- an implementation of Self-Extend, to expand the context window via grouped attention☆119Updated last year
- Train your own SOTA deductive reasoning model☆107Updated 8 months ago
- ☆116Updated 11 months ago
- ☆158Updated 7 months ago