firstbatchxyz / function-calling-evalLinks
The DPAB-α Benchmark
☆29Updated 8 months ago
Alternatives and similar repositories for function-calling-eval
Users that are interested in function-calling-eval are comparing it to the libraries listed below
Sorting:
- A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.☆95Updated 2 months ago
- klmbr - a prompt pre-processing technique to break through the barrier of entropy while generating text with LLMs☆80Updated 11 months ago
- Distributed Inference for mlx LLm☆95Updated last year
- ☆104Updated 3 months ago
- ☆23Updated 7 months ago
- Lightweight toolkit package to train and fine-tune 1.58bit Language models☆88Updated 4 months ago
- Official homepage for "Self-Harmonized Chain of Thought" (NAACL 2025)☆92Updated 7 months ago
- MLX port for xjdr's entropix sampler (mimics jax implementation)☆62Updated 10 months ago
- Easy to use, High Performant Knowledge Distillation for LLMs☆92Updated 4 months ago
- Simple examples using Argilla tools to build AI☆55Updated 10 months ago
- ☆68Updated 3 months ago
- Multi-Agent Step Race Benchmark: Assessing LLM Collaboration and Deception Under Pressure. A multi-player “step-race” that challenges LLM…☆73Updated 3 weeks ago
- Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…☆82Updated this week
- ☆61Updated 2 months ago
- Easily view and modify JSON datasets for large language models☆82Updated 4 months ago
- ☆133Updated 4 months ago
- Guaranteed Structured Output from any Language Model via Hierarchical State Machines☆146Updated 3 months ago
- Nexusflow function call, tool use, and agent benchmarks.☆29Updated 9 months ago
- Modify Entropy Based Sampling to work with Mac Silicon via MLX☆49Updated 10 months ago
- Train your own SOTA deductive reasoning model☆106Updated 6 months ago
- ☆51Updated last year
- Thematic Generalization Benchmark: measures how effectively various LLMs can infer a narrow or specific "theme" (category/rule) from a sm…☆63Updated last month
- Train Large Language Models on MLX.☆160Updated last month
- Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna☆55Updated 7 months ago
- ☆99Updated 3 weeks ago
- Conduct in-depth research with AI-driven insights : DeepDive is a command-line tool that leverages web searches and AI models to generate…☆42Updated last year
- look how they massacred my boy☆64Updated 11 months ago
- ☆161Updated last month
- tiny_fnc_engine is a minimal python library that provides a flexible engine for calling functions extracted from a LLM.☆38Updated last year
- A Python library to orchestrate LLMs in a neural network-inspired structure☆50Updated 11 months ago