Benchgen

BFCL — Results

RankModelScore
1llama-3-1-405b-instruct0.885
2llama-3-1-70b-instruct0.848
3llama-3-1-8b-instruct0.761
4nova-2-sonic0.745
5qwen3-235b-a22b0.708
6qwen3-32b0.703
7qwen3-30b-a3b0.691
8nova-pro0.684
9nova-lite0.666
10qwq-32b0.664
11nova-micro0.562
B

BFCL

1 phaseActive

Comprehensive executable function-call evaluation for LLMs covering serial, parallel, and multi-turn calls across Python, Java, JavaScript, and REST APIs.

Overview

BFCL

Category Metric Tasks Saturation Created

Paper GitHub

Quick answer: BFCL (Berkeley Function Calling Leaderboard) is the first comprehensive and executable function call evaluation for LLMs, covering over 2,000 question-function-answer pairs across multiple programming languages using Abstract Syntax Tree (AST) evaluation.

What is BFCL?

The Berkeley Function Calling Leaderboard (BFCL) evaluates serial and parallel function calls across Python, Java, JavaScript, and REST APIs. It covers complex use cases including multiple function calls, parallel function calls, and multi-turn interactions, with AST-based evaluation for executable accuracy.

Benchmark Details

PropertyValue
Tasks2,000+ question-function-answer pairs
MetricOverall accuracy (AST + executable)
CategoriesTool calling, Reasoning
ModalityText
LanguagesPython, Java, JavaScript, REST

Source: Yan et al. 2024. Last updated 2026-07-24.