# BabyVision ![Category](https://img.shields.io/badge/Category-Visual%20Reasoning-1f6feb) ![Metric](https://img.shields.io/badge/Metric-%25%20Accuracy-2da44e) ![Saturation](https://img.shields.io/badge/Saturation-Low-d29922) ![Created](https://img.shields.io/badge/Created-2026-555) > **Quick answer:** BabyVision tests AI models on deceptively simple, "early-stage" visual reasoning tasks — the kind of basic perceptual judgments a young child could make — that nonetheless remain surprisingly difficult for current multimodal models to answer reliably without tool assistance. Kimi K3 scores 85.7% when allowed to use Python-based tool assistance, as of July 2026. ## At a Glance **What it tests:** Fundamental visual perception and reasoning — basic counting, spatial relationships, object comparison — designed to be intuitive for humans but revealing of subtle model weaknesses. **Why it matters:** Frontier models can solve advanced graduate-level reasoning problems while still occasionally failing simple perceptual tasks. BabyVision surfaces this gap, which matters for real-world reliability. **Known limitations:** As an emerging benchmark, exact task composition is not yet independently published outside its citation by Moonshot AI. Scores can vary significantly depending on whether tool assistance (e.g., Python for counting/measurement) is permitted. ## What BabyVision Measures BabyVision evaluates a model's performance on foundational, seemingly simple visual reasoning tasks — such as counting objects, judging relative size or position, and basic scene comparison — that remain a known weak point for multimodal models despite their strength on harder benchmarks. Results can be reported both with and without tool assistance (e.g., allowing a model to write and execute Python code to verify counts), since tool use often substantially improves accuracy on these tasks. ## Benchmark Specifications | Field | Value | |---|---| | Task category | Reasoning / basic visual perception | | Metric | % accuracy | | Saturation | Low | | Created by | Not yet independently documented | ## How BabyVision Is Scored Models answer basic visual perception questions, scored on % accuracy against ground truth. Scores are often reported both with and without permitted tool assistance (e.g., Python code execution) to isolate raw perceptual accuracy from tool-augmented accuracy. ## State-of-the-Art Results | Rank | Model | Score | Source | Date | |---|---|---|---|---| | 1 | [Kimi K3](/models/moonshot-ai/kimi-k3) | 85.7% (w/ Python) | [Kimi K3 technical report](https://www.kimi.com/blog/kimi-k3) | 2026-07 | *Score sourced from Moonshot AI's Kimi K3 announcement, July 2026.* ## BabyVision on Benchgen > No Benchgen results yet — [be the first to run BabyVision](/benchmarks/unipat-ai/babyvision). ## BabyVision vs Other Benchmarks | Benchmark | What it tests | Saturation | |---|---|---| | **BabyVision** | Fundamental/basic visual perception | Low | | [PerceptionBench](/benchmarks/moonshot-ai/perceptionbench) | Fine-grained visual perception | Low | | [WorldVQA ForceAnswer](/benchmarks/moonshot-ai/worldvqa-forceanswer) | Forced-answer real-world visual QA | Low | | [ZeroBench](/benchmarks/zerobench/zerobench) | Extremely hard visual reasoning | Very low | ## Run BabyVision on Your Model Benchgen lets you run BabyVision against your own multimodal model, tracking basic perceptual accuracy with and without tool assistance to catch subtle reliability gaps. ## Frequently Asked Questions

What is BabyVision?

BabyVision is a benchmark testing AI models on deceptively simple, foundational visual reasoning tasks that reveal subtle perceptual weaknesses even in frontier multimodal models.

What does a good score look like on BabyVision?

Kimi K3 reports 85.7% with Python tool assistance as of July 2026, indicating that tool use substantially helps close the gap on basic perceptual tasks like counting.

Who created BabyVision?

BabyVision's originating team is not yet independently documented outside of its citation in Kimi K3's July 2026 technical report.

Rank	Model	Score
1	deepseek-v4-1-flash-1017	92.5
2	minimax-m3-1-flash	91
3	deepseek-v4-1-flash	89.6
4	kimi-k3	85.7
5	muse-spark-open-816b-a42b	80.2
6	qwen3-8-27b	65.7

BabyVision — Results

BabyVision — Evaluations