Benchgen
Models/google-deepmind/

Gemma 3 1B

DraftPublic

Model Details

Gemma 3 1B

Organization Type Context Parameters License Modality Released

Quick answer: Gemma 3 1B is the smallest model in Google DeepMind's Gemma 3 family, released on 12 March 2025 with fully open weights under the permissive Gemma license. It has 1 billion parameters, a 32,768-token context window, and handles text-only input and output. Trained on 2 trillion tokens across 140+ languages, it is designed to run on CPU without a GPU and is well-suited for on-device applications, edge deployments, and lightweight fine-tuning. On MMLU-Pro it scores 14.7%, reflecting its intentionally small footprint.

At a Glance

Where Gemma 3 1B leads

  • Smallest model in a strong open family: fits on CPU, runs on mobile, laptops, and resource-constrained edge devices.
  • Open weights with a permissive Gemma license — commercial use allowed, no per-query cost when self-hosted.
  • Trained on 2 trillion tokens including code and multilingual data — capable for its size on text generation and simple QA.
  • Active fine-tuning ecosystem: 550+ fine-tuned community variants on HuggingFace, 1M+ monthly downloads.

Where it lags

  • Text-only — no image understanding (the 4B, 12B, 27B variants are multimodal).
  • 32K context window vs 128K for all larger Gemma 3 sizes.
  • Benchmark scores are substantially below larger models: 14.7% on MMLU-Pro vs 85.2% for Gemma 3 27B.

Best for: on-device inference, edge AI, low-resource environments, fine-tuning experiments, and applications where model size and cost matter more than frontier accuracy.

What Gemma 3 1B Is

Gemma 3 1B is part of Google's Gemma 3 family of open-weight models, which was built from the same research and technology stack that underlies the proprietary Gemini 2.0 models. The 1B variant is the entry-level member of the family, designed specifically for deployment in environments where compute is limited — phones, laptops, IoT devices, and offline applications.

Unlike the 4B, 12B, and 27B Gemma 3 models — which are multimodal and can process both images and text — Gemma 3 1B is text-only. Its context window is also shorter at 32,768 tokens, compared to 128K for the rest of the family. These trade-offs are deliberate: the model is optimized for minimal footprint and fast inference on CPU rather than for top-end accuracy.

The model ships in two variants: a base pre-trained model (gemma-3-1b-pt) and an instruction-tuned model (gemma-3-1b-it). The instruction-tuned variant supports function calling and structured output, enabling simple agentic workflows even on constrained hardware. It is compatible with Hugging Face Transformers (4.50+), Ollama, vLLM, and Google AI Edge for on-device deployment on Android and web.

Specifications

FieldValue
OrganizationGoogle DeepMind
Parameters1 billion
ArchitectureTransformer decoder (Gemma 3)
ModalityText only (no vision)
Context window32,768 tokens
Max output8,192 tokens
Training tokens2 trillion
Training languages140+
LicenseGemma (permissive, commercial use allowed)
Release date12 March 2025
Open weightsYes — HuggingFace, Kaggle, Ollama
HuggingFace IDgoogle/gemma-3-1b-it
Inference frameworksTransformers, vLLM, Ollama, JAX, Keras, Google AI Edge

Pricing

Gemma 3 1B has open weights — there is no per-token charge when self-hosted. Cloud API pricing varies by provider:

ProviderInput (per 1M tokens)Output (per 1M tokens)
Self-hosted (open weights)FreeFree
Google AI StudioFree (rate-limited)Free
Vertex AIUsage-basedUsage-based

Benchmark Results

BenchmarkScoreNotes
MMLU-Pro14.7%Very low — expected for 1B scale
HellaSwag (10-shot)62.3%Commonsense reasoning
ARC-Challenge (25-shot)38.4%Grade-school science
BIG-Bench Hard28.4%Multi-step reasoning
MATH (4-shot)24.2%Mathematical reasoning
GSM8K (8-shot)38.4%Grade-school math
MBPP (3-shot)46.0%Python code generation
HumanEval (0-shot)36.0%Function synthesis
MGSM (multilingual math)2.04Limited multilingual math

Scores from the Gemma 3 technical report (March 2025). MMLU-Pro from Benchgen leaderboard.

Gemma 3 1B vs Other Small Open Models

ModelParamsContextMMLU-ProModalityLicense
Gemma 3 1B1B32K14.7%TextGemma (open)
Gemma 3 4B4B128K43.6%Text + ImageGemma (open)
Qwen3.5-0.8B0.8B42.3%TextApache 2.0
Qwen3.5-2B2B66.5%TextApache 2.0
Phi 4 Mini4B52.8%TextMIT
Llama 3.1 8B8B128K48.3%TextLlama 3.1

Gemma 3 1B scores below models of similar or larger size on MMLU-Pro, which reflects the extreme parameter budget. Within the same family, Gemma 3 4B (4× the parameters) scores nearly 3× higher at 43.6%. For tasks where raw benchmark performance matters, stepping up to 4B or 12B is recommended.

Run Gemma 3 1B on Benchgen

Gemma 3 1B's published benchmark numbers reflect Google's evaluation setup. Running it on Benchgen lets you measure performance on your specific task domain, prompt format, and input distribution — giving you comparable, version-tracked scores for your actual use case rather than general academic benchmarks. Useful when evaluating whether the 1B model is sufficient for a given application, or to justify upgrading to a larger variant.

Frequently Asked Questions

What is Gemma 3 1B? Gemma 3 1B is the smallest model in Google DeepMind's Gemma 3 open-weight family, released on 12 March 2025. It has 1 billion parameters, a 32K context window, and handles text-only input and output. It is designed for on-device and resource-constrained deployments where a larger model would not fit.
Does Gemma 3 1B support image input? No. Gemma 3 1B is text-only. The multimodal (image + text) capability is available in the 4B, 12B, and 27B sizes of the Gemma 3 family, but was not included in the 1B variant due to its size constraints.
Can Gemma 3 1B run on CPU? Yes — this is one of its main design goals. At 1B parameters with BF16 weights (~2 GB), it fits in RAM on most laptops and desktops and can run on CPU via Gemma.cpp, Ollama, or llama.cpp without requiring a GPU.
What is the Gemma license? The Gemma license is a custom permissive license from Google that allows commercial use and redistribution. It prohibits using the model to build products that compete directly with Google's Gemini API services, and requires attribution. It is not Apache 2.0, but is broadly permissive for most commercial applications.
How does Gemma 3 1B compare to Gemma 3 4B? Gemma 3 4B has 4× the parameters, a 128K context window (vs 32K), and adds multimodal image understanding. On MMLU-Pro it scores 43.6% vs 14.7% for 1B. The 4B model is substantially more capable for reasoning and knowledge tasks; the 1B is better suited for cases where model size or inference cost is the primary constraint.

Benchmark scores from the Gemma 3 technical report (Google DeepMind, March 2025) and Benchgen leaderboard data. Last updated 2026-06-18.