cs-cv/vision-language IB-arxiv-2607.28269-semantic-agreement measured

Across 173,179 label pairs, captions generated by a Qwen3.5 4B dense model and a Qwen3.5 35B Mixture-of-Experts model showed a semantic agreement of 78.65 out of 100 as scored by an image-blind Qwen3.5-9B LLM-as-a-Judge.

Active Evidence state is recorded explicitly and may be revised by a later event.

Observed quantities

semantic_agreement_score 78.65 · score_max 100 · label_pairs 173179

01

Primary source

  1. arxiv · 2607.28269 · v1 · abstract
Title
Theia: Large-Scale Multimodal Captioning and Automated Validation of the Incidents1M Dataset for Data-Free Distillation
Authors
Simone Giano, Lorenzo Severini, Alessandro Galdelli, Adriano Mancini
Version
v1
Check
Support quote found word for word in the arXiv abstract v1, 2026-10-08
Supporting quote from the source
Our evaluation across 173,179 label pairs demonstrates a high semantic agreement (78.65/100) between the two architectures

02

Boundary of this block

No additional public limitation was recorded.

03

Connections

Outgoing

No outgoing public edges.

Incoming

No incoming public edges.