dorsal/arxiv
View SchemaIdentifying Models Behind Text-to-Image Leaderboards
| Authors | Ali Naseh, Yuefeng Peng, Anshuman Suri, Harsh Chaudhari, Alina Oprea, Amir Houmansadr |
|---|---|
| Categories | |
| ArXiv ID | 2601.09647vv1 |
| URL | https://arxiv.org/abs/2601.09647 |
| License | http://arxiv.org/licenses/nonexclusive-distrib/1.0/ |
Abstract
Text-to-image (T2I) models are increasingly popular, producing a large share of AI-generated images online. To compare model quality, voting-based leaderboards have become the standard, relying on anonymized model outputs for fairness. In this work, we show that such anonymity can be easily broken. We find that generations from each T2I model form distinctive clusters in the image embedding space, enabling accurate deanonymization without prompt control or training data. Using 22 models and 280 prompts (150K images), our centroid-based method achieves high accuracy and reveals systematic model-specific signatures. We further introduce a prompt-level distinguishability metric and conduct large-scale analyses showing how certain prompts can lead to near-perfect distinguishability. Our findings expose fundamental security flaws in T2I leaderboards and motivate stronger anonymization defenses.
{
"annotation_id": "06e0f9aa-8248-4c33-bb85-9bce5e19e6ac",
"date_created": "2026-02-17T05:53:20.495000Z",
"date_modified": "2026-02-17T05:53:20.495000Z",
"file_hash": "562ef6ba2184e985e36b12459dac14b37095278ff91431900531ab86da0df7a8",
"private": false,
"record": {
"abstract": "Text-to-image (T2I) models are increasingly popular, producing a large share of AI-generated images online. To compare model quality, voting-based leaderboards have become the standard, relying on anonymized model outputs for fairness. In this work, we show that such anonymity can be easily broken. We find that generations from each T2I model form distinctive clusters in the image embedding space, enabling accurate deanonymization without prompt control or training data. Using 22 models and 280 prompts (150K images), our centroid-based method achieves high accuracy and reveals systematic model-specific signatures. We further introduce a prompt-level distinguishability metric and conduct large-scale analyses showing how certain prompts can lead to near-perfect distinguishability. Our findings expose fundamental security flaws in T2I leaderboards and motivate stronger anonymization defenses.",
"arxiv_id": "2601.09647",
"authors": [
"Ali Naseh",
"Yuefeng Peng",
"Anshuman Suri",
"Harsh Chaudhari",
"Alina Oprea",
"Amir Houmansadr"
],
"categories": [
"cs.CV",
"cs.CR",
"cs.LG"
],
"license": "http://arxiv.org/licenses/nonexclusive-distrib/1.0/",
"title": "Identifying Models Behind Text-to-Image Leaderboards",
"url": "https://arxiv.org/abs/2601.09647",
"version": "v1"
},
"schema_id": "dorsal/arxiv",
"source": {
"execution_id": "b1763f22-3a92-4f72-bc81-04d6eceee7f2",
"id": "arXiv Dataset",
"type": "Model",
"variant": "snapshot-2026-01-17",
"version": "0.1.0"
},
"user_id": 1000002
}