dorsal/arxiv
View SchemaReasonTabQA: A Comprehensive Benchmark for Table Question Answering from Real World Industrial Scenarios
| Authors | Changzai Pan, Jie Zhang, Kaiwen Wei, Chenshuo Pan, Yu Zhao, Jingwang Huang, Jian Yang, Zhenhe Wu, Haoyang Zeng, Xiaoyan Gu, Weichao Sun, Yanbo Zhai, Yujie Mao, Zhuoru Jiang, Jiang Zhong, Shuangyong Song, Yongxiang Li, Zhongjiang He |
|---|---|
| Categories | |
| ArXiv ID | 2601.07280vv1 |
| URL | https://arxiv.org/abs/2601.07280 |
| License | http://arxiv.org/licenses/nonexclusive-distrib/1.0/ |
Abstract
Recent advancements in Large Language Models (LLMs) have significantly catalyzed table-based question answering (TableQA). However, existing TableQA benchmarks often overlook the intricacies of industrial scenarios, which are characterized by multi-table structures, nested headers, and massive scales. These environments demand robust table reasoning through deep structured inference, presenting a significant challenge that remains inadequately addressed by current methodologies. To bridge this gap, we present ReasonTabQA, a large-scale bilingual benchmark encompassing 1,932 tables across 30 industry domains such as energy and automotive. ReasonTabQA provides high-quality annotations for both final answers and explicit reasoning chains, supporting both thinking and no-thinking paradigms. Furthermore, we introduce TabCodeRL, a reinforcement learning method that leverages table-aware verifiable rewards to guide the generation of logical reasoning paths. Extensive experiments on ReasonTabQA and 4 TableQA datasets demonstrate that while TabCodeRL yields substantial performance gains on open-source LLMs, the persistent performance gap on ReasonTabQA underscores the inherent complexity of real-world industrial TableQA.
{
"annotation_id": "b253a840-6ac7-4434-9abd-2e1705176b03",
"date_created": "2026-02-17T05:53:11.347000Z",
"date_modified": "2026-02-17T05:53:11.347000Z",
"file_hash": "b6bf41148733b93ae7c5421d483c281e38a2ad0777e0f4e86da4c31c696f7c5f",
"private": false,
"record": {
"abstract": "Recent advancements in Large Language Models (LLMs) have significantly catalyzed table-based question answering (TableQA). However, existing TableQA benchmarks often overlook the intricacies of industrial scenarios, which are characterized by multi-table structures, nested headers, and massive scales. These environments demand robust table reasoning through deep structured inference, presenting a significant challenge that remains inadequately addressed by current methodologies. To bridge this gap, we present ReasonTabQA, a large-scale bilingual benchmark encompassing 1,932 tables across 30 industry domains such as energy and automotive. ReasonTabQA provides high-quality annotations for both final answers and explicit reasoning chains, supporting both thinking and no-thinking paradigms. Furthermore, we introduce TabCodeRL, a reinforcement learning method that leverages table-aware verifiable rewards to guide the generation of logical reasoning paths. Extensive experiments on ReasonTabQA and 4 TableQA datasets demonstrate that while TabCodeRL yields substantial performance gains on open-source LLMs, the persistent performance gap on ReasonTabQA underscores the inherent complexity of real-world industrial TableQA.",
"arxiv_id": "2601.07280",
"authors": [
"Changzai Pan",
"Jie Zhang",
"Kaiwen Wei",
"Chenshuo Pan",
"Yu Zhao",
"Jingwang Huang",
"Jian Yang",
"Zhenhe Wu",
"Haoyang Zeng",
"Xiaoyan Gu",
"Weichao Sun",
"Yanbo Zhai",
"Yujie Mao",
"Zhuoru Jiang",
"Jiang Zhong",
"Shuangyong Song",
"Yongxiang Li",
"Zhongjiang He"
],
"categories": [
"cs.CL"
],
"license": "http://arxiv.org/licenses/nonexclusive-distrib/1.0/",
"title": "ReasonTabQA: A Comprehensive Benchmark for Table Question Answering from Real World Industrial Scenarios",
"url": "https://arxiv.org/abs/2601.07280",
"version": "v1"
},
"schema_id": "dorsal/arxiv",
"source": {
"execution_id": "d70b72c2-c5b0-4aaa-9b3f-3a2481236260",
"id": "arXiv Dataset",
"type": "Model",
"variant": "snapshot-2026-01-17",
"version": "0.1.0"
},
"user_id": 1000002
}