Distributed Data-Processing Pipeline for Mingantu Ultrawide Spectral Radioheliograph | |
Wang F(王锋)1,2,3; Mei, Y1; Deng, H1; Wang, W4; Liu, CY1; Liu, DH4; Wei SL(卫守林)1,2,3; Dai W(戴伟)1,2,3; Liang, B1; Liu YB(刘应波)1,2,3; Zhang, XL1; Ji, KF1 | |
发表期刊 | PUBLICATIONS OF THE ASTRONOMICAL SOCIETY OF THE PACIFIC |
2015-04 | |
卷号 | 127期号:950页码:383-396 |
DOI | 10.1086/680852 |
产权排序 | 第3完成单位 |
收录类别 | SCI |
摘要 | The Mingantu Ultrawide Spectral Radioheliograph (MUSER) is a synthetic-aperture radio interferometer built in Ming'antu, Inner Mongolia, China. As a solar-dedicated interferometric array, the MUSER can produce high-quality radio images in a frequency range of 400 MHz-15 GHz with high temporal, spatial, and spectral resolution. Implementing of the data processing system for the MUSER is a major challenge to performing high-cadence imaging in wideband and obtaining more than two orders of higher multiple frequencies. There is an urgent need to build a pipeline for processing the massive amount of MUSER data generated each day. In this article, we present a high-performance distributed data processing pipeline (DDPP) built on the OpenCluster infrastructure for processing MUSER observational data, including data storage, preprocessing, image reconstruction, deconvolution, archiving, and real-time monitoring. We comprehensively elaborate the system architecture of the pipeline and the implementation of each subsystem. The DDPP is automatic, robust, scalable, and manageable. The processing performance under a parallel CPU/GPU hybrid system meets the requirements of MUSER data processing. |
资助项目 | National Natural Science Foundation of China[U1231205] ; National Natural Science Foundation of China[61462053] ; National Natural Science Foundation of China[1263004] ; National Natural Science Foundation of China[11203011] ; National Natural Science Foundation of China[11163004] ; National Natural Science Foundation of China[11103005] ; Natural Science Foundation of Yunnan Province[2013FA013] ; Natural Science Foundation of Yunnan Province[2013FA032] ; Natural Science Foundation of Yunnan Province[2013FZ018] |
项目资助者 | National Natural Science Foundation of China[U1231205, 61462053, 1263004, 11203011, 11163004, 11103005] ; Natural Science Foundation of Yunnan Province[2013FA013, 2013FA032, 2013FZ018] |
语种 | 英语 |
学科领域 | 天文学 ; 天文学其他学科 ; 计算机科学技术 |
文章类型 | Article |
出版者 | UNIV CHICAGO PRESS |
出版地 | 1427 E 60TH ST, CHICAGO, IL 60637-2954 USA |
ISSN | 0004-6280 |
URL | 查看原文 |
WOS记录号 | WOS:000352231000007 |
WOS研究方向 | Astronomy & Astrophysics |
WOS类目 | Astronomy & Astrophysics |
关键词[WOS] | FASTBIT |
引用统计 | |
文献类型 | 期刊论文 |
条目标识符 | http://ir.ynao.ac.cn/handle/114a53/4265 |
专题 | 其他 |
通讯作者 | Wang F(王锋) |
作者单位 | 1.Computer Technology Application Key Lab of Yunnan Province, Kunming 2.University of Chinese Academy of Sciences, Beijing 100049, China 3.Yunnan Observatories, Chinese Academy of Sciences, Kunming 650011, 4.Chinese National Observatory, Chinese Academy of Sciences, Beijing |
第一作者单位 | 中国科学院云南天文台 |
通讯作者单位 | 中国科学院云南天文台 |
推荐引用方式 GB/T 7714 | Wang F,Mei, Y,Deng, H,et al. Distributed Data-Processing Pipeline for Mingantu Ultrawide Spectral Radioheliograph[J]. PUBLICATIONS OF THE ASTRONOMICAL SOCIETY OF THE PACIFIC,2015,127(950):383-396. |
APA | Wang F.,Mei, Y.,Deng, H.,Wang, W.,Liu, CY.,...&Ji, KF.(2015).Distributed Data-Processing Pipeline for Mingantu Ultrawide Spectral Radioheliograph.PUBLICATIONS OF THE ASTRONOMICAL SOCIETY OF THE PACIFIC,127(950),383-396. |
MLA | Wang F,et al."Distributed Data-Processing Pipeline for Mingantu Ultrawide Spectral Radioheliograph".PUBLICATIONS OF THE ASTRONOMICAL SOCIETY OF THE PACIFIC 127.950(2015):383-396. |
条目包含的文件 | ||||||
文件名称/大小 | 文献类型 | 版本类型 | 开放类型 | 使用许可 | ||
Distributed Data-Pro(623KB) | 期刊论文 | 出版稿 | 开放获取 | CC BY-NC-SA | 浏览 请求全文 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论