High-performance data storage for large solar telescope using distributed file system | |
Liu YB(刘应波)1,2,3; Wang F(王锋)1,2,3; Deng, Hui1,2,3; Dai W(戴伟)1,2,3; Wei SL(卫守林)1,2,3 | |
发表期刊 | Open Automation and Control Systems Journal |
2014 | |
卷号 | 6期号:1页码:823-829 |
DOI | 10.2174/1874444301406010823 |
产权排序 | 第1完成单位 |
收录类别 | EI |
关键词 | Distributed computer systems Lustre High performance storage systems Optical telescopes |
摘要 | New Vacuum Solar Telescope (NVST), which is an altazimuth mounting telescope, is generating data more than 2 TB per day on fine observing conditions. These data impose a great pressure on the performance of real-time data transferring and scalability of the centralized data storage. Our investigation reveals that the combination of commodity servers and the distributed file system is a cost-effective alternative solution to these issues. In this paper, We study the distributed file system to handle the massive data generated by multi-channel data acquisition system under the solar observational environment. An aggregated FITS file based on the feature of the FITS format is employed to further improve the performance of distributed data storage. Experiments show that one single channel can provide the highest writing speed at 420 MB/s under 1 Gb network by using bonding technology. The real-time data transferring rate can supply data capture more than five times than the current in NVST. The works of this paper also provide a reference to highperformance data storage of other large telescopes. |
资助项目 | National Natural Science Foundation of China[U1231205] ; National Natural Science Foundation of China[11263004] ; National Natural Science Foundation of China[11203011] ; National Natural Science Foundation of China[11163004] ; National Natural Science Foundation of China[11103005] ; Natural Science Foundation of Yunnan Province[2013FA013] ; Natural Science Foundation of Yunnan Province[2013FA032] ; Natural Science Foundation of Yunnan Province[2013FZ018] |
项目资助者 | National Natural Science Foundation of China[U1231205, 11263004, 11203011, 11163004, 11103005] ; Natural Science Foundation of Yunnan Province[2013FA013, 2013FA032, 2013FZ018] |
语种 | 英语 |
学科领域 | 天文学 ; 天文学其他学科 ; 计算机科学技术 |
文章类型 | Journal article (JA) |
出版者 | Bentham Science Publishers B.V. |
出版地 | P.O. Box 294, Bussum, 1400 AG, Netherlands |
ISSN | 1874-4443 |
URL | 查看原文 |
归档日期 | 2015-11-27 |
EI入藏号 | 20151900830845 |
EI主题词 | Distributed database systems |
EI分类号 | 657Space Physics - 722.1Data Storage, Equipment and Techniques - 722.4Digital Computers and Systems - 723.2Data Processing and Image Processing - 723.3Database Systems - 741.3Optical Devices and Systems - 912.3Operations Research |
引用统计 | |
文献类型 | 期刊论文 |
条目标识符 | http://ir.ynao.ac.cn/handle/114a53/4256 |
专题 | 其他 |
通讯作者 | Wang F(王锋) |
作者单位 | 1.Yunnan Observatories, Chinese Academy of Sciences, Kunming 650011, China 2.University of Chinese Academy of Sciences, Beijing, 100049, China 3.Computer Technology Application Key Lab of Yunnan Province, Kunming University of Science and Technology, Chenggong, Kunming, 650500, China |
第一作者单位 | 中国科学院云南天文台 |
通讯作者单位 | 中国科学院云南天文台 |
推荐引用方式 GB/T 7714 | Liu YB,Wang F,Deng, Hui,et al. High-performance data storage for large solar telescope using distributed file system[J]. Open Automation and Control Systems Journal,2014,6(1):823-829. |
APA | Liu YB,Wang F,Deng, Hui,Dai W,&Wei SL.(2014).High-performance data storage for large solar telescope using distributed file system.Open Automation and Control Systems Journal,6(1),823-829. |
MLA | Liu YB,et al."High-performance data storage for large solar telescope using distributed file system".Open Automation and Control Systems Journal 6.1(2014):823-829. |
条目包含的文件 | ||||||
文件名称/大小 | 文献类型 | 版本类型 | 开放类型 | 使用许可 | ||
High-Performance Dat(656KB) | 期刊论文 | 出版稿 | 开放获取 | CC BY-NC-SA | 浏览 请求全文 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论