Low-cost high performance distributed data storage for multi-channel observations | |
Liu YB(刘应波)1,2,3; Wang F(王锋)1,2,3; Deng, H1; Ji, KF1; Dai W(戴伟)1,2,3; Wei SL(卫守林)1,2,3; Liang, B1; Zhang, XL1 | |
发表期刊 | NEW ASTRONOMY |
2015-10 | |
卷号 | 40页码:78-86 |
DOI | 10.1016/j.newast.2015.04.005 |
产权排序 | 第2完成单位 |
收录类别 | SCI |
关键词 | Astronomical Databases: Miscellaneous Methods: Massive Solar Data Storage Techniques: High Performance I/o |
摘要 | The New Vacuum Solar Telescope (NVST) is a 1-m solar telescope that aims to observe the fine structures in both the photosphere and the chromosphere of the Sun. The observational data acquired simultaneously from one channel for the chromosphere and two channels for the photosphere bring great challenges to the data storage of NVST. The multi-channel instruments of NVST, including scientific cameras and multi-band spectrometers, generate at least 3 terabytes data per day and require high access performance while storing massive short-exposure images. It is worth studying and implementing a storage system for NVST which would balance the data availability, access performance and the cost of development. In this paper, we build a distributed data storage system (DDSS) for NVST and then deeply evaluate the availability of real-time data storage on a distributed computing environment. The experimental results show that two factors, i.e., the number of concurrent read/write and the file size, are critically important for improving the performance of data access on a distributed environment. Referring to these two factors, three strategies for storing FITS files are presented and implemented to ensure the access performance of the DDSS under conditions of multi-host write and read simultaneously. The real applications of the DDSS proves that the system is capable of meeting the requirements of NVST real-time high performance observational data storage. Our study on the DDSS is the first attempt for modern astronomical telescope systems to store real-time observational data on a low-cost distributed system. The research results and corresponding techniques of the DDSS provide a new option for designing real-time massive astronomical data storage system and will be a reference for future astronomical data storage. (C) 2015 Elsevier B.V. All rights reserved. |
资助项目 | National Natural Science Foundation of China[U1231205] ; National Natural Science Foundation of China[11263004] ; National Natural Science Foundation of China[11203011] ; National Natural Science Foundation of China[11163004] ; National Natural Science Foundation of China[11103005] ; Natural Science Foundation of Yunnan Province[2013FA013] ; Natural Science Foundation of Yunnan Province[2013FA032] ; Natural Science Foundation of Yunnan Province[2013FZ018] |
项目资助者 | National Natural Science Foundation of China[U1231205, 11263004, 11203011, 11163004, 11103005] ; Natural Science Foundation of Yunnan Province[2013FA013, 2013FA032, 2013FZ018] |
语种 | 英语 |
学科领域 | 天文学 ; 天文学其他学科 ; 计算机科学技术 |
文章类型 | Article |
出版者 | ELSEVIER SCIENCE BV |
出版地 | PO BOX 211, 1000 AE AMSTERDAM, NETHERLANDS |
ISSN | 1384-1076 |
URL | 查看原文 |
WOS记录号 | WOS:000356552700009 |
WOS研究方向 | Astronomy & Astrophysics |
WOS类目 | Astronomy & Astrophysics |
引用统计 | |
文献类型 | 期刊论文 |
条目标识符 | http://ir.ynao.ac.cn/handle/114a53/4257 |
专题 | 其他 |
通讯作者 | Wang F(王锋) |
作者单位 | 1.Computer Technology Application Key Lab of Yunnan Province, Kunming University of Science and Technology, Chenggong, Kunming 650500, China 2.Yunnan Observatories, Chinese Academy of Sciences, Kunming 650011, China 3.University of Chinese Academy of Sciences, Beijing 100049, China |
第一作者单位 | 中国科学院云南天文台 |
通讯作者单位 | 中国科学院云南天文台 |
推荐引用方式 GB/T 7714 | Liu YB,Wang F,Deng, H,et al. Low-cost high performance distributed data storage for multi-channel observations[J]. NEW ASTRONOMY,2015,40:78-86. |
APA | Liu YB.,Wang F.,Deng, H.,Ji, KF.,Dai W.,...&Zhang, XL.(2015).Low-cost high performance distributed data storage for multi-channel observations.NEW ASTRONOMY,40,78-86. |
MLA | Liu YB,et al."Low-cost high performance distributed data storage for multi-channel observations".NEW ASTRONOMY 40(2015):78-86. |
条目包含的文件 | ||||||
文件名称/大小 | 文献类型 | 版本类型 | 开放类型 | 使用许可 | ||
Low-cost high perfor(1144KB) | 期刊论文 | 出版稿 | 开放获取 | CC BY-NC-SA | 浏览 请求全文 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论