YNAO OpenIR  > 其他
Low-cost high performance distributed data storage for multi-channel observations
Liu YB(刘应波)1,2,3; Wang F(王锋)1,2,3; Deng, H1; Ji, KF1; Dai W(戴伟)1,2,3; Wei SL(卫守林)1,2,3; Liang, B1; Zhang, XL1
发表期刊NEW ASTRONOMY
2015-10
卷号40页码:78-86
DOI10.1016/j.newast.2015.04.005
产权排序第2完成单位
收录类别SCI
关键词Astronomical Databases: Miscellaneous Methods: Massive Solar Data Storage Techniques: High Performance I/o
摘要

The New Vacuum Solar Telescope (NVST) is a 1-m solar telescope that aims to observe the fine structures in both the photosphere and the chromosphere of the Sun. The observational data acquired simultaneously from one channel for the chromosphere and two channels for the photosphere bring great challenges to the data storage of NVST. The multi-channel instruments of NVST, including scientific cameras and multi-band spectrometers, generate at least 3 terabytes data per day and require high access performance while storing massive short-exposure images. It is worth studying and implementing a storage system for NVST which would balance the data availability, access performance and the cost of development. In this paper, we build a distributed data storage system (DDSS) for NVST and then deeply evaluate the availability of real-time data storage on a distributed computing environment. The experimental results show that two factors, i.e., the number of concurrent read/write and the file size, are critically important for improving the performance of data access on a distributed environment. Referring to these two factors, three strategies for storing FITS files are presented and implemented to ensure the access performance of the DDSS under conditions of multi-host write and read simultaneously. The real applications of the DDSS proves that the system is capable of meeting the requirements of NVST real-time high performance observational data storage. Our study on the DDSS is the first attempt for modern astronomical telescope systems to store real-time observational data on a low-cost distributed system. The research results and corresponding techniques of the DDSS provide a new option for designing real-time massive astronomical data storage system and will be a reference for future astronomical data storage. (C) 2015 Elsevier B.V. All rights reserved.

资助项目National Natural Science Foundation of China[U1231205] ; National Natural Science Foundation of China[11263004] ; National Natural Science Foundation of China[11203011] ; National Natural Science Foundation of China[11163004] ; National Natural Science Foundation of China[11103005] ; Natural Science Foundation of Yunnan Province[2013FA013] ; Natural Science Foundation of Yunnan Province[2013FA032] ; Natural Science Foundation of Yunnan Province[2013FZ018]
项目资助者National Natural Science Foundation of China[U1231205, 11263004, 11203011, 11163004, 11103005] ; Natural Science Foundation of Yunnan Province[2013FA013, 2013FA032, 2013FZ018]
语种英语
学科领域天文学 ; 天文学其他学科 ; 计算机科学技术
文章类型Article
出版者ELSEVIER SCIENCE BV
出版地PO BOX 211, 1000 AE AMSTERDAM, NETHERLANDS
ISSN1384-1076
URL查看原文
WOS记录号WOS:000356552700009
WOS研究方向Astronomy & Astrophysics
WOS类目Astronomy & Astrophysics
引用统计
被引频次:4[WOS]   [WOS记录]     [WOS相关记录]
文献类型期刊论文
条目标识符http://ir.ynao.ac.cn/handle/114a53/4257
专题其他
通讯作者Wang F(王锋)
作者单位1.Computer Technology Application Key Lab of Yunnan Province, Kunming University of Science and Technology, Chenggong, Kunming 650500, China
2.Yunnan Observatories, Chinese Academy of Sciences, Kunming 650011, China
3.University of Chinese Academy of Sciences, Beijing 100049, China
第一作者单位中国科学院云南天文台
通讯作者单位中国科学院云南天文台
推荐引用方式
GB/T 7714
Liu YB,Wang F,Deng, H,et al. Low-cost high performance distributed data storage for multi-channel observations[J]. NEW ASTRONOMY,2015,40:78-86.
APA Liu YB.,Wang F.,Deng, H.,Ji, KF.,Dai W.,...&Zhang, XL.(2015).Low-cost high performance distributed data storage for multi-channel observations.NEW ASTRONOMY,40,78-86.
MLA Liu YB,et al."Low-cost high performance distributed data storage for multi-channel observations".NEW ASTRONOMY 40(2015):78-86.
条目包含的文件
文件名称/大小 文献类型 版本类型 开放类型 使用许可
Low-cost high perfor(1144KB)期刊论文出版稿开放获取CC BY-NC-SA浏览 请求全文
个性服务
推荐该条目
保存到收藏夹
查看访问统计
导出为Endnote文件
谷歌学术
谷歌学术中相似的文章
[Liu YB(刘应波)]的文章
[Wang F(王锋)]的文章
[Deng, H]的文章
百度学术
百度学术中相似的文章
[Liu YB(刘应波)]的文章
[Wang F(王锋)]的文章
[Deng, H]的文章
必应学术
必应学术中相似的文章
[Liu YB(刘应波)]的文章
[Wang F(王锋)]的文章
[Deng, H]的文章
相关权益政策
暂无数据
收藏/分享
文件名: Low-cost high performance distributed data storage for multi-channel observations.pdf
格式: Adobe PDF
所有评论 (0)
暂无评论
 

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。