NVST DATA ARCHIVING SYSTEM BASED ON FASTBIT NOSQL DATABASE | |
Liu YB(刘应波)1,2,3; Wang F(王锋)1,2,3; Ji, KF1; Deng, H1; Dai W(戴伟)1,2,3; Liang, B1 | |
发表期刊 | JOURNAL OF THE KOREAN ASTRONOMICAL SOCIETY |
2014-06-30 | |
卷号 | 47期号:3页码:115-122 |
DOI | 10.5303/JKAS.2014.47.3.115 |
产权排序 | 第2完成单位 |
收录类别 | SCI |
关键词 | Astronomical Databases: Miscellaneous Techniques: Indexing And Querying Techniques: Data Archiving System |
摘要 | The New Vacuum Solar Telescope (NVST) is a 1-meter vacuum solar telescope that aims to observe the fine structures of active regions on the Sun. The main tasks of the NVST are high resolution imaging and spectral observations, including the measurements of the solar magnetic field. The NVST has been collecting more than 20 million FITS files since it began routine observations in 2012 and produces a maximum observational records of 120 thousand files in a day. Given the large amount of files, the effective archiving and retrieval of files becomes a critical and urgent problem. In this study, we implement a new data archiving system for the NVST based on the Fastbit Not Only Structured Query Language (NoSQL) database. Comparing to the relational database (i.e., MySQL; My Structured Query Language), the Fastbit database manifests distinctive advantages on indexing and querying performance. In a large scale database of 40 million records, the multi-field combined query response time of Fastbit database is about 15 times faster and fully meets the requirements of the NVST. Our study brings a new idea for massive astronomical data archiving and would contribute to the design of data management systems for other astronomical telescopes. |
资助项目 | National Natural Science Foundation of China[U1231205] ; National Natural Science Foundation of China[11263004] ; National Natural Science Foundation of China[11203011] ; National Natural Science Foundation of China[11163004] ; National Natural Science Foundation of China[11103005] ; National Natural Science Foundation of China[2013FA013] ; National Natural Science Foundation of China[2013FA032] |
项目资助者 | National Natural Science Foundation of China[U1231205, 11263004, 11203011, 11163004, 11103005, 2013FA013, 2013FA032] |
语种 | 英语 |
学科领域 | 天文学 ; 天文学其他学科 ; 计算机科学技术 |
文章类型 | Article |
出版者 | KOREAN ASTRONOMICAL SOCIETY |
出版地 | 61-1 HWA-AM DONG, YUSUNG KU, TAEJON, 305-348, SOUTH KOREA |
ISSN | 1225-4614 |
URL | 查看原文 |
WOS记录号 | WOS:000339089900004 |
WOS研究方向 | Astronomy & Astrophysics |
WOS类目 | Astronomy & Astrophysics |
关键词[WOS] | BITMAP INDEXES |
引用统计 | |
文献类型 | 期刊论文 |
条目标识符 | http://ir.ynao.ac.cn/handle/114a53/4252 |
专题 | 其他 |
通讯作者 | Wang F(王锋) |
作者单位 | 1.Computer Technology Application Key Lab of Yunnan Province, Kunming University of Science and Technology, Chenggong, Kunming 650500, China 2.Yunnan Observatories, Chinese Academy of Sciences, Kunming 650011, China 3.University of Chinese Academy of Sciences, Beijing 100049, China |
第一作者单位 | 中国科学院云南天文台 |
通讯作者单位 | 中国科学院云南天文台 |
推荐引用方式 GB/T 7714 | Liu YB,Wang F,Ji, KF,et al. NVST DATA ARCHIVING SYSTEM BASED ON FASTBIT NOSQL DATABASE[J]. JOURNAL OF THE KOREAN ASTRONOMICAL SOCIETY,2014,47(3):115-122. |
APA | Liu YB,Wang F,Ji, KF,Deng, H,Dai W,&Liang, B.(2014).NVST DATA ARCHIVING SYSTEM BASED ON FASTBIT NOSQL DATABASE.JOURNAL OF THE KOREAN ASTRONOMICAL SOCIETY,47(3),115-122. |
MLA | Liu YB,et al."NVST DATA ARCHIVING SYSTEM BASED ON FASTBIT NOSQL DATABASE".JOURNAL OF THE KOREAN ASTRONOMICAL SOCIETY 47.3(2014):115-122. |
条目包含的文件 | ||||||
文件名称/大小 | 文献类型 | 版本类型 | 开放类型 | 使用许可 | ||
NVST DATA ARCHIVING (399KB) | 期刊论文 | 出版稿 | 开放获取 | CC BY-NC-SA | 浏览 请求全文 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论