A Key-Value Database Optimization Method Based on Raw Flash Device

被引：0
|
作者：
Qin X. [1 ]
Zhang J. [1 ]
Lu Y. [1 ]
Shu J. [1 ]
机构：
[1] Department of Computer Science and Technology, Tsinghua University, Beijing
来源：
Shu, Jiwu (shujw@tsinghua.edu.cn) | 1600年 / Science Press卷 / 54期
基金：
中国国家自然科学基金;
关键词：
Data storage; Flash memory; Key-value database; Lifespan; Raw device;
D O I：
10.7544/issn1000-1239.2017.20170092
中图分类号：
学科分类号：
摘要：
In recent years, NoSQL key-value databases have been widely used. However, the current mainstream key-value databases are based either on disk, or on traditional file system and flash translation layer, which makes it difficult to utilize the characteristics of flash devices, and also limits I/O concurrency of flash devices. Moreover, garbage collection process under such kind of architecture is complex. This paper designs and implements Flashkv, a key-value data management architecture based on raw flash device. Flashkv doesn't use file system and flash translation layer, instead, it's space management and garbage collection are done by the management unit in the user mode. Flashkv makes full use of the concurrent features inside the flash device, and simplifies the garbage collection process and removes redundant function modules which exist in both traditional file system and flash translation layer, and also shortens the I/O path. This paper proposes I/O scheduling technology based on the characteristics of flash memory, which reduces read and write latency of flash memory and improves throughput. The user mode cache management technology is proposed, which reduces write amount and also the cost of frequent system calls. Test results show that Flashkv's performance is 1.9 to 2.2 times that of levelDB and the write amount reduces by 60% to 65%. © 2017, Science Press. All right reserved.
引用
收藏
页码：1326 / 1336
页数：10
相关论文
共 22 条
  • [1] Lu J., Big Data Challenge and NoSQL Technology, pp. 45-46, (2013)
  • [2] Shen D., Yu G., Wang X., Et al., Survey on NoSQL for management of big data, Journal of Software, 24, 8, pp. 1786-1803, (2013)
  • [3] Leavitt N., Will NoSQL databases live up to their promise?, Computer, 43, 2, pp. 12-14, (2010)
  • [4] DeCandia G., Hastorun D., Jampani M., Et al., Dynamo: Amazon's highly available key-value store, ACM SIGOPS Operating Systems Review, 41, 6, pp. 205-220, (2007)
  • [5] Chang F., Dean J., Ghemawat S., Et al., Bigtable: A distributed storage system for structured data, Proc of the 7th USENIX Symp on Operating Systems Design and Implementation, pp. 205-218, (2006)
  • [6] Lu Y., Shu J., Survey on flash-based storage systems, Journal of Computer Research and Development, 50, 1, pp. 49-59, (2013)
  • [7] Zheng W., Li M., Shu J., Flash storage technology, Journal of Computer Research and Development, 47, 4, pp. 716-726, (2010)
  • [8] Chen F., Lee R., Zhang X., Essential roles of exploiting internal parallelism of flash memory based solid state drives in high-speed data processing, Proc of the 17th IEEE Int Symp on High Performance Computer Architecture, pp. 266-277, (2011)
  • [9] Andersen D.G., Franklin J., Kaminsky M., Et al., FAWN: A fast array of wimpy nodes, Proc of the 22nd ACM SIGOPS Symp on Operating Systems Principles, pp. 1-14, (2009)
  • [10] Lee S.W., Moon B., Park C., Et al., A case for flash memory SSD in enterprise database applications, Proc of the 2008 ACM SIGMOD Int Conf on Management of data, pp. 1075-1086, (2008)
123