• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
成果搜索

author:

Li, K. (Li, K..) [1] | Guo, K. (Guo, K..) [2] | Guo, H. (Guo, H..) [3]

Indexed by:

Scopus

Abstract:

In the era of big data, HBase has been widely used in scenarios of massive unstructured data. For the financial big data, due to the integrity and timing of it, unreasonable data storage and management usually lead to hot spots that decreases the query performance. In practice, the separation of hot and cold financial data will improve data query performance and utilization rate of cluster resources. In this paper, a hot and cold data separation scheme is designed, to store infrequently queried financial data to HBase, and frequently queried one to Redis. The cold data is reasonably planned and managed through pre-partitioning and row key design for HBase. A hot data cache based on Redis is realized to improve the query speed and reduces the pressure of HBase. In addition, due to the lack of Redis's inherent cache elimination strategy, we propose a caching strategy based on the frequencies of updating and querying operations. The experimental results show that the scheme can effectively avoid the hot storage problem, and improve the query performance, and improve the cache hit ratio of Redis. Therefore, the number of cold data access requests can be effectively reduced. © 2019 IEEE.

Keyword:

Cache elimination; Financial big data; Hbase; Hot and cold data; Redis

Community:

  • [ 1 ] [Li, K.]Fujian Provincial Key Laboratory of Network Computing, Intelligent Information Processing, College of Mathematics and Computer Science, Fuzhou University, Fuzhou, 350108, China
  • [ 2 ] [Li, K.]College of Mathematics and Computer Science, Fuzhou University, Fuzhou, 350108, China
  • [ 3 ] [Guo, K.]Fujian Provincial Key Laboratory of Network Computing, Intelligent Information Processing, College of Mathematics and Computer Science, Fuzhou University, Fuzhou, 350108, China
  • [ 4 ] [Guo, K.]College of Mathematics and Computer Science, Fuzhou University, Fuzhou, 350108, China
  • [ 5 ] [Guo, H.]College of Mathematics and Computer Science, Fuzhou University, Fuzhou, 350108, China

Reprint 's Address:

Email:

Show more details

Related Keywords:

Related Article:

Source :

SocialCom 2019

Year: 2019

Page: 1612-1617

Language: English

Cited Count:

WoS CC Cited Count:

SCOPUS Cited Count: 5

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 3

Affiliated Colleges:

Online/Total:137/9984517
Address:FZU Library(No.2 Xuyuan Road, Fuzhou, Fujian, PRC Post Code:350116) Contact Us:0591-22865326
Copyright:FZU Library Technical Support:Beijing Aegean Software Co., Ltd. 闽ICP备05005463号-1