Massive Data HBase Storage Method for Electronic Archive Management

【Author】 Su, Huaquan; Li, Junwei; Guo, Li; Wang, Wanshuo; Yang, Yongjiao; Wen, You; Li, Kai; Mo, Pingyan

【Source】INTERNATIONAL JOURNAL OF NETWORK MANAGEMENT

【影响因子】1.914

【Abstract】The acceleration of the digitalization process in enterprise and university education management has generated a massive amount of electronic archive data. In order to improve the intelligence, storage quality, and efficiency of electronic records management and achieve efficient storage and fast retrieval of data storage models, this study proposes a massive data storage model based on HBase and its retrieval optimization scheme design. In addition, HDFS is introduced to construct a two-level storage structure and optimize values to improve the scalability and load balancing of HBase, and the retrieval efficiency of the HBase storage model is improved through SL-TCR and BF filters. The results indicated that HDFS could automatically recover data after node, network partition, and NameNode failures. The write time of HBase was 56 s, which was 132 and 246 s less than Cassandra and CockroachDB. The query latency was reduced by 23% and 32%, and the query time was reduced by 9988.51 ms, demonstrating high reliability and efficiency. The delay of BF-SL-TCL was 1379.28 s after 1000 searches, which was 224.78 and 212.74 s less than SL-TCL and Blockchain Retrieval Acceleration and reduced the delay under high search times. In summary, this storage model has obvious advantages in storing massive amounts of electronic archive data and has high security and retrieval efficiency, which provides important reference for the design of storage models for future electronic archive management. The storage model designed by the research institute has obvious advantages in storing massive electronic archive data, solving the problem of lack of scalability in electronic archive management when facing massive data, and has high security and retrieval efficiency. It has important reference for the design of storage models for future electronic archive management.

【Keywords】data compression; distributed storage; electronic archive management; HBase; HDFS; massive data

【发表时间】2024 2024 OCT 27

【收录时间】2024-11-09

【文献类型】案例研究

【主题类别】

区块链技术-协同技术-数据管理