IPFS Keyword Retrieval System Based on Merkle DAG Inverted Index

Authors

  • Lin Shi
  • Jun Lu
  • Xu Zhang
  • Yuan Cao
  • Jinchuan Kang

DOI:

https://doi.org/10.62051/ijcsit.v2n2.16

Keywords:

IPFS; Merkle DAG; Distributed storage; CRDT; Inverted index

Abstract

In recent years, IPFS, as an emerging P2P network technology, has been gaining increasing popularity. There have been numerous studies on the issue of cluster retrieval in P2P networks. This paper proposes an inverted index structure implemented through Merkle DAG, and ensures the eventual consistency of inverted index information among multiple nodes in the cluster through CRDT technology, thereby realizing a relatively effective cluster keyword retrieval scheme based on IPFS. The redundant data is reduced by improving the storage mechanism of cache. The experiments on real data sets prove the effectiveness of the proposed method.

Downloads

Download data is not yet available.

References

Kang peng, Yang Wenzhong, Zheng Jiong. Blockchain PRivate File Storage-Sharing Method Based on IPFS[J]. Sensors, 2022, 22(14)

BENET J. IPFS-content addressed, versioned, p2p file system[j]. arXiv E-print, 2014: arXiv: 1407.3561.

Khudhur N, Fujita S. Siva-The PFS search engine[C]/2019 Seventh International Symposium on Computing and Networking (CANDAR). IEEE, 2019: 150-156.

Zhu Liyan, Xiao Chuqiao, Gong Xueqing. Keyword search in decentralized storage systems[J]. Electronics, 2020, 9(12): 2041.

Klems M, Eberhardt J, Tai S, et al. Trustless intermediation in blockchain-based decentralized service marketplaces[C]/International. Conference on Service-Oriented Computing. Malaga: Springer, Cham, 2017: 731-739.

Mosharraf sharafat Ibn Mollah, Adnan Muhammad Abdullah. Improving lookup and query execution performance in distributed Big Data systems using Cuckoo Filter[J]. Journal of Big Data,2022,9(1).

Huang sui, Li Jian, Fan Bingbing. IABC: A cross-domain authentication method based on blockchain and cuckoo filter [J]. Small Microcomputer system, 2020, 41(12): 2620-2625.

Deng yingying. Optimization and Application of Cuckoo Hash Table [D]. Nanjing university of posts and Telecommunications, 2021. DOI: 10.27251/d.cnki.gnjdc.2021.000705.

BRUIN M D. Search engine for the interplanetary file system[EB/OL].[2020-12-21].https://github.com/ipfs-search/ipfs-search.

KHUDHUR N, FUJITA S. Siva-the IPFS search engine[C]//Proceedings of the 2019 Seventh International Symposium on Computing and Networking(CANDAR), Nagasaki, Japan, Nov 26- 29, 2019.Los Alamitos: IEEE Computer SOC, 2019: 150-156.

Downloads

Published

26-04-2024

Issue

Section

Articles

How to Cite

Shi, L., Lu, J., Zhang, X., Cao, Y., & Kang, J. (2024). IPFS Keyword Retrieval System Based on Merkle DAG Inverted Index. International Journal of Computer Science and Information Technology, 2(2), 146-154. https://doi.org/10.62051/ijcsit.v2n2.16