Hadoop Perfect File: A fast and memory-efficient metadata access archive file to face small files problem in HDFS

Open Webpage

Yanlong Zhai, Jude Tchaye-Kondi, Kwei-Jay Lin, Liehuang Zhu, Wenjun Tao, Xiaojiang Du, Mohsen Guizani

Published: 01 Jan 2021, Last Modified: 05 Feb 2025J. Parallel Distributed Comput. 2021EveryoneRevisionsBibTeXCC BY-SA 4.0
Abstract: Highlights•Direct metadata access using perfect hashing.•Archive base solution to HDFS small files problems.•Small files access performance optimization using hashing techniques.•Dynamic index files.