Design of appearance patent retrieval system based on MapReduce cluster framework

Weimin Ni; Huifen Sun

doi:10.1117/12.3026172

6 May 2024 Design of appearance patent retrieval system based on MapReduce cluster framework

Weimin Ni, Huifen Sun

Proceedings Volume 13161, Fourth International Conference on Telecommunications, Optics, and Computer Science (TOCS 2023); 131610T (2024) https://doi.org/10.1117/12.3026172
Event: Fourth International Conference on Telecommunications, Optics and Computer Science (TOCS 2023), 2023, Xi’an, China

Abstract

The MapReduce task scheduling mechanism and the HDFS storage strategy in Hadoop are lower in the performance of complex heterogeneous application scenarios, and bave become the botteneck of mass data processing. The addresses based on Hadoop platform design patent image retrieval system which is a concrete, in default of MapReduce task scheduling mechanism and HDFS storage strategy in practical application scene performance is poor, respectively, are proposed optimization measures, improve the performance of the system. The main work is as follows: (1) The design principle and execution flow of Hadoop framework, HDFS and MapReduce are deeply analyzed. (2) Aiming at the problem of the actual use of the Hadoop platform in the actual use of the image patent retrieval system, the improvement of the LASE task scheduling strategy and the HIFI storage strategy are improved respectively. (3) The optimization strategy of the image retrieval for the Hadoop platform is verified by experiments. The experimental results show that the optimized system can improve the performance of the Hadoop platform, and reduce the response time of the users’ request.

(2024) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Weimin Ni and Huifen Sun "Design of appearance patent retrieval system based on MapReduce cluster framework", Proc. SPIE 13161, Fourth International Conference on Telecommunications, Optics, and Computer Science (TOCS 2023), 131610T (6 May 2024); https://doi.org/10.1117/12.3026172

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available