Automatic classification of manga characters using density-based clustering

Hideaki Yanagisawa; Kengo Kyogoku; Jain Ravi; Hiroshi Watanabe

doi:10.1117/12.2566845

1 June 2020 Automatic classification of manga characters using density-based clustering

Hideaki Yanagisawa, Kengo Kyogoku, Jain Ravi, Hiroshi Watanabe

Proceedings Volume 11515, International Workshop on Advanced Imaging Technology (IWAIT) 2020; 115150F (2020) https://doi.org/10.1117/12.2566845
Event: International Workshop on Advanced Imaging Technologies 2020 (IWAIT 2020), 2020, Yogyakarta, Indonesia

Abstract

Manga (Japanese comic) is a globally popular content. In recent years, sales of e-comics that converted to electronic data from paper-based manga are increasing because of the widespread use of electronic terminals. Against this background, it has been proposed to improve the accessibility of e-comics by tagging manga images with metadata. In order to allocate metadata more efficiently, technology that automatically extracts elements such as character and speech is required. One way to classify characters is to get image features from the character's faces and cluster them. Previous research has shown that using the intermediate output of CNN which fine-tuned with character face images is effective for character face recognition. We proposed a clustering method using Density-Based Spatial Clustering of Applications with Noise (DBSCAN) to classify character face images without specifying the number of clusters. However, DBSCAN is greatly affected by the hyperparameter. The purpose of this study is to automatically classify character face images without complicated hyperparameter setting. We examine the application of Ordering Points to Identify the Clustering Structure (OPTICS) and Hierarchical DBSCAN (HDBSCAN), which are density-based clustering algorithms that extend DBSCAN. OPTICS is an algorithm for finding clusters in spatial data, and HDBSCAN is an algorithm extracts flat partition from hierarchical cluster data. We also verify the effective CNN model as the feature extractor of face images. Experimental results showed that HDBSCAN is effective for character face image clustering.

Citation Download Citation

Hideaki Yanagisawa, Kengo Kyogoku, Jain Ravi, and Hiroshi Watanabe "Automatic classification of manga characters using density-based clustering", Proc. SPIE 11515, International Workshop on Advanced Imaging Technology (IWAIT) 2020, 115150F (1 June 2020); https://doi.org/10.1117/12.2566845

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
6 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Dimension reduction

Communication engineering

Algorithm development

Computer engineering

Detection and tracking algorithms

Facial recognition systems

Feature extraction

Show All Keywords

Keywords/Phrases

Search In:

Publication Years