Braille block detection at shortest distance by mobile devices

Shotaro Nakamura; Hidehiko Shishido; Yoshinari Kameda

doi:10.1117/12.2666662

25 March 2023 Braille block detection at shortest distance by mobile devices

Shotaro Nakamura, Hidehiko Shishido, Yoshinari Kameda

Proceedings Volume 12592, International Workshop on Advanced Imaging Technology (IWAIT) 2023; 125921R (2023) https://doi.org/10.1117/12.2666662
Event: International Workshop on Advanced Imaging Technology (IWAIT) 2023, 2023, Jeju, Korea, Republic of

Abstract

This research proposes a method based on image recognition technology to guide the visually impaired to the shortest Braille block in situations where they cannot find the existence of Braille blocks. In this paper, we make four proposals. First, we propose a method for detecting Braille blocks using SSD, a deep learning network with our own image dataset. Various kinds of Braille blocks and out-of-specification Braille blocks look different by weathering indoors and outdoors. Second, we propose a detection method that can handle differences in camera height. By constructing a training dataset with images of Braille blocks taken at a person's height or a general robot, we can achieve detection with cameras of different heights. Third, we propose a standalone method, real-time recognition of Braille blocks using the cameras of mobile devices. We incorporate MobileNet, a lightweight deep-learning network, into the SSD network. As a result, we achieve standalone and real-time Braille block recognition by optimizing the network for mobile devices. Finally, we propose a method of estimating the orientation and shortest distance of Braille blocks. It considers the continuous and linear arrangement pattern of guiding blocks that indicate the direction of travel.

Citation Download Citation

Shotaro Nakamura, Hidehiko Shishido, and Yoshinari Kameda "Braille block detection at shortest distance by mobile devices", Proc. SPIE 12592, International Workshop on Advanced Imaging Technology (IWAIT) 2023, 125921R (25 March 2023); https://doi.org/10.1117/12.2666662

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
6 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Cameras

Mobile devices

Visualization

Object detection

Education and training

Deep learning

Buildings

Show All Keywords

Keywords/Phrases

Search In:

Publication Years