A smart pen-oriented multimodal fusion auxiliary line intent detection algorithm

Baizhou Liu

doi:10.1117/12.3007969

14 November 2023 A smart pen-oriented multimodal fusion auxiliary line intent detection algorithm

Baizhou Liu

Proceedings Volume 12934, Third International Conference on Computer Graphics, Image, and Virtualization (ICCGIV 2023); 1293405 (2023) https://doi.org/10.1117/12.3007969
Event: 2023 3rd International Conference on Computer Graphics, Image and Virtualization (ICCGIV 2023), 2023, Nanjing, China

Abstract

This article proposes a multimodal fusion auxiliary line intention detection algorithm for smart pens. The main innovation of this method lies in: (a) using a depth camera to track the smart pen, allowing the operator to move the smart pen in virtual space through natural hand movements; (b) Select vertices by hovering; (c) Judge the user's intention to make auxiliary lines through the interaction method of integrating operator behavior and voice commands. Compared to the method of understanding intention solely through single channel information of behavioral actions or voice, the method proposed in this article improves the accuracy of intention understanding, reduces the complexity of user operations, and is more in line with the concept of natural interaction. The method proposed in this article has achieved good accuracy and results in a Unity based virtual teaching environment, proving the effectiveness of the proposed algorithm.

(2023) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Baizhou Liu "A smart pen-oriented multimodal fusion auxiliary line intent detection algorithm", Proc. SPIE 12934, Third International Conference on Computer Graphics, Image, and Virtualization (ICCGIV 2023), 1293405 (14 November 2023); https://doi.org/10.1117/12.3007969

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available