Conversational sensing

Alun Preece; Chris Gwilliams; Christos Parizas; Diego Pizzocaro; Jonathan Z. Bakdash; Dave Braines

doi:10.1117/12.2053283

22 May 2014 Conversational sensing

Alun Preece, Chris Gwilliams, Christos Parizas, Diego Pizzocaro, Jonathan Z. Bakdash, Dave Braines

Proceedings Volume 9122, Next-Generation Analyst II; 91220I (2014) https://doi.org/10.1117/12.2053283
Event: SPIE Sensing Technology + Applications, 2014, Baltimore, MD, United States

Abstract

Recent developments in sensing technologies, mobile devices and context-aware user interfaces have made it pos- sible to represent information fusion and situational awareness for Intelligence, Surveillance and Reconnaissance (ISR) activities as a conversational process among actors at or near the tactical edges of a network. Motivated by use cases in the domain of Company Intelligence Support Team (CoIST) tasks, this paper presents an approach to information collection, fusion and sense-making based on the use of natural language (NL) and controlled nat- ural language (CNL) to support richer forms of human-machine interaction. The approach uses a conversational protocol to facilitate a ow of collaborative messages from NL to CNL and back again in support of interactions such as: turning eyewitness reports from human observers into actionable information (from both soldier and civilian sources); fusing information from humans and physical sensors (with associated quality metadata); and assisting human analysts to make the best use of available sensing assets in an area of interest (governed by man- agement and security policies). CNL is used as a common formal knowledge representation for both machine and human agents to support reasoning, semantic information fusion and generation of rationale for inferences, in ways that remain transparent to human users. Examples are provided of various alternative styles for user feedback, including NL, CNL and graphical feedback. A pilot experiment with human subjects shows that a prototype conversational agent is able to gather usable CNL information from untrained human subjects.

Citation Download Citation

Alun Preece, Chris Gwilliams, Christos Parizas, Diego Pizzocaro, Jonathan Z. Bakdash, and Dave Braines "Conversational sensing", Proc. SPIE 9122, Next-Generation Analyst II, 91220I (22 May 2014); https://doi.org/10.1117/12.2053283

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available