Improving situational awareness with collective artificial intelligence over knowledge graphs

Meng Jiang

doi:10.1117/12.2556746

21 April 2020 Improving situational awareness with collective artificial intelligence over knowledge graphs

Meng Jiang

Proceedings Volume 11413, Artificial Intelligence and Machine Learning for Multi-Domain Operations Applications II; 114130J (2020) https://doi.org/10.1117/12.2556746
Event: SPIE Defense + Commercial Sensing, 2020, Online Only

Abstract

Situational awareness (SA) was defined as perception of environmental elements within the situation, comprehension, and projection of future status. Here the perception is the representation of sensory information that includes multi-typed interacting objects forming knowledge graphs." A typical problem in artificial intelligence (AI) research is to learn representations of objects that preserve structural information in knowledge graphs (KGs). Existing methods assume an AI agent has a complete knowledge graph, and any kind of prediction can be made accurately by a single AI. However, the real world needs multiple AI agents (e.g., warfighters, citizens) to collectively make a prediction. Each AI has a different, incomplete view of the knowledge graph with noise. In this work, I present a novel approach to improve representation learning and thus to improve SA with collective AI over KGs. I present the approach in four parts. First, I introduce knowledge graph and its nature of heterogeneity with multiple examples in the real world. Second, I discuss four ideas of making prediction with collective AI: prediction ensemble, data aggregation, representation aggregation, and joint representation learning. Third, I describe two state-of-the-art models to learn object representations from heterogeneous graphs: one is path- based embedding and the other is a graph neural network (GNN). Lastly, I present a new GNN framework that jointly learns object representations from multiple agents. Experimental results demonstrate that collective AI performs significantly better than individual AI. In future work, I discuss about federated learning that may improve security and privacy of the framework, which is quite necessary when any type of sharing (e.g., raw data, object representations, or learning process) is sensitive.

Conference Presentation

Citation Download Citation

Meng Jiang "Improving situational awareness with collective artificial intelligence over knowledge graphs", Proc. SPIE 11413, Artificial Intelligence and Machine Learning for Multi-Domain Operations Applications II, 114130J (21 April 2020); https://doi.org/10.1117/12.2556746

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available