CONFERENCE PROCEEDINGS
Advanced Search
Home > Proceedings > Volume 12612 > Article
Paper
14 April 2023 A real-time integration scheme of multi-source heterogeneous data based on Flink
Peilin Li, Yun Lin, Qianqian Chen
Author Affiliations +
Proceedings Volume 12612, International Conference on Artificial Intelligence and Industrial Design (AIID 2022); 126120V (2023) https://doi.org/10.1117/12.2673010
Event: International Conference on Artificial Intelligence and Industrial Design (AIID 2022), 2022, Zhuhai, China
Abstract
Data integration technology is of great significance to all kinds of analysis and decision-making systems based on largescale data. The difficulty of data integration lies in the diversity of data sources, data types and data storage methods, which makes it difficult to integrate data in real time. To solve the above problems, this paper designs a scheme, which uses the real-time stream processing characteristics of Apache Flink to realize the real-time integration of multi-source heterogeneous data through log capture and user-defined data processing. Through this scheme, multi-source heterogeneous data can be integrated into one place to provide data support for all kinds of big data analysis and decision-making.
© (2023) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Citation Download Citation
Peilin Li, Yun Lin, and Qianqian Chen "A real-time integration scheme of multi-source heterogeneous data based on Flink", Proc. SPIE 12612, International Conference on Artificial Intelligence and Industrial Design (AIID 2022), 126120V (14 April 2023); https://doi.org/10.1117/12.2673010
ACCESS THE FULL ARTICLE
ORGANIZATIONAL
Sign in with credentials provided by your organization.
INSTITUTIONAL
Select your institution to access the SPIE Digital Library.
SELECT YOUR INSTITUTION
PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.
PERSONAL SIGN IN
No SPIE Account? Create one
PURCHASE THIS CONTENT
SUBSCRIBE TO DIGITAL LIBRARY
50 downloads per 1-year subscription
Members: $195
Non-members: $335 ADD TO CART
25 downloads per 1 - year subscription
Members: $145
Non-members: $250 ADD TO CART
PURCHASE SINGLE ARTICLE
Includes PDF, HTML & Video, when available
Members: $17.00
Non-members: $21.00 ADD TO CART
PROCEEDINGS
 5 PAGES
DOWNLOAD PAPER SAVE TO MY LIBRARY
GET CITATION
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Data integration
Databases
Data processing
Data storage
Connectors
Data conversion
RELATED CONTENT
Subscribe to Digital Library
Receive Erratum Email Alert
Back to Top