An approach for meteorological data integration and stream processing

Hdafa, Mohamed; Zouhairi, Youssef; Lemoudden, Mouad; Ziyati, Elhoussaine

Abstract

Real-time big data processing is a crucial need of meteorology today. As a matter of fact, the weather is a determining factor in decision making in different areas such as air or sea transport, so acquiring knowledge of the environment in real time is a consequential question. A promising approach for big data treatment in real time is based on the concept of complex events processing CEP). The CEP aims to identify significant events in a cloud of simple and individually detectable events in real time. The meteorological variables, constituting simple event's spaces, offer significant flow of data to be processed using CEP technologies. This real-time data processing is done by phase of their integration with weather systems. This paper discusses the big data's meteorological aspects, and shows the architectural model for integration of weather data and its processing in real time.

• Presentation Conference Type: Conference Paper (Published)
• Conference Name: 2016 Third International Conference on Systems of Collaboration (SysCo)
• Start Date: Nov 28, 2016
• End Date: Nov 29, 2016
• Online Publication Date: Jan 26, 2017
• Publication Date: 2016-11
• Deposit Date: Feb 28, 2023
• Publisher: Institute of Electrical and Electronics Engineers
• Book Title: 2016 Third International Conference on Systems of Collaboration (SysCo)
• DOI: https://doi.org/10.1109/sysco.2016.7831342
• Keywords: Big data streaming , Meteorology , Complex Event Processing , spChains , SOS