Frameworks for management, storage and preparation of large data volumes Big Data

Abstract

Weather systems like the World Meteorological Organization ́s Global Information System need to store different kinds of images, data and files. Big Data and its 3V paradigm can provide a suitable solution to solve this problem. This tutorial presents some concepts around the Hadoop framework, de facto standard implementation of Big Data, and how to store semi-estructured data generated by automatic weather stations using this framework. Finally, a formal method to generate weather reports using Hadoop ́s ecosystem frameworks is presented.

Keywords

• Big Data
• Hadoop
• HDFS
• World Meteorological Organization
• Global Observing System
• Internet of Things