Title
On the architecture of a big data classification tool based on a map reduce approach for hyperspectral image analysis
Date Issued
10 November 2015
Access level
metadata only access
Resource Type
conference paper
Author(s)
Ferreira R.S.
Happ P.N.
Oliveira D.A.B.
Costa G.A.O.P.
Feitosa R.Q.
Plaza A.
Gamba P.
Pontifical Catholic University of Rio de Janeiro
Publisher(s)
Institute of Electrical and Electronics Engineers Inc.
Abstract
Advances in remote sensors are providing exceptional quantities of large-scale data with increasing spatial, spectral and temporal resolutions, raising new challenges in its analysis, e.g. those presents in classification processes. This work presents the architecture of the InterIMAGE Cloud Platform (ICP): Data Mining Package; a tool able to perform supervised classification procedures on huge amounts of data, on a distributed infrastructure. The architecture is implemented on top of the MapReduce framework. The tool has four classification algorithms implemented taken from WEKA's machine learning library, namely: Decision Trees, Naïve Bayes, Random Forest and Support Vector Machines. The SVM classifier was applied on datasets of different sizes (2 GB, 4 GB and 10 GB) for different cluster configurations (5, 10, 20, 50 nodes). The results show the tool as a potential approach to parallelize classification processes on big data.
Start page
1508
End page
1511
Volume
2015-November
Language
English
OCDE Knowledge area
Informática y Ciencias de la Información
Scopus EID
2-s2.0-84962592030
ISBN
9781479979295
Conference
International Geoscience and Remote Sensing Symposium (IGARSS)
Sponsor(s)
The Institute of Electrical and Electronics Engineers Geoscience and Remote Sensing Society (IEEE GRSS)
Sources of information: Directorio de Producción Científica Scopus