Title
Classification algorithms for big data analysis, a map reduce approach
Date Issued
01 January 2015
Access level
open access
Resource Type
conference paper
Author(s)
Pontifical Catholic University of Rio de Janeiro
Publisher(s)
International Society for Photogrammetry and Remote Sensing
Abstract
Since many years ago, the scientific community is concerned about how to increase the accuracy of different classification methods, and major achievements have been made so far. Besides this issue, the increasing amount of data that is being generated every day by remote sensors raises more challenges to be overcome. In this work, a tool within the scope of InterIMAGE Cloud Platform (ICP), which is an open-source, distributed framework for automatic image interpretation, is presented. The tool, named ICP: Data Mining Package, is able to perform supervised classification procedures on huge amounts of data, usually referred as big data, on a distributed infrastructure using Hadoop MapReduce. The tool has four classification algorithms implemented, taken from WEKA's machine learning library, namely: Decision Trees, Naïve Bayes, Random Forest and Support Vector Machines (SVM). The results of an experimental analysis using a SVM classifier on data sets of different sizes for different cluster configurations demonstrates the potential of the tool, as well as aspects that affect its performance.
Start page
17
End page
21
Volume
40
Issue
3W2
Language
English
OCDE Knowledge area
Ingeniería de sistemas y comunicaciones
Ciencias de la computación
Subjects
Scopus EID
2-s2.0-84925352144
Source
International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences - ISPRS Archives
ISSN of the container
16821750
Conference
Joint ISPRS Conference on Photogrammetric Image Analysis, PIA 2015 and High Resolution Earth Imaging for Geospatial Information, HRIGI 2015
Sponsor(s)
Coordenação de Aperfeiçoamento de Pessoal de Nível Superior
Sources of information:
Directorio de Producción Científica
Scopus